ReadMeFeed / Community knowledge
Real questions. Useful conversations. Find the people who know your stack.
Triple replication costs 200 percent overhead for cold HDFS data. Erasure coding in Hadoop 3.x drops that to roughly 50 percent, but adds read and reconstruction cost. Here is how to decide, configure, and verify.
Cut HDFS storage costs with erasure coding: apply a 4+2 policy to a directory, write a 500 MB file, verify 1.5× overhead, and understand trade‑offs like recovery latency and write‑once restrictions.
Stop wasting 200% extra storage on cold data. Learn how to implement HDFS Erasure Coding to reduce overhead to 50% while maintaining fault tolerance.
HDFS Erasure Coding in Hadoop 3.x cuts storage overhead from 3x replication to ~1.5x for cold data. Here's how Reed-Solomon policies work, how to apply them, and the read-performance trade-off.
HDFS Erasure Coding in Hadoop 3.x cuts raw storage overhead from 200% to ~50% using Reed-Solomon RS-6-3. This blog walks through enabling EC on a cold-data directory, the write/read trade-offs, and operational guardrails for production clusters.
HDFS erasure coding cuts storage overhead from 200% to roughly 50% for cold data, at the cost of CPU and read complexity. Here's how to enable it and verify the savings.
Reduce HDFS storage overhead from 3x to 1.5x using Erasure Coding in Hadoop 3.x. Learn how to configure policies and verify EC block types for cold data workloads.
HDFS Erasure Coding in Hadoop 3.x cuts storage overhead from 3× to ~1.5× for cold data. Here's how to enable RS-6-3, verify it with fsck, and weigh the CPU and latency trade-offs.
HDFS Erasure Coding cuts storage overhead from 3× to ~1.5× for cold data. Learn how Reed-Solomon policies work, how to enable them per directory, and where EC hurts.
hadoop