ReadMeFeed / Community knowledge
Real questions. Useful conversations. Find the people who know your stack.
HDFS Erasure Coding in Hadoop 3.x cuts raw storage overhead from 200% to ~50% using Reed-Solomon RS-6-3. This blog walks through enabling EC on a cold-data directory, the write/read trade-offs, and operational guardrails for production clusters.
HDFS erasure coding cuts storage overhead from 200% to roughly 50% for cold data, at the cost of CPU and read complexity. Here's how to enable it and verify the savings.
Learn how to use HDFS snapshots to protect data, roll back changes, and integrate with Hadoop tools—plus the trade‑offs that keep namespace usage in check.
Reduce HDFS storage overhead from 3x to 1.5x using Erasure Coding in Hadoop 3.x. Learn how to configure policies and verify EC block types for cold data workloads.
A step-by-step guide to implementing HDFS Federation with ViewFS to overcome NameNode memory limits by distributing namespace across multiple nameservices while sharing DataNodes.
HDFS Erasure Coding in Hadoop 3.x cuts storage overhead from 3× to ~1.5× for cold data. Here's how to enable RS-6-3, verify it with fsck, and weigh the CPU and latency trade-offs.
HDFS Erasure Coding cuts storage overhead from 3× to ~1.5× for cold data. Learn how Reed-Solomon policies work, how to enable them per directory, and where EC hurts.
HDFS erasure coding in Hadoop 3.x cuts storage overhead from 200% to ~50% for cold data. A worked RS-6-3 configuration, verification steps, and the limits that matter.
HDFS High Availability lets a Hadoop cluster survive a NameNode failure by using ZooKeeper and JournalNodes. This guide shows the core-site.xml configuration, explains the failover mechanism, and highlights common pitfalls to avoid.
hadoop