Explore

Articles
General
Community
Search

Community

Members
Leaderboards
Achievements
Community guidelines

The essentials

About ReadMeFeed
Privacy
Terms of use
Moderation policy

Home Community Create Inbox Profile

ReadMeFeed / Community knowledge

#etl-pipeline

Real questions. Useful conversations. Find the people who know your stack.

All Unanswered Has answers Resolved Unresolved

Cards Compact list

Community & Careers

Article0 replies4,764 followingPosted 29 Nov 2025, 01:25 UTC143.9K views2,213 votes

Architecting Exactly-Once ETL with Spark Structured Streaming Micro-batches

Learn how to implement exactly-once ETL pipelines using Apache Spark Structured Streaming, focusing on micro-batch architecture, checkpointing, and operational monitoring.

Community & Careers · Guide

Tasadduq Burneyowner

Started29 Nov 2025, 01:25 UTC

Level 35Owner29,275 rep points

Community & Careers

Article0 replies2,247 followingPosted 18 Jul 2026, 13:25 UTC10.2K views2,482 votes

Choosing Between Parquet and Avro for Spark ETL Pipelines

A technical decision guide for choosing between Parquet and Avro in Apache Spark, comparing read/write performance, schema evolution, and columnar vs. row-based storage.

Community & Careers · Guide

etl-pipeline parquet avro

Tasadduq Burneyowner

Started18 Jul 2026, 13:25 UTC

Level 35Owner rep points

29,275