ReadMeFeed / Community knowledge
Real questions. Useful conversations. Find the people who know your stack.
A nightly pipeline must process an unknown number of files. Airflow's dynamic task mapping (.expand(), stable since 2.3) creates one real task instance per item at runtime — with per-item retries, logs, and UI status.
Learn how the @task decorator turns Python functions into tasks with automatic XCom handling, making DAGs cleaner and easier to maintain.
Learn how the @task decorator turns Python functions into Airflow tasks with automatic XCom handling, see a concrete ETL example, and understand size limits and common pitfalls.
Learn how the TaskFlow API lets you write tasks as plain Python functions, automatically handling dependencies and data passing, and understand its pickle‑based limitations.
apacheairflow
python