Query Parquet Files Directly in DuckDB Without an ETL Step
DuckDB can read Parquet files directly with SQL, pushing filters into the file reader for ad-hoc analytics without an ETL load step.
Loading…
ReadMeFeed / Community knowledge
#etl
Real questions. Useful conversations. Find the people who know your stack.
duckdbGenerate Hundreds of Airflow DAGs with a Single Python File: A Practical Guide to Dynamic DAGs
Dynamic DAG generation lets you create dozens of Airflow pipelines from a single Python file, cutting boilerplate and simplifying maintenance. Learn how to build a factory, avoid scheduler pitfalls, and keep your Web UI responsive.
apacheairflowUsing Firebird Global Temporary Tables for Efficient ETL Staging
Firebird GTTs let you stage ETL data without polluting the main database. This article explains ON COMMIT semantics, isolation, statistics challenges, and gives a concrete example of loading and merging data while keeping temp space usage in check.
firebirdUsing DuckDB’s Native Parquet Engine for Zero‑Config Analytics
Learn how DuckDB lets you read, transform, and write Parquet files directly from SQL without extra services or complex setup.
Drupal Migrate API: Building a Restartable CSV-to-Node Import You Can Trust
A practical walkthrough of Drupal's Migrate API: source/process/destination plugins, a working CSV-to-node migration, rollback via map tables, and the trade-offs to plan for at scale.
drupalUsing Apache Airflow TaskFlow API to Simplify DAG Definition
Learn how the @task decorator turns Python functions into Airflow tasks with automatic XCom handling, see a concrete ETL example, and understand size limits and common pitfalls.