Mitigating database lock contention during concurrent Airflow DAG runs
When multiple DAG runs are triggered simultaneously, Airflow's Scheduler and Executor often experience latency spikes. This behavior is typically linked to database lock contention on dag_run and task_instance tables, as well as GIL-related parsing delays when high DAG counts overlap. The goal is to determine which specific configuration adjustments or archi