ReadMeFeed / Community knowledge

#database-optimization

Real questions. Useful conversations. Find the people who know your stack.

Article1 reply1 comment1,811 followingPosted 20 Jul 2026, 23:07 UTC12.4K views4,244 votes

Architecting Large-Scale Content Trees in MODX CMS

Learn how to manage complex MODX CMS resource structures at scale, focusing on flat table architecture, caching strategies, and performance bottlenecks in deep-nested trees.

Community & Careers · Guide

database-optimization

Community & Careers

Question1 answer2,002 followingPosted 17 Sept 2023, 09:41 UTC78.4K views4,316 votes

owner answered

Apache Airflow and SQLAlchemy: Connection Pool Exhaustion in Distributed Executor Environments

Apache Airflow relies on SQLAlchemy to manage the connection pool for its metadata database. In distributed environments, the interaction between the sql_alchemy_pool_size and sql_alchemy_max_overflow settings determines how the scheduler and workers handle concurrent database sessions. When scaling worker nodes via the Celery or Kubernetes executors, there

Community & Careers · Editorial question

connection-pooling apache-airflow

sqlalchemy

Community & Careers

Question1 answer1 comment2,993 followingPosted 10 Apr 2023, 22:03 UTC28.5K views2,948 votes

owner commented

Page API find method performance with large custom field datasets

ProcessWire's Page API provides the find() method to retrieve pages based on specific field criteria. This flexible schema allows fields to be added to templates without immediate database migrations, enabling rapid development of complex content filters. When scaling to extremely large datasets, there is a concern regarding the efficiency of these queries.

Community & Careers · Editorial question

processwire page-api cms-performance

Community & Careers

Question1 answer3,347 followingPosted 16 Nov 2021, 13:33 UTC125.8K views638 votes

helper answered

DBI pool connection timeout and server-side session alignment

The pool package manages a cache of database connections to reduce handshake overhead, utilizing a validation mechanism and an idle timeout to reclaim resources. When integrating this with database servers that enforce their own strict idle-session timeouts, a discrepancy between the client-side pool timer and the server-side session limit can occur. If the

Community & Careers · Editorial question

r dbi connection-pooling

Community & Careers

Question1 answer1,771 followingPosted 29 Dec 2020, 09:56 UTC140.6K views2,670 votes

helper answered

ADO.NET Connection Pool Max Pool Size Limits

ADO.NET utilizes connection pooling to minimize the overhead of establishing physical database connections. By default, the pool manages connections based on the exact connection string provided, and the Max Pool Size attribute defines the upper limit of physical connections allowed per pool. When an application reaches this limit and all connections are cur

Community & Careers · Editorial question

csharp connection-pooling ado-net