#catalyst-optimizer

Can Catalyst physical planning move shuffle stage boundaries in Spark 3.x?

Goal Determine whether Catalyst physical optimization can change the number or placement of shuffle stage boundaries, or whether those boundaries are fixed by the logical DAG before physical planning begins. Uncertainty Spark documentation describes stage boundaries as shuffle-determined, while Catalyst chooses physical operators such as join strategies. It