Spark AQE in Practice: When the Runtime Should Pick Your Shuffle Partitions
Static planning guesses at shuffle partition counts and join strategies. AQE re-decides after the shuffle, using real partition sizes — here's how to configure and verify it.