Blog109K views914 votes0 replies3,038 following
Using Spark Broadcast Joins to Speed Up Large Dataset Joins
Spark broadcast joins avoid shuffling the large side of a join when one dataset fits in memory. This post walks through the configuration, a concrete example, and how to verify the improvement.