ReadMeFeed / Community knowledge

#distributed-computing

Real questions. Useful conversations. Find the people who know your stack.

Article1 reply1 comment1,002 followingPosted 09 Jul 2026, 02:08 UTC37.1K views4,573 votes

Stopping the Shuffle: Optimizing Spark Joins with Broadcast Hash Joins

Stop wasting resources on unnecessary shuffles. Learn how to use Broadcast Hash Joins in Apache Spark to optimize joins between large and small datasets.

Community & Careers · Blog

distributed-computing

performance-tuning

spark-sql

Community & Careers

Article0 replies4,214 followingPosted 11 Nov 2025, 17:39 UTC56.1K views2,179 votes

Choosing Between @threads and pmap for Parallel Loops in Julia

Deciding between @threads and pmap in Julia depends on data volume and hardware. This guide compares shared-memory threading versus distributed processing for parallel loops.

Community & Careers · Guide

multithreading

julia distributed-computing

Community & Careers

Article0 replies4,166 followingPosted 30 Nov 2025, 02:01 UTC106.3K views1,856 votes

Choosing Julia Parallelism: Shared‑Memory Threads vs Distributed Workers for Loop Workloads

When you need to speed up a loop‑heavy Julia program, decide between lightweight shared‑memory threading and heavyweight distributed workers. This guide compares the two, explains trade‑offs, and shows a concrete sum‑benchmark to help you pick the right model.

Community & Careers · Guide

multithreading

julia distributed-computing