GridSearchCV Memory Exhaustion When Using n_jobs with Large Pipeline Parameter Grids
Context Running GridSearchCV on a Pipeline with a large param_grid and n_jobs > 1 can trigger MemoryError or system-level OOM kills even when the dataset fits comfortably in memory during single-threaded execution. Constraint Each parallel worker clones the full Pipeline and its parameter candidates, multiplying memory consumption by the effective number