Using pandas Categorical to Reduce Memory and Speed Up groupby
Learn how converting low‑cardinality string columns to pandas Categorical reduces memory and accelerates groupby operations, with a concrete example and practical verification steps.
ReadMeFeed / Community knowledge
Real questions. Useful conversations. Find the people who know your stack.
Learn how converting low‑cardinality string columns to pandas Categorical reduces memory and accelerates groupby operations, with a concrete example and practical verification steps.
A technical guide for R developers on choosing between data.frame and data.table, focusing on memory management, update-by-reference semantics, and performance benchmarks for large datasets.
Stop fighting 'cannot allocate vector' errors. Learn how data.table's update-by-reference and keyed binary search eliminate memory duplication and accelerate R data processing.
Learn how converting low‑cardinality string columns to pandas categorical dtype can cut memory usage by up to 90 % and boost performance. Follow a quick checklist to decide when the conversion is worth it.
Learn how Unity ScriptableObjects eliminate duplicate data, improve memory usage, and let you tweak game values instantly from the Inspector.
V8 pointer compression stores 64‑bit object pointers as 32‑bit offsets, halving per‑object memory while keeping full addressability. Learn how it works, its limits, and how to verify it in your embed.
Learn how to use Python generators to process massive datasets with O(1) memory complexity, avoiding MemoryErrors by replacing lists with lazy evaluation.
Convert repeated string columns to pandas Categorical to cut memory by up to 90%. This guide shows a worked example, explains how it works, and lists limits and common pitfalls.
Global memory latency is often the real bottleneck in OpenCL kernels. This post explains the tiling pattern with a worked 1D blur kernel, barrier rules, and the occupancy trade-off that decides whether local memory actually helps.