Guide44.4K views1,246 votes0 replies1,009 following
Diagnosing NaN Losses After Enabling TensorFlow Mixed‑Precision
When TensorFlow mixed‑precision training yields NaN loss, the issue is usually missing loss scaling or an unsupported float16 op. Follow this guide to diagnose, fix scaling, cast ops, and monitor loss scales for stable training.
tensorflow