Limits of Kaldi online2 GPU fallback for low‑traffic workloads
Goal Minimise operational cost for a sporadic speech‑recognition service by selecting the most efficient Kaldi online2 decoding path. Constraints and Uncertainty Kaldi’s online2 pipeline can run on CPU or GPU, but the documented behaviour for automatic fallback when a GPU is absent is unclear. Using a GPU for infrequent traffic may introduce scheduling overh
kaldi