Why voice agents pause, and how to shorten the silence
Where a voice agent’s silence comes from, which work can start before the caller finishes, how to handle interruptions and how to measure each stage.
Inference optimisation
Every post on this topic, newest first.
Updated 6 OCT 2026
More users per GPU: a playbook for self-hosted LLM serving
What to measure first, then the levers that raise LLM serving throughput on your own GPUs, in the order we pull them and what each one trades away.