https://blog.ans20xx.com/tags/continuous-batching/Recent content in Continuous Batching on 安橙的博客Hugo -- 0.163.3zhSat, 20 Jun 2026 00:00:00 +0000https://blog.ans20xx.com/posts/ai/day33/Sat, 20 Jun 2026 00:00:00 +0000https://blog.ans20xx.com/posts/ai/day33/学习 LLM 推理服务中的 Continuous Batching:理解静态 batching 与 in-flight batching 的差异,prefill/decode 如何混排,以及 TGI、vLLM、SGLang 调度器在吞吐、TTFT、TPOT 与公平性上的取舍。