https://blog.ans20xx.com/tags/megatron/Recent content in Megatron on 安橙的博客Hugo -- 0.163.3zhSat, 20 Jun 2026 00:00:00 +0000https://blog.ans20xx.com/posts/ai/day20/Sat, 20 Jun 2026 00:00:00 +0000https://blog.ans20xx.com/posts/ai/day20/拆开 Pipeline Parallel:理解模型按层切 stage、micro-batch 如何填流水线,对比 GPipe、1F1B 与 Megatron Interleaved 1F1B,掌握 bubble 时间计算与 pipeline 调参方法。