https://blog.ans20xx.com/tags/allreduce/Recent content in AllReduce on 安橙的博客Hugo -- 0.163.3zhSat, 20 Jun 2026 00:00:00 +0000https://blog.ans20xx.com/posts/ai/day16/Sat, 20 Jun 2026 00:00:00 +0000https://blog.ans20xx.com/posts/ai/day16/进入分布式训练通信层:理解 NCCL 的 ring、tree、双二叉树 AllReduce 算法,看懂 NCCL_DEBUG=INFO 的初始化、拓扑、通道、算法选择日志,并用一个小脚本完整跑通 AllReduce 取证流程。