Odin: Rethinking Congestion Control under All-to-All Traffic
Wanchun Jiang, Yujie Hu, Kai Wang, Xiao Han, Haoran Wei, Yong Zhang, Jianxi Ye, Huichen Dai
Central South University ByteDance (China)
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
All-to-All (A2A) communication dominates the training and inference time of large language models, especially under the Mixture-of-Experts (MoE) architecture where expert dispatch induces dense concurrent flows. We observe that A2A traffic consistently builds up large total buffer occupancy (TBO) at switches. Analyzing the accompanying counterintuitive phenomena, we reveal that the A2A traffic saturates ingress bandwidth, interferes with rate adjustment of congestion control (CC) through sparse congestion signals and rate inflation, and causes ingress-egress bandwidth mismatch. Unaware of these issues, existing CC algorithms would be easy to trigger PFC with large TBO, suffer from ineffectual congestion response, and lead to throughput loss. Based on these insights, we propose Odin to enhance CC under A2A traffic. Odin suppresses large TBO based on the switch-level TBO signals, proactively allocate ingress bandwidth to eliminate rate inflation, and make bandwidth compensation for ingress-egress matching. Experiments and simulations show that Odin achieves low TBO and high throughput under A2A traffic, accelerating the training process. Meanwhile, it keeps strong performance under non-A2A traffic.
逐年被引趋势
暂无年度引用数据
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
计算机 / AINetwork Traffic and Congestion Control
Software-Defined Networks and 5G · Interconnection Networks and Systems