亚洲模型实验室 · arXiv 论文
Pipeline Parallel Overlap Grid
复现 Kimi K2 Figure 7 的 PP 调度结构，展示 forward、backward、通信与 offload 如何重叠。
pipelineOverlapGridInformation grammar
它如何组织信息
microbatch 二维时隙网格 + forward/backward 色块 + communication/offload 下层带
- Visual system
- VS-63 Kimi pipeline schedule
- Component ID
kimi-pipeline-overlap
Use when
适用判断
适合训练系统 pipeline 调度；每格必须对应同一时间粒度。
Figure-level evidence
Figure 7 · PDF p.8
不同 PP phase 中 computation、communication 与 offloading 的重叠调度。
- Verified
- 2026-07-12
- Paper source
- Kimi K2 Technical Report
Structured data
可替换的数据模型
示意数据，仅复现信息结构，不代表最新榜单结果。
{
"phases": [
"t0",
"t1",
"t2",
"t3",
"t4",
"t5",
"t6",
"t7",
"t8",
"t9",
"t10"
],
"rows": [
{
"label": "PP0",
"cells": [
{
"kind": "F",
"text": "F1"
},
{
"kind": "F",
"text": "F2"
},
{
"kind": "C",
"text": "C"
},
null,
{
"kind": "B",
"text": "B1"
},
{
"kind": "B",
"text": "B2"
},
null,
null,
null,
null,
null
]
},
{
"label": "PP1",
"cells": [
null,
{
"kind": "F",
"text": "F1"
},
{
"kind": "F",
"text": "F2"
},
{
"kind": "C",
"text": "C"
},
null,
{
"kind": "B",
"text": "B1"
},
{
"kind": "B",
"text": "B2"
},
null,
null,
null,
null
]
},
{
"label": "PP2",
"cells": [
null,
null,
{
"kind": "F",
"text": "F1"
},
{
"kind": "F",
"text": "F2"
},
{
"kind": "C",
"text": "C"
},
null,
{
"kind": "B",
"text": "B1"
},
{
"kind": "B",
"text": "B2"
},
null,
null,
null
]
},
{
"label": "PP3",
"cells": [
null,
null,
null,
{
"kind": "F",
"text": "F1"
},
{
"kind": "F",
"text": "F2"
},
{
"kind": "C",
"text": "C"
},
null,
{
"kind": "B",
"text": "B1"
},
{
"kind": "B",
"text": "B2"
},
null,
null
]
}
],
"bands": [
{
"label": "all-to-all",
"start": 2,
"end": 8
},
{
"label": "offload",
"start": 4,
"end": 10
}
]
}Related components