Benchmark Atlas

亚洲模型实验室 · arXiv 论文

Isoflop Equal-Quality Gaps

复现 MiniMax-01 Figure 4:在多个 benchmark 中,以同一性能水平反查 MoE 与 dense 所需算力差。

minimaxmoeisoflopcompute-gap
MoE vs dense · equal-quality compute gaps 复现 MiniMax-01 Figure 4:在多个 benchmark 中,以同一性能水平反查 MoE 与 dense 所需算力差。 示意数据,仅复现信息结构,不代表最新榜单结果。 MoE vs dense · equal-quality compute gaps MiniMax-01 Technical Report · Figure 4 / PDF p.5 DEMO DATA HellaSwag3.0× compute gapZFLOPs →WinoGrande3.1× compute gapZFLOPs →Natural Questions3.1× compute gapZFLOPs →PIQA4.2× compute gapZFLOPs →2B active MoE7B dense
Illustrative demo data · renderer: isoflopGapFacets

Information grammar

它如何组织信息

benchmark 小多图双拟合曲线 + 等性能水平桥 + 两端算力垂线与倍率

Visual system
VS-65 MiniMax isoflop gap facets
Component ID
minimax-isoflop-gaps

Use when

适用判断

适合回答“达到同一质量要多少 compute”;不同训练 token 或激活参数设置不可混在同一桥线。

Figure-level evidence

Figure 4 · PDF p.5

五个 benchmark facet 比较 2B-active MoE 与 7B dense 的等性能算力差。

Verified
2026-07-12
Paper source
MiniMax-01 Technical Report

Structured data

可替换的数据模型

示意数据,仅复现信息结构,不代表最新榜单结果。

{
  "facets": [
    {
      "label": "HellaSwag",
      "min": 54,
      "max": 74,
      "target": 70,
      "moeMatch": 3.4,
      "denseMatch": 10.2,
      "moe": [
        [
          0.5,
          58
        ],
        [
          1.2,
          63
        ],
        [
          2.1,
          67
        ],
        [
          3.4,
          70
        ],
        [
          4.2,
          72
        ]
      ],
      "dense": [
        [
          0.5,
          55
        ],
        [
          2,
          60
        ],
        [
          5,
          66
        ],
        [
          9,
          69
        ],
        [
          13,
          72
        ]
      ]
    },
    {
      "label": "WinoGrande",
      "min": 56,
      "max": 69,
      "target": 65,
      "moeMatch": 3.1,
      "denseMatch": 9.6,
      "moe": [
        [
          0.5,
          58
        ],
        [
          1.3,
          61
        ],
        [
          2.2,
          63
        ],
        [
          3.1,
          65
        ],
        [
          4.1,
          66
        ]
      ],
      "dense": [
        [
          0.5,
          57
        ],
        [
          2.5,
          60
        ],
        [
          5.5,
          63
        ],
        [
          9.6,
          65
        ],
        [
          13,
          67
        ]
      ]
    },
    {
      "label": "Natural Questions",
      "min": 5,
      "max": 16,
      "target": 13,
      "moeMatch": 3.7,
      "denseMatch": 11.6,
      "moe": [
        [
          0.5,
          7
        ],
        [
          1.3,
          9
        ],
        [
          2.3,
          11
        ],
        [
          3.7,
          13
        ],
        [
          4.4,
          15
        ]
      ],
      "dense": [
        [
          0.5,
          6
        ],
        [
          2.8,
          8.5
        ],
        [
          6,
          10
        ],
        [
          9,
          11
        ],
        [
          11.6,
          13
        ],
        [
          13.5,
          14.5
        ]
      ]
    },
    {
      "label": "PIQA",
      "min": 70,
      "max": 80,
      "target": 77,
      "moeMatch": 2.8,
      "denseMatch": 11.8,
      "moe": [
        [
          0.5,
          73
        ],
        [
          1.2,
          75
        ],
        [
          2,
          76
        ],
        [
          2.8,
          77
        ],
        [
          3.8,
          79
        ]
      ],
      "dense": [
        [
          0.5,
          71.5
        ],
        [
          3,
          74
        ],
        [
          6,
          75
        ],
        [
          9,
          76
        ],
        [
          11.8,
          77
        ],
        [
          13.5,
          77.4
        ]
      ]
    }
  ]
}

Related components

同一图表家族的其他语法