Artificial Analysis, Updated HLE Diamond: Open Weights Models Trail By More Than 30 Points
Summary
Artificial Analysis 更新了 HLE Diamond 基准评测,显示开源权重模型在该高难度基准上落后闭源模型超过 30 分。
Similar Articles
Artificial Analysis Intelligence Index v5
Artificial Analysis 释放 Artificial Analysis Intelligence Index v5 与 Progress Index v1,新增 FrontierCode 2.0、Terminal-Bench-Science 等基准并转向 60% 私有测试集,结果显示 Claude Opus 5.5 (max) 以 58 分领先,开放权重模型与闭源前沿模型差距扩大至 12 分。
Artificial Analysis v5 and the benchmarker's dilemma (11 minute read)
Interconnects 分析了 Artificial Analysis Intelligence Index v5 的更新,探讨独立 AI 评测在快速迭代时代面临的'单一分数'困境,以及各基准权重分配对模型排名和市场的影响。
GLM-5.2 is the new leading open weights model on Artificial Analysis
Z ai's GLM-5.2 has become the new leading open weights model on the Artificial Analysis Intelligence Index, scoring 51 and outperforming competitors like MiniMax-M3 and DeepSeek V4 Pro. The model features 744B total parameters, 40B active, MIT license, and 1M context window.
Meta's 816B Muse Spark Open scores 39 on Artificial Analysis, the 180B Qwen3.8-Flash-Next scores 40. Score vs size for 11 open-weight models
作者基于 Artificial Analysis 的评分绘制了 11 个开放权重模型的参数量-得分对比图:816B 的 Meta Muse Spark Open 得分 39,而仅 180B 的 Qwen3.8-Flash-Next 得分 40;图表还包含 MiMo-V2.6-Pro、DeepSeek V4.1 Flash 等模型及量化体积、本地部署建议等信息。
The gap between open weights LLMs and closed source LLMs
Analyzes the gap between open weights and closed source LLMs using the Artificial Analysis Intelligence Index and other benchmarks, finding that the gap is shrinking on some metrics but stable on others.