VibeWorlding benchmark: open 30B model tops GPT-5.5 on 3D worlds
Summary
A new benchmark for evaluating multimodal agents in building 3D open worlds from natural language shows GPT-5.5 and Qwen3.8-Max scoring below 60%, while an open 30B model achieves the best performance through reinforcement learning.
Similar Articles
VibeWorlding: Can Multimodal Agents Construct 3D Open Worlds End-to-End?
This paper proposes VibeWorlding, a framework for benchmarking and training multimodal agents to construct 3D open worlds from user queries, showing that reinforcement learning improves open-source models to compete with closed-source frontiers.
GlobeBench: Evaluating Text-Based World Model Capabilities for Scalable Environment Simulations
GlobeBench introduces a standardized benchmark of 1,632 tasks across five domains for evaluating text-based world models, finding that current LLMs — led by GPT-6 Astra at 49.57% — struggle badly with propagating action effects across dependent objects.
BlenderWorld: Benchmarking Visual Agents for 3D Creation from Real-World References
BlenderWorld 是首个专注于真实世界 3D 创作任务的综合基准,包含 223 个任务,通过渲染输出和 2,651 条二元评分标准评估前沿多模态模型,结果显示 GPT-6-Astra 以 79.9 分领先,但所有模型在细粒度 3D 空间一致性方面仍存在显著不足。
@ModelScope2022: Qwen-AgentWorld just dropped two releases on ModelScope! An open 35B total / 3B active MoE world model with 256K contex…
Qwen-AgentWorld releases an open 35B total / 3B active MoE world model with 256K context, along with a 7-domain benchmark, achieving state-of-the-art performance on AgentWorldBench.
Qwen3.8 (27b) performs better than GPT-5.6-Terra (Max) for Agentic tasks
The article reports on AI model performances, indicating that Qwen3.8 (27b) outperforms GPT-5.6-Terra (Max) in agentic tasks based on the Agentic Index scores.