VSArena — an open benchmark for AI agents in 3D embodied environments

Reddit r/ArtificialInteligence 09/26/26, 04:29 PM Tools

ai-agents 3d-environments benchmark evaluation embodied-ai open-source

Summary

VSArena is an open benchmark for evaluating AI agents in interactive 3D environments, offering remote execution and a public leaderboard to assess perception, reasoning, and action without physical robots.

I’ve been working on VSArena, an open benchmark designed to evaluate AI agents in interactive 3D environments. The idea is simple: instead of evaluating an agent only through text or code, give it an environment where it has to actually perceive, reason and act. VSArena currently provides: Interactive 3D evaluation environments Remote agent execution Reproducible task evaluation Public ELO leaderboard Evaluation runs and replays No physical robot required I’d especially like feedback from people working on VLA, embodied AI, robotics, and agent evaluation. What would you want to see in an open benchmark like this? Website: https://vsarena.app GitHub: https://github.com/NovaCoding-G/VSArena

Original Article

Similar Articles

VSArena v0.6.0 — a new Studio for running and inspecting embodied AI policies in the browser

Reddit r/artificial

VSArena v0.6.0 is a major update to a browser-based studio for running and evaluating Vision-Language-Action policies in 3D physics environments, emphasizing reliable and reproducible assessment without local simulators or physical robots.

An AI agent just stacked blocks in a live physics simulation — building an open benchmark arena for embodied AI

Reddit r/artificial

An early-stage project is building an open, browser-based arena for AI agents to compete in real-time physical reasoning tasks, demonstrated by an AI agent achieving 100% task completion and high spatial accuracy in a block-stacking simulation.

Agent Arena

Product Hunt

Agent Arena is the first public arena for AI agents, allowing users to test and compare AI agents in a competitive environment.

Inside VAKRA: Reasoning, Tool Use, and Failure Modes of Agents

Hugging Face Blog

This article introduces VAKRA, an executable benchmark for evaluating AI agents' reasoning and tool-use capabilities in enterprise-like environments. It analyzes failure modes and details the benchmark's structure involving API chaining and document retrieval.

VABench: Measuring Embodied Spatial Intelligence through Visual Demonstrations, Active Perception, and Metric Control

Hugging Face Daily Papers

VABench introduces a benchmark to evaluate embodied spatial intelligence in models by testing their ability to observe, reason, and act through visual demonstrations and active perception. It shows that active camera control improves task success, but no model completes long-horizon episodes.