@seclink: 又一个 benchmark ， 收录一下 样本和标注。
Summary
PatronusAI releases SpeedrunBench, the first benchmark that measures how fast AI agents can speedrun video games across multiple titles.
View Cached Full Text
Cached at: 09/04/26, 04:15 AM
又一个 benchmark ， 收录一下 样本和标注。
PatronusAI (@PatronusAI): Today, we’re releasing SpeedrunBench: the first benchmark that measures how fast agents can beat video games.
We asked frontier models not to simply complete video games, but to speedrun them - across 10 titles like Mario Kart and Pokemon.
On simpler games, agents get close
Similar Articles
@svpino: This is a cool benchmark that uses video games to test agents. Basically, they speedrun the game to test how well agent…
SpeedrunBench is a new benchmark that evaluates AI agents by having them speedrun video games to test planning, learning, and decision-making, with a public leaderboard for model comparison.
New benchmark dropped
A new benchmark has been released, likely for evaluating AI or software performance.
@Lyubh22: Coding benchmarks are saturating. AI4Research is the next frontier. Thrilled to see our MLS-Bench (https://mls-bench.co…
Announcing MLS-Bench, the first AI4Research benchmark to gain broad community adoption, testing AI agents on 140 executable tasks across 12 domains to propose modular ML improvements. The post includes leaderboard scores for models like Claude Opus 4.6 and GPT-5.4.
ProgramBench (5 minute read)
ProgramBench is a new benchmark that evaluates AI agents' ability to reconstruct complete software projects from compiled binaries and documentation without access to source code or decompilation tools.
@gneubig: SkillsBench is a great benchmark, and I'm not just saying that because @OpenHandsDev beats everyone else on it Skills a…
SkillsBench 1.1 is a benchmark for evaluating AI agents' ability to use skills, now fully audited and error-free.