evaluation-benchmarks

Tag

Cards List
#evaluation-benchmarks

Recursive Game Creator: An Agentic Product-Level Experience-Oriented Game Harness

Hugging Face Daily Papers ↗ · 2026-10-06 Cached

The paper introduces Recursive Game Creator, an experience-oriented agentic framework with Designer, Builder, Player, and Reviewer roles that recursively transforms game prototypes into polished games, achieving state-of-the-art results on GameCraft-Bench and GameASG-Bench via its Coding-Native Player for gameplay evaluation.

0 favorites 0 likes
#evaluation-benchmarks

Rules to Tools: Executable Checks for LLM Agents in Scientific Computing

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

论文提出 Rules to Tools (R2T),为科学计算中的 LLM 代码修复代理提供可执行的公开需求检查工具,并在 SciCode 基准上对比纯文本说明与可调用检查的修复效果与成本。

0 favorites 0 likes
#evaluation-benchmarks

Function-Level Execution Feedback for Code Preference Optimization

arXiv cs.AI ↗ · 2026-08-26 Cached

This paper proposes Step-KTOder, a framework for code preference optimization that uses function-level execution feedback with unit tests to improve over outcome-only methods like KTO and DPO on benchmarks such as HumanEval+ and MBPP+.

0 favorites 0 likes
#evaluation-benchmarks

Testing the Test: Score-Direction Instability in Class-Split Anomaly Detection

arXiv cs.LG ↗ · 2026-06-03 Cached

该论文揭示了在类分割异常检测评估中,由于表示空间中的分布重叠,异常分数可能变得不稳定甚至反转,并引入了一种无训练的邻域类泄漏诊断来预测此现象。

0 favorites 0 likes
#evaluation-benchmarks

ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents

Papers with Code Trending ↗ · 2026-04-13 Cached

ClawGUI is an open-source framework for training, evaluating, and deploying GUI agents using reinforcement learning, featuring standardized benchmarks and cross-platform deployment to Android, iOS, and HarmonyOS.

0 favorites 0 likes
← Back to home

Submit Feedback