economic-grounding

Tag

Cards List
#economic-grounding

OmegaUse-OfficeVal: Benchmarking LLM Agents on Long-Horizon Office-Suite Tasks with Economic Grounding

Hugging Face Daily Papers · 2d ago Cached

OmegaUse-OfficeVal is a benchmark for evaluating LLM agents on long-horizon office-suite tasks with economic grounding, comparing human costs and LLM inference costs. It includes 100 tasks requiring ~2.3 hours of human labor each, and finds that frontier LLMs are cheaper and faster but still below human quality.

0 favorites 0 likes
← Back to home

Submit Feedback