Tag
OmegaUse-OfficeVal is a benchmark for evaluating LLM agents on long-horizon office-suite tasks with economic grounding, comparing human costs and LLM inference costs. It includes 100 tasks requiring ~2.3 hours of human labor each, and finds that frontier LLMs are cheaper and faster but still below human quality.