Tag
EngiWorld introduces a comprehensive benchmark for AI agents in professional engineering, evaluating their performance across multiple domains and software with a focus on geometric and physical validity. The evaluation reveals that current frontier models have limited success, indicating a need for improvement.
Workflow-GYM is a benchmark for evaluating AI agents on long-horizon GUI tasks in professional domains. Experiments show that even top models achieve only ~30% success, revealing significant challenges.