@seclink: Workspace-Bench-Workspaces stores the complete original workspace file system: Various documents, spreadsheets, code, P…

X AI KOLs Timeline Tools
benchmark ai-agents file-management simulation evaluation dataset

Summary

Workspace-Bench is a benchmark that simulates a real employee's file workspace to evaluate AI agents on tasks involving file discovery and understanding relationships. It includes various file types and role-based scenarios to test agent capabilities.

Workspace-Bench-Workspaces stores the complete original workspace file system: Various documents, spreadsheets, code, PPTs, meeting minutes, dependency files, etc., simulating that pile of numerous and messy, interconnected files on a real employee's computer. The Agent has to find files on its own in this workspace, understand file relationships, and complete tasks. The accompanying tasks are in Workspace-Bench / Workspace-Bench-Lite, with a total of 5 types of role-based workspaces: Operations Manager Logistics Manager AI Product Manager Backend Developer Researcher The full version has 388 tasks, about 20,000 files, over 70 formats, with the largest workspace around 20GB. The evaluation looks not only at whether the final answer is correct, but also at whether the Agent found and correctly used the necessary files.
Original Article
View Cached Full Text

Cached at: 09/03/26, 12:08 PM

Workspace-Bench-Workspaces stores the complete original workspace file system:

Various documents, spreadsheets, code, PPTs, meeting minutes, dependency files, etc., simulating that pile of numerous and messy, interconnected files on a real employee’s computer.

The Agent has to find files on its own in this workspace, understand file relationships, and complete tasks.

The accompanying tasks are in Workspace-Bench / Workspace-Bench-Lite, with a total of 5 types of role-based workspaces:

Operations Manager Logistics Manager AI Product Manager Backend Developer Researcher

The full version has 388 tasks, about 20,000 files, over 70 formats, with the largest workspace around 20GB. The evaluation looks not only at whether the final answer is correct, but also at whether the Agent found and correctly used the necessary files.

Similar Articles