Tag
Introduces EComAgentBench, a benchmark for evaluating LLM-based shopping agents on long-horizon tasks with hidden intents distributed across queries, profiles, and clarifications. The benchmark uses real Amazon products and automated scoring, revealing that even the best model achieves only 57.1% accuracy.