Tag
Studio AI's model achieved over 97.5% accuracy in forecasting consumer purchase behavior during a pilot test, surpassing traditional market research methods in a comparison study.
Introduces ConsumerSimBench, a benchmark for evaluating LLMs' ability to reconstruct crowd-level consumer reactions from real Chinese social media topics. Tests show frontier models cover only 47.8% of real reaction criteria, highlighting a gap between technical benchmark performance and social intuition.