benchmark-drift

Stanford researchers retested 50 widely cited findings about LLMs using 20 new models and found that 44% no longer held, 34% had significantly weakened, and only 16% still held, suggesting that LLM research findings may have a “shelf life” of only about 15 months.