trace-driven-evaluation

Tag

Cards List
#trace-driven-evaluation

When Does Trace-Driven Evaluation Mislead MoE Expert Caching? Replay Semantics, Workload Contamination, and Operating Regimes

arXiv cs.LG · 5d ago Cached

This paper investigates how trace-driven evaluation can mislead assessments of MoE expert caching, identifying replay semantics, workload contamination, and operating regimes as confounding axes that can reverse policy rankings. After correcting these issues, it shows that a large offline-optimal gap overstates the gains actually recovered by lightweight causal caching mechanisms.

0 favorites 0 likes
← Back to home

Submit Feedback