@antoine_chaffin: Party is over, time to regularize ColBERT models to fix efficient ANN MUVERA and SMVE promised to simplify multi-vector…
Summary
The authors found that regularizing ColBERT models fixes the efficient ANN methods MUVERA and SMVE, which had broken on modern ColBERT models, simplifying multi-vector retrieval infrastructure in an unexpected way.
View Cached Full Text
Cached at: 06/16/26, 03:37 PM
Party is over, time to regularize ColBERT models to fix efficient ANN MUVERA and SMVE promised to simplify multi-vector retrieval infrastructure but broke on modern ColBERT models We found a fix, and it does the exact opposite of what we expected https://t.co/R3JOJ8kVU3
Similar Articles
@antoine_chaffin: Reason-ModernColBERT nearly solved BrowseComp-Plus, smashing SOTA and outperforming models models 54× bigger Not bad fo…
Reason-ModernColBERT achieves near-perfect results on BrowseComp-Plus, surpassing SOTA and models 54× larger, then Agent-ModernColBERT further improves with minimal training.
@AmelieTabatta: ColBERT models continue to embarrass models 54× their sizes , this is why we trust late interaction @LightOnIO . A 1-ye…
The article highlights how ColBERT models, despite being smaller and older, outperform larger models like Qwen3-embed-8B when coupled with late interaction techniques and minimal fine-tuning.
@antoine_chaffin: It’s only BEIR but there are almost 10 points gap between v2 and LateOn We also have good evidence that the model gener…
LateOn, a new generation ColBERT model, achieves a nearly 10-point improvement over v2 on BEIR and generalizes well outside BEIR, with the same usage in PyLate.
@raphaelsrty: We're releasing LateOn and DenseOn today. Two open retrieval models, 149M parameters each. LateOn (ColBERT, multi-vecto…
Raphael released two open-source retrieval models, LateOn (ColBERT multi-vector) and DenseOn (single-vector), each 149M parameters and outperforming 4× larger models on BEIR.
@LightOnIO: Reason-ModernColBERT topped BrowseComp-Plus with just 149M parameters. Now, Agent-ModernColBERT adds ~10% on top. Reach…
LightOn released Agent-ModernColBERT, a 149M parameter open-source retrieval model that achieves performance comparable to GPT-5 combined with Qwen3-Embed-8B by integrating agent reasoning traces into queries.