@AmelieTabatta: ColBERT models continue to embarrass models 54× their sizes , this is why we trust late interaction @LightOnIO . A 1-ye…
Summary
The article highlights how ColBERT models, despite being smaller and older, outperform larger models like Qwen3-embed-8B when coupled with late interaction techniques and minimal fine-tuning.
View Cached Full Text
Cached at: 05/13/26, 12:33 AM
ColBERT models continue to embarrass models 54× their sizes 😎, this is why we trust late interaction @LightOnIO . A 1-year-old ColBERT + 5 min of fine-tuning = a model which, coupled to gpt-oss-120B, surpasses qwen3-embed-8B + gpt-5. @antoine_chaffin keeps making it look easy.
Similar Articles
@antoine_chaffin: Reason-ModernColBERT nearly solved BrowseComp-Plus, smashing SOTA and outperforming models models 54× bigger Not bad fo…
Reason-ModernColBERT achieves near-perfect results on BrowseComp-Plus, surpassing SOTA and models 54× larger, then Agent-ModernColBERT further improves with minimal training.
@antoine_chaffin: It’s only BEIR but there are almost 10 points gap between v2 and LateOn We also have good evidence that the model gener…
LateOn, a new generation ColBERT model, achieves a nearly 10-point improvement over v2 on BEIR and generalizes well outside BEIR, with the same usage in PyLate.
@bo_wangbo: okay maybe it's a good time? We have a small colbert model trained at pplx, it is a continue-training of pplx-embed-0.6…
Perplexity AI releases pplx-embed-v1-late-0.6b, a small ColBERT late-interaction embedding model for retrieval, fine-tuned from their existing embedding model and optimized for MaxSim scoring, now open-source on HuggingFace.
@LightOnIO: Reason-ModernColBERT topped BrowseComp-Plus with just 149M parameters. Now, Agent-ModernColBERT adds ~10% on top. Reach…
LightOn released Agent-ModernColBERT, a 149M parameter open-source retrieval model that achieves performance comparable to GPT-5 combined with Qwen3-Embed-8B by integrating agent reasoning traces into queries.
@antoine_chaffin: Party is over, time to regularize ColBERT models to fix efficient ANN MUVERA and SMVE promised to simplify multi-vector…
The authors found that regularizing ColBERT models fixes the efficient ANN methods MUVERA and SMVE, which had broken on modern ColBERT models, simplifying multi-vector retrieval infrastructure in an unexpected way.