DINOv2 way worse than SigLIP in k-NN. Is this expected? [R]

Reddit r/MachineLearning 07/08/26, 01:51 PM Papers

fine-grained-classification dino-v2 siglip knn embeddings self-supervised contrastive-learning

Summary

A researcher reports a surprising 50-point accuracy gap between frozen SigLIP2 (92%) and DINOv2 (41%) embeddings on a fine-grained car classification task using k-NN, seeking insight on whether a linear probe would close the gap or if DINOv2 is unsuited for retrieval.

Doing a bachelor thesis on fine-grained car classification (telling apart VW Golf generations from listing photos). Simple setup: frozen encoder → embeddings → weighted k-NN. On my small dataset (175 train / 132 test): SigLIP2 SO400M: ~92% CLIP ViT-L: ~59% DINOv2 Giant: ~41% I thought maybe it was a cosine vs euclidean thing, but my embeddings are L2-normalized so both give the same ranking. Tried both, DINOv2 stays at 41%. I get that SigLIP was trained contrastively so its space is basically built for cosine similarity, while DINOv2 is self-supervised and probably needs a trained head to shine. But a 50 point gap still feels huge to me. Anyone here tried DINOv2 with a linear probe on something fine-grained? Does it actually catch up or is it just not the right tool for retrieval? Also open to tips if there's some obvious thing I'm missing (wrong layer, wrong pooling, etc).

Original Article

Similar Articles

LingBot-Vision: masked boundary modeling for self-supervised pretraining (0.296 NYUv2 linear-probe RMSE at 1.1B vs 0.309 for DINOv3-7B, trails on ImageNet); weights in 4 sizes[R]

Reddit r/MachineLearning

LingBot-Vision introduces masked boundary modeling for self-supervised pretraining, achieving a 0.296 RMSE on NYUv2 linear-probe with 1.1B parameters versus 0.309 for DINOv3-7B, though it trails on ImageNet; weights are released in four sizes.

Ant Group released LingBot-Vision: DINO-family vision backbones in 4 sizes, and the 0.3B ViT-L matches DINOv3-7B on NYUv2 depth with ~23x fewer params

Reddit r/LocalLLaMA

Ant Group released LingBot-Vision, a family of DINO-style vision backbones in 4 sizes; the 0.3B ViT-L matches DINOv3-7B on NYUv2 depth with ~23x fewer parameters, showcasing significant efficiency gains.

DeepSeek 0813 "Pro" vs GLM 5.2 & Kimi K3 🐋

Reddit r/singularity

A comparison of DeepSeek 0813 'Pro' against GLM 5.2 and Kimi K3, likely covering benchmark performance and capability differences between these AI models.

DiZiNER: Disagreement-guided Instruction Refinement via Pilot Annotation Simulation for Zero-shot Named Entity Recognition

arXiv cs.CL

DiZiNER is a framework that uses disagreement between multiple LLMs to refine task instructions for zero-shot named entity recognition, achieving state-of-the-art results on 14 out of 18 benchmarks and significantly reducing the performance gap between zero-shot and supervised systems.

Comparing embedding models with synthetic query probing [R]