@incrementaliser: Enter the embedding room! I was refreshing my memory on some NLP (it had to be the lectures of @chrmanning ) and realis…
Summary
The author proposes creating a 3D visualization room to explore NLP embedding models, inspired by lectures from @chrmanning.
View Cached Full Text
Cached at: 09/13/26, 02:59 AM
Enter the embedding room! 🧙♂️ I was refreshing my memory on some NLP (it had to be the lectures of @chrmanning ) and realised all the visualisations of old embedding models that I’ve seen are 2D, and thought it would be cool to have a 3D “room” where you can fly through! https://t.co/CXWJzT5Yz3
Similar Articles
Playing with Vision Embeddings
This post explores DINOv3 vision embeddings by generating images that correspond to specific embedding directions, using gradient optimization and augmentation strategies to invert the model.
@v0xium: LLM Inference Engineering: Embedding Models Explained 1. An Embedding Model (EM) converts a chunk of text, or any other…
This article explains embedding models and their role in LLM inference, covering architectures, traffic profiles, and optimization techniques like quantization.
@techNmak: This is the best way to learn how LLMs work. Interactive. 3D. Step-by-step. Covers: → Embedding → Layer Norm → Self-Att…
An interactive 3D step-by-step guide to learning how LLMs work, covering key transformer concepts like embedding, self-attention, and softmax. It recommends a visual approach over reading papers.
@oneill_c: https://x.com/oneill_c/status/2077453217609453784
A researcher discusses the challenge of continual learning in LLMs, comparing them to amnesiac interns, and explores approaches like extending context windows, building stateful memory, and compressing context into latent representations, citing their work on Still.
@bo_wangbo: okay maybe it's a good time? We have a small colbert model trained at pplx, it is a continue-training of pplx-embed-0.6…
Perplexity AI releases pplx-embed-v1-late-0.6b, a small ColBERT late-interaction embedding model for retrieval, fine-tuned from their existing embedding model and optimized for MaxSim scoring, now open-source on HuggingFace.