Follow up: GPT-2's vocabulary as a hyperbolic tree — 32,070 tokens in a Poincaré ball you can fly through [P]
Summary
A follow-up project visualizing GPT-2's 32,070 tokens as an interactive hyperbolic tree in a Poincaré ball, allowing users to fly through the embedding space.
Similar Articles
Interactive map of GPT-2's token embedding space - tap any token and explore [P]
An interactive map of GPT-2's token embedding space that lets users tap any token to explore its embeddings.
I built a tool that shows you what GPT-2 is "thinking" in real-time as it generates 3D graph of concept activations per token [R]
A developer built AXON, a tool that visualizes GPT-2's internal concept activations as a live 3D force graph using Sparse Autoencoders, allowing users to see interpretable features firing before token generation.
GPT-2 Small’s embedding geometry around “Trump”: discretized vs. continuous nearest neighbours [P]
This paper examines the embedding geometry of GPT-2 Small around the token 'Trump', comparing discretized and continuous nearest neighbor approaches to understand representational structure.
openai-community/gpt2
This page details GPT-2, a transformer-based language model pretrained on English text for text generation, available on Hugging Face with usage instructions and examples.
@AlphaSignalAI: This free interactive explainer just exposed how GPT actually works. Most people treat Transformers like magic. You typ…
A free interactive tool called Transformer Explainer runs a live GPT-2 model in the browser, visualizing the internal workings of Transformers with a Sankey diagram and live inference.