Paper page - Transformer Explainer: Interactive Learning of Text-Generative Models

Source: https://huggingface.co/papers/2408.04619

Abstract

Transformer Explainer is an interactive visualization tool that allows non-experts to understand the inner workings of the GPT-2 model through real-time experimentation and visualization in a web browser.

Transformershave revolutionized machine learning, yet their inner workings remain opaque to many. We present Transformer Explainer, an interactive visualization tool designed for non-experts to learn aboutTransformersthrough theGPT-2model. Our tool helps users understand complex Transformer concepts by integrating amodel overviewand enabling smooth transitions across abstraction levels ofmathematical operationsandmodel structures. It runs a liveGPT-2instance locally in the user’s browser, empowering users to experiment with their own input and observe in real-time how the internal components and parameters of the Transformer work together to predict the next tokens. Our tool requires no installation or special hardware, broadening the public’s education access to modern generative AI techniques. Our open-sourced tool is available at https://poloclub.github.io/transformer-explainer/. A video demo is available at https://youtu.be/ECR4oAwocjs.

View arXiv pageView PDFProject pageGitHub7.45kAdd to collection

Get this paper in your agent:

hf papers read 2408\.04619

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2408.04619 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2408.04619 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2408.04619 in a Space README.md to link it from this page.

Collections including this paper33

Browse 33 collections that include this paper