Tag
A browser-based tool that runs SmolLM2-135M fully client-side (ONNX, int8) to visualize next-token probabilities and attention weights, including an illustration of the attention sink phenomenon. It includes an open-source GitHub repo and live demo that works even on mobile.
A React app tool for visualizing attention mechanisms in large language models using Transformers.js, demonstrating how tokens influence generation and aiding in understanding LLM behavior.
MiMo-V2.5-Pro-UltraSpeed is a tool for visualizing differences in attention mechanisms of large models, boasting ultra-fast speed.