@percyliang: ! Tokenization is the first thing you do in CS336 (language models from scratch). If Marcel can work his magic for the …

X AI KOLs Following Tools

Summary

Marcel Rød announces Gigatoken, a tokenizer implementation that is 500-1000x faster than HuggingFace and 100x faster than OpenAI's tiktoken, built in Rust.

⚡! Tokenization is the first thing you do in CS336 (language models from scratch). If Marcel can work his magic for the rest of the LM pipeline, the world will be a better place.
Original Article
View Cached Full Text

Cached at: 07/22/26, 06:19 AM

⚡! Tokenization is the first thing you do in CS336 (language models from scratch). If Marcel can work his magic for the rest of the LM pipeline, the world will be a better place.

Marcel Rød (@marcelroed): Introducing the world’s fastest tokenizer implementation, Gigatoken!

Gigatoken is ~500-1000x faster than HuggingFace, and ~100x faster than OpenAI’s tiktoken for most tokenizer definitions on most machines.

These baselines are already multithreaded Rust implementations! 🧵

Similar Articles

Gigatoken (GitHub Repo)

TLDR AI

Gigatoken is a drop-in replacement tokenizer claiming up to 1000x speedup over HuggingFace's tokenizers, supporting many common tokenizers and CPUs.