LFM2.5 230M running in-browser at 1,400 tok/s using custom WebGPU kernels
Summary
LFM2.5 230M model achieves 1,400 tokens per second in-browser using custom WebGPU kernels, demonstrating efficient local inference.
Similar Articles
LFM3-Omni-2B running locally in-browser on WebGPU
LiquidAI 的 LFM3-Omni-2B 成为首个可在浏览器中通过 WebGPU 100% 本地运行的全模态模型，无需独立 ASR/TTS，在 M4 Max 上实现约 280 token/s、90ms 首 token 延迟。
Gemma 4 E2B running in-browser at 255 tok/s using WebGPU kernels written by Fable 5
Gemma 4 is demonstrated running in-browser via WebGPU at 255 tokens per second, using kernels generated by Fable 5, showcasing efficient on-device inference.
Bonsai 27B: 1-bit dense LLM running locally in your browser using custom WebGPU kernels
Bonsai 27B is a 1-bit dense large language model that can run locally in a browser using custom WebGPU kernels, enabling efficient on-device inference.
@victormustar: 300tok/s on mobile is insane... open source must win
Open source AI inference reaches 300 tok/s on mobile, with a WebGPU framework pushing Liquid AI's LFM2.5 230M to 1,400 tok/s in browser.
1-bit 27B in the browser: 25–30 tok/s on a 6 GB RTX 3060 Laptop (WebGPU, no install)
Mentria.ai's browser-based inference engine achieves 25-30 tokens per second with a 1-bit 27B parameter model on a 6 GB RTX 3060 laptop GPU using WebGPU, enabling efficient AI inference without server installation.