webgpu

PrismML has released Bonsai Image 4B, a 1-bit binary and ternary quantized diffusion model, with a size of only 3GB (1-bit version 0.93GB), achieving over 8x compression compared to the same-parameter FLUX.2 Klein 4B at 16GB, and fully supports local browser execution.

A deep dive video explaining how AI models run from JavaScript using Transformers.js, covering tensors, ONNX, quantization, WebGPU/WASM, and more.

OpenAI open-sourced the Privacy Filter model (1.5B parameters, Apache 2.0), which runs locally in the browser via WebGPU to detect personal information without uploading data, protecting privacy.

PrismML released Bonsai Image 4B models in binary and ternary quantized versions, enabling text-to-image generation to run locally in a browser via WebGPU with only 3GB size, under Apache-2.0 license.

The article highlights the new WebGPU backend in llama.cpp/ggml, enabling GPU-accelerated local AI model inference in browsers, developed by Reese Levine and team at USCS over the past year and a half.

Created an in-browser WebGPU version of the classic char-rnn demo training on Shakespeare, paying homage to Karpathy joining Anthropic.

A developer demonstrates running the Qwen3.6-27B AI model entirely on WebGPU in a browser, though speed is not optimal.

Demonstrates running Gemma 4 offline in the browser using WebGPU and Transformers.js to control a Reachy Mini robot via WebSerial.

Opus 4.7 auto-generated a custom WebGPU kernel that accelerates Qwen3.5 inference up to 13× via fused LinearAttention, now shipping in Transformers.js v4.2.0.

A 3D building editor built with React Three Fiber and WebGPU, structured as a Turborepo monorepo with core, viewer, and editor packages for schema definitions, 3D rendering, and interactive tools.

Brush is an open-source 3D reconstruction engine using Gaussian Splatting, built in Rust and compatible with WebGPU for cross-platform real-time rendering on desktop, mobile, and browser.

OpenReel Video is an open-source, browser-based professional video editor built with React, TypeScript, WebCodecs, and WebGPU that runs entirely client-side without uploads or installations.