webgpu

作者微调了一个 360M 参数的 Qwen2.5-Coder-0.5B 模型，使其像真正的终端一样预测屏幕变化，可以模拟 vim、tmux、snake 等应用，展示了小型世界模型在字符网格界面中维持一致状态的可行性。

Odin is a browser-based debugging search engine that parses a repo and ranks the exact file (93%) and function (79.4%) to fix for a given bug, using Tree-sitter via WebAssembly and sub-1B local models via WebGPU, matching Claude 4.5 agent accuracy at a fraction of the cost on SWE-bench Lite.

作者在博客中演示了如何完全在浏览器端运行 RAG：用静态嵌入检索段落，再通过 transformers.js 在 WebGPU/WASM 上运行小型模型（如 Qwen3-0.6B、SmolLM2-360M）生成两句话摘要，全程数据不出本地。文章还评估了这些小模型的忠实度局限。

作者将上周的 MoE 专家按需从磁盘流式加载的方案接入 llama.cpp 的 WebGPU 后端，使 80B MoE 模型（Qwen3-Next，48GB GGUF）也能在 Chrome 标签页中运行，无需为每个模型手写引擎。该方案新增了 ggml-webgpu 的缓冲类型、slot 映射的 MUL_MAT_ID 着色器和驻留逻辑，实测在 M4 Pro MacBook 上以 2.9 tok/s 解码 80B 模型，较小模型可达 22 tok/s。

AskCyph Health Explorer 是一款教育工具，结合 Google DeepMind 的 AlphaGenome API 预测基因变异影响，以及在浏览器中通过 WebGPU 本地运行的 MedGemma 1.5 4B 模型，实现完全隐私的 DNA 突变与疾病关系探索。

作者将两个开源 AI 内容检测模型（RoBERTa 文本检测器约 500MB 压缩至 97MB，以及 26MB 的 ViT 图像检测器）通过 ONNX Runtime Web 和混合精度量化等技术实现在浏览器端完全本地运行，无需上传数据，文本检测约 60ms、图像约 200ms。

Show HN: PS2 games like Gran Turismo 4 and God of War II are statically recompiled from Emotion Engine machine code into C++/WebAssembly and run in the browser without an emulator, using WebGPU compute shaders for the Graphics Synthesizer and a reimplemented PS2 kernel. The project runs at full speed on a laptop's integrated GPU, with game disc images processed locally by the repo's scripts.

dzhng shares his AI-native software engineering principles—deleting abstraction layers, writing apps in Rust compiled to WASM, and letting coding agents run autonomously for 12+ hours—alongside his open-source library of composable agent skills (dzhng/skills) for building software factories with Claude Code, Codex, Cursor, and 70+ other harnesses.

Talus is a 23M-parameter pixel-space diffusion model that generates 64x64 game terrain heightmaps conditioned on terrain type and user-selected measurable properties, trained from scratch on a single RTX 5060 and evaluated against a real-vs-real noise floor. It runs in the browser via ONNX Runtime Web on WebGPU (~3s per map) with Apache-2.0 open-sourced code and weights.

开源了 Rampart——一个浏览器原生的端侧 PII 过滤系统，结合正则规则与 MiniLM 小模型在数据离开设备前完成脱敏，模型仅 14.7MB、WebGPU 上 p50 延迟 3.9ms，七种语言的私有词召回率达 98.4%。

Google AI Edge 开源了 ML Drift，一个高性能、跨平台的 GPU 加速 AI/ML 推理引擎，支持 Android、iOS、Web（WebGPU）和服务器端，可高效运行大型生成式模型。

Google's EmbeddingGemma 2 embedding model is now running locally in the browser via WebGPU, with a Hugging Face model page and an interactive web demo showcasing on-device inference.

A Chrome extension that filters YouTube feeds using a small on-device ONNX decision model (opendecider-nano) running via WebGPU/WASM with no server or API calls. On 400 videos it achieves 0.934 balanced accuracy on rules like "hide music" or "only news", and can also flag prompt injection in selected text.

LocalMind is updated to stream mixture-of-experts weights from disk while generating in a browser tab via WebGPU, letting a 24 GB Mac run a 14.4 GB Gemma 4 26B-A4B and even a 37 GB Qwen3.6 model, with output that matches llama.cpp on the same GGUF files.

Framefields is an open-source npm package that enables code-first video production — compositing, motion graphics, and 3D rendered natively on WebGPU/WGSL from TypeScript, designed to be driven by AI coding agents like Claude Code and Codex instead of traditional creative suites.

A developer got llama.cpp compiling with WebGPU, demonstrating a proof-of-concept of an LLM running fully inside the browser, with plans to turn it into an agent that can interact with web apps.

Gitframes is an open-source npm package that packs Photoshop-, After Effects-, and Blender-class video capabilities into a single code-first tool, rendering directly on WebGPU (Dawn/Metal/Vulkan) for AI coding agents to compose and export MP4s via TypeScript.

Hugging Face open-sourced an optimized WebGPU operator library covering 200+ ML operators, enabling large models to run directly in the browser on a user's GPU with zero environment setup, full privacy, and no server-side compute costs.

Matt Keeter releases Halfspace, an experimental IDE for solid modeling built on the Fidget kernel, enabling real-time rasterization and mesh export of distance-field models with an incremental, parameterized modeling workflow.

OpenDLSS-NR is an open-source, bit-exact Vulkan reimplementation of NVIDIA's DLSS 5 generative neural rendering network (71-block Swin/ViT U-net), with a second independent WebGPU port that runs in the browser without tensor cores or FP8.