4GB "Gemini Nano" model GGUF anyone?
Summary
A user inquires about the specific identity of a ~4GB AI model (likely Gemini Nano) silently downloaded by Chrome for on-device features, and requests a GGUF version for local execution via llama.cpp.
Similar Articles
@_ar9av: So apparently Google ships a Gemini Nano 4B LLM (context limit : 9216 tokens) baked into chrome I tried to expose it ou…
A developer discovered Google's Gemini Nano 4B LLM built into Chrome and created an OpenAI-compatible API wrapper for local use, eliminating the need for API keys or external calls.
Jiunsong/supergemma4-26b-uncensored-gguf-v2
SuperGemma4-26B-Uncensored-Fast GGUF v2 is a quantized, locally-runnable variant of Google's Gemma-4-26B model optimized for Apple Silicon, offering faster inference speeds and less-censored chat behavior while maintaining practical performance on general tasks.
guess what? if you are a chrome user, technically you are localllama member!
Google Chrome is silently installing a 4 GB Gemini Nano AI model on user devices without explicit consent or opt-out UI, raising significant privacy, legal, and environmental concerns.
Run Chrome’s tiny Gemma4 (aka Gemini Nano) directly on PC without GPU
A developer created a Chrome extension called Dobby that runs Google's Gemma4 (Gemini Nano) locally on PC without needing a GPU, requiring only Chrome and 16GB RAM. The extension provides a simple interface to interact with the model for tasks like spell checking or summarizing.
Gemma 4 26B-A4B and a 37 GB Qwen3.6 MoE running in a browser tab on a 24 GB Mac — experts streamed from disk, output matches llama.cpp
LocalMind is updated to stream mixture-of-experts weights from disk while generating in a browser tab via WebGPU, letting a 24 GB Mac run a 14.4 GB Gemma 4 26B-A4B and even a 37 GB Qwen3.6 model, with output that matches llama.cpp on the same GGUF files.