Un modello 100% locale sul tuo smartphone!
Summary
A developer shares their success in fine-tuning Qwen 3 models (1.5B and 4B) for local use on smartphones, with a downloadable APK that works offline, and plans for a Windows version.
Similar Articles
Un modello linguistico locale, privato 100%, sul tuo smartphone!!
Un modello linguistico locale e privato (Qwen 3 da 1.5B e 4B quantizzati) può girare offline su smartphone, con fine-tuning e LoRA distillato da un 32B.
Got local Qwen 3.5/3.6 generating meeting summaries entirely offline on an M4 Max. Demo with Wi-Fi off. This is the future.
The Hedy meeting app now supports fully offline AI summaries using local models like Qwen and Gemma via llama.cpp, with options for bring-your-own-model and hardware-aware model selection. The update enables Wi-Fi-free operation on Apple Silicon and Windows GPUs, though cloud still offers higher speed and quality.
"Browser OS" implemented by Qwen 3.6 35B: The best result I ever got from a local model
A user reports achieving impressive results with Qwen 3.6 35B running a 'Browser OS' implementation locally, highlighting the model's capability for complex task execution without cloud dependencies.
@KtAIFeed: Straight to the point, no fluff. The recently popular Qwen 3.6 (35B/43B) latest open-source 'uncensored' model on Hugging Face (over a million downloads per month) can run locally with just 6GB VRAM on a single GPU. It completely breaks the original model's moral preaching and safety restrictions—no censorship, it will answer whatever you ask...
Introduces the Qwen 3.6 (35B/43B) open-source uncensored model, removing official moral and safety restrictions. Requires only 6GB VRAM for local operation. Over a million downloads.
@victormustar: llama.cpp with MTP support makes local models fast enough to use as daily drivers Qwen3.6-27B dense generation (on A10G…
llama.cpp adds MTP support for Qwen3.6 models, boosting generation speed by 78% on A10G hardware, making local models viable as daily drivers.