on-device

AI Rep Counter is an on-device iOS app that uses AI to count reps and analyze workout form via the iPhone camera, offering privacy modes, workout metrics, and widgets.

ExecuTorch, PyTorch's on-device AI deployment framework, won the Best Industry Paper Award at MLSysConf 2026. The paper introduces a unified solution for running models on diverse hardware, from microcontrollers to SoCs.

Supertone released Supertonic 3, an open-source TTS model with 99M parameters that runs faster on CPU than a 2B model on A100, supporting 31 languages and ONNX Runtime for fully local inference.

Supertonic is a new open-source TTS engine that runs on-device via ONNX, supporting 31 languages and outperforming ElevenLabs in speed, even on a Raspberry Pi without a GPU.

An implementation or adaptation of OpenAI's Codex model for mobile devices, enabling code generation and assistance on smartphones.

The Hedy meeting app now supports fully offline AI summaries using local models like Qwen and Gemma via llama.cpp, with options for bring-your-own-model and hardware-aware model selection. The update enables Wi-Fi-free operation on Apple Silicon and Windows GPUs, though cloud still offers higher speed and quality.

Supertonic is a lightning-fast, on-device TTS model with 99M parameters, supporting 31 languages. It runs locally with no API costs, outperforms cloud TTS on accuracy for numbers, phone numbers, and technical terms, and can be installed via Python, Node.js, Rust, Go, and more.

Google's Gemma 4 achieves up to 3x faster inference speeds through speculative decoding and multi-token prediction, enabling efficient on-device deployment.

BlankOut is a tool that redacts sensitive content in documents on-device before sharing with AI services.

Google’s Gemma 4 E2B/E4B quantized variants now run fully offline on iPhone via apps like Locally AI, leveraging the Apple Neural Engine for on-device inference.

Google announces Gemma 3n preview, a mobile-first open AI model optimized for on-device inference on phones, tablets, and laptops. Built on a new architecture developed with hardware partners like Qualcomm and MediaTek, Gemma 3n uses innovations like Per-Layer Embeddings to achieve fast performance with minimal memory footprint (2-3GB), while supporting multimodal capabilities.

FluidVoice is an open-source voice-to-text dictation app for macOS featuring on-device AI enhancement via a separate private local runtime called Fluid Intelligence. Version 1.6.0 brings faster Parakeet support, improved theming, and a refreshed onboarding experience.