An 8 billion param model running on iphone 15 without internet through offeline app
Summary
An 8 billion parameter AI model can now run offline on an iPhone 15 through a dedicated app, enabling on-device inference without internet.
Similar Articles
@rohanpaul_ai: Gemma 4 (specifically its edge-optimized E2B and E4B variants) running fully offline on an iPhone via apps like Locally…
Google’s Gemma 4 E2B/E4B quantized variants now run fully offline on iPhone via apps like Locally AI, leveraging the Apple Neural Engine for on-device inference.
Run (your largest) local models from your iPhone
A tool or app that enables users to run large local AI models directly from their iPhone, bringing on-device LLM inference to iOS.
We built an app that runs AI completely offline on your phone (Local LLMs). Perfect for flights, camping, or dead zones.
Introduces Cortex AI, an app that runs AI completely offline on phones using optimized local models, addressing privacy and connectivity issues.
@rohanpaul_ai: So much possibilities for on-device small models. Here @adrgrondin is running Google’s Gemma 4 E2B on iPhone 17 Pro. ~4…
Google's Gemma 4 E2B is demonstrated running on an iPhone 17 Pro via MLX optimization, achieving ~40 tokens/second with 128K context and offline thinking mode for coding and math.
@sudoingX: this is a laptop running a 31b parameter model at 99% gpu autonomously through hermes agent, 15 tok/s sustained, 22.8 o…
A 31B parameter model runs locally on a laptop via Hermes agent at 15 tok/s, using 22.8 GB VRAM and 94 W power, highlighting fully autonomous, private AI inference without cloud dependencies.