An 8 billion param model running on iphone 15 without internet through offeline app
Summary
An 8 billion parameter AI model can now run offline on an iPhone 15 through a dedicated app, enabling on-device inference without internet.
Similar Articles
A 397-Billion AI Just Ran on an iPhone
A 397-billion-parameter AI model has been successfully run on an iPhone, demonstrating on-device AI capabilities with a mixture-of-experts design, though facing challenges in speed, storage, and heat.
@rohanpaul_ai: Gemma 4 (specifically its edge-optimized E2B and E4B variants) running fully offline on an iPhone via apps like Locally…
Google’s Gemma 4 E2B/E4B quantized variants now run fully offline on iPhone via apps like Locally AI, leveraging the Apple Neural Engine for on-device inference.
Run (your largest) local models from your iPhone
A tool or app that enables users to run large local AI models directly from their iPhone, bringing on-device LLM inference to iOS.
We built an app that runs AI completely offline on your phone (Local LLMs). Perfect for flights, camping, or dead zones.
Introduces Cortex AI, an app that runs AI completely offline on phones using optimized local models, addressing privacy and connectivity issues.
@rohanpaul_ai: So much possibilities for on-device small models. Here @adrgrondin is running Google’s Gemma 4 E2B on iPhone 17 Pro. ~4…
Google's Gemma 4 E2B is demonstrated running on an iPhone 17 Pro via MLX optimization, achieving ~40 tokens/second with 128K context and offline thinking mode for coding and math.