A 397-Billion AI Just Ran on an iPhone

Reddit r/ArtificialInteligence 08/15/26, 09:32 PM News

on-device-ai mixture-of-experts apple-silicon local-llm iphone ai-inference

Summary

A 397-billion-parameter AI model has been successfully run on an iPhone, demonstrating on-device AI capabilities with a mixture-of-experts design, though facing challenges in speed, storage, and heat.

A 397-billion-parameter AI just ran on an iPhone. Not a demo video — the phone itself, generating text with the network off. On-device AI got that good, and this video shows exactly how it happened and what you can actually run today. We break down the mixture-of-experts design that leaves 96% of the model asleep, the Apple paper that predicted all of it three years ago, why the flash-moe team deleted their own caching code and got 38% faster, and where it still falls short — speed, storage, and heat — so you know what's real and what's hype. If you want AI that runs on your own hardware instead of somebody else's servers, this is where it's headed. Watch Here: A 397-Billion AI Just Ran on an iPhone #OnDeviceAI #iPhone #AI #LocalAI #MixtureOfExperts #AppleSilicon #OnDeviceAI #LocalLLM

Original Article

Similar Articles

An 8 billion param model running on iphone 15 without internet through offeline app

Reddit r/ArtificialInteligence

An 8 billion parameter AI model can now run offline on an iPhone 15 through a dedicated app, enabling on-device inference without internet.

@rohanpaul_ai: So much possibilities for on-device small models. Here @adrgrondin is running Google’s Gemma 4 E2B on iPhone 17 Pro. ~4…

X AI KOLs Following

Google's Gemma 4 E2B is demonstrated running on an iPhone 17 Pro via MLX optimization, achieving ~40 tokens/second with 128K context and offline thinking mode for coding and math.

@0x0SojalSec: Apple hid 15.8 TFLOPS of raw AI power in every M4 Mac & iPhone. They only let you use the Neural Engine for inference. …

X AI KOLs Timeline

A developer reverse-engineered Apple's private APIs to enable training neural networks directly on the Apple Neural Engine (ANE) in M4 Macs and iPhones, bypassing CoreML and GPU. The project demonstrates that ANE hardware is capable of training, though with limitations like low utilization and CPU fallbacks for some operations.

Local iPhone AI image generation is getting practical - only 3 seconds per image

Reddit r/ArtificialInteligence

Benchmark shows local Stable Diffusion 1.5 on iPhone can generate 512x512 images in as little as 3.1 seconds using optimized models like Realistic Vision V5.1 Hyper, making on-device AI image generation practical.

Run (your largest) local models from your iPhone

Reddit r/LocalLLaMA

A tool or app that enables users to run large local AI models directly from their iPhone, bringing on-device LLM inference to iOS.