I built a iOS app to benchmark GGUF models on your iPhone/iPad

Reddit r/LocalLLaMA Tools

Summary

GenBench is a free iOS app that lets users download, run, and benchmark GGUF models on iPhone/iPad using llama.cpp and Metal, with features like offline chat, standardized benchmarks, and a global leaderboard.

Hey I've been working on **GenBench**, a free iOS app that lets you download, run, and benchmark GGUF models directly on your iPhone or iPad using llama.cpp + Metal. **What** **it** **does:** \- Search and download GGUF models from Hugging Face in one tap \- Chat with models completely offline \- Benchmark with standardized prompts — measures tok/s, first-token latency, and peak memory \- Submit scores to a global leaderboard to compare across devices \- Supports text and vision models (MiniCPM-V etc.) **Why** **I** **built** **it:** I kept seeing people ask "how fast does X model run on iPhone?" with no easy way to test. Existing tools are CLI-only or macOS-only. I wanted something where you just tap Download → Run and get real numbers. https://preview.redd.it/akuoevg9qh5h1.png?width=1206&format=png&auto=webp&s=1afc35f0add883eff571a0f53ae3b0eacc9e2712 **Some** **results** **I've** **seen:** \- SmolLM2 1.7B Q4\_K\_M on iPhone 16 Pro: \~35 tok/s \- Qwen2.5 3B Q4\_K\_M on iPhone 15 Pro: \~20 tok/s \- Phi-3.5 Mini Q4\_K\_M on iPad Pro M4: \~45 tok/s (Your numbers will vary — that's the whole point of the app) **App** **Store** **link:** [https://apps.apple.com/us/app/genbench/id6775272272](https://apps.apple.com/us/app/genbench/id6775272272) **Website:** [https://genbench.tken.ai](https://genbench.tken.ai/) It's completely free, no account required, no ads. Leaderboard submissions are anonymous. Would love feedback from this community — what models should I add to a recommended list? Any benchmarking metrics you'd want to see? Thinking about adding perplexity measurement next.
Original Article

Similar Articles