Demo of local document extraction (52 pages) using Arctic Embed and Bonsai 8B on an Iphone 16 (KernelAI app)
Summary
Demonstration of the KernelAI mobile app's capability to perform local document extraction on 52 pages using Arctic Embed and Bonsai 8B models on an iPhone 16, with new features in v2 including web search and custom model import.
Similar Articles
@rohanpaul_ai: So much possibilities for on-device small models. Here @adrgrondin is running Google’s Gemma 4 E2B on iPhone 17 Pro. ~4…
Google's Gemma 4 E2B is demonstrated running on an iPhone 17 Pro via MLX optimization, achieving ~40 tokens/second with 128K context and offline thinking mode for coding and math.
@rohanpaul_ai: Gemma 4 (specifically its edge-optimized E2B and E4B variants) running fully offline on an iPhone via apps like Locally…
Google’s Gemma 4 E2B/E4B quantized variants now run fully offline on iPhone via apps like Locally AI, leveraging the Apple Neural Engine for on-device inference.
@googlegemma: Check out original post by @ivanfioravanti here:
A demonstration of the Gemma 4 E4B AI model running locally on an iPad using Apple MLX, showcased as an engaging application for children.
Show HN: Maple-Preview – ternary 20B MoE running at 120 tok/s on a iPhone
Maple-Preview is a ternary 20B MoE model that runs at 120 tokens per second on an iPhone, showcasing efficient on-device inference.
@berryxia: https://x.com/berryxia/status/2067078380017828205
The author tested the three tiers of PP-OCRv6 models and provided open-source tools for local deployment. They demonstrated performance comparisons of each model on OmniDocBench and real-world scenarios, emphasizing the advantages of lightweight specialized models for OCR tasks.