I made this android app which runs ai models locally
Summary
A developer created an Android app that runs AI models locally, supporting GGUF and LiteRT formats with multiple ways to add models.
Similar Articles
We built an app that runs AI completely offline on your phone (Local LLMs). Perfect for flights, camping, or dead zones.
Introduces Cortex AI, an app that runs AI completely offline on phones using optimized local models, addressing privacy and connectivity issues.
I turned an Android phone into a Vulkan-accelerated local LLM node (GGUF + LiteLLM + Tailscale)
An Android phone is repurposed as a portable GGUF inference server with Vulkan acceleration, exposing an OpenAI-compatible endpoint via LiteLLM and Tailscale mesh for integration into a self-hosted AI cluster.
Run (your largest) local models from your iPhone
A tool or app that enables users to run large local AI models directly from their iPhone, bringing on-device LLM inference to iOS.
@DanKornas: Testing an on-device model shouldn’t mean building a mobile app before you can evaluate it. Google AI Edge Gallery is a…
Google AI Edge Gallery is an experimental beta app that lets developers test and evaluate generative AI models on-device without building a full mobile app. It supports model downloads, custom loading, parameter tuning, hardware benchmarks, and multimodal workflows, and is open-source for Android, iOS, and macOS.
@TheAhmadOsman: Excellent points for people who run models locally
A tweet highlights excellent points for people who run AI models locally, linking to further information.