I made this android app which runs ai models locally

Reddit r/artificial Tools

Summary

A developer created an Android app that runs AI models locally, supporting GGUF and LiteRT formats with multiple ways to add models.

I wanted to add link on this post but wasn't able to , cause it was either photos or the link that's why I gave the photos , If you need link just ask for link. ​ ​ Few months ago I wanted to try running ai models on my phone and I was trying to find few apps ,but i couldn't find a decent one ​ \- Some were giving handpicked models \- Some restricted downloads of model based on my device config \- Experienced not being smooth \- Background download was not supported \- etc etc ​ ​ ​ So i made one , Features :::--- ​ \- Can run any GGUF || LiteRT models ​ ​ \- has 3 ways of adding model to models list \-> Downloading from recommended handpicked list of models for not knowing user \-> Downloading from in app Hugging Face integration \-> Importing gguf & LiteRt models from your device's internal storage ​ ​ ​ \- Two backend available ( cpu , vulkan ) \-> You must set the preference to vulkan if you want to set gpu layers in settings. ​ ​ ​ \- You can set system prompt( for setting personas or telling the model how to behave ) \- Can modify inference parameters ​ ​ ​ \- And this is just the first version. \-> A new feature will be coming soon which will just make it the bbbbbest ( won't say what it is now ) ​ ​ ( Download will continue even after you close your app , thus you must cancel the download manually if your want to ) ​ ​ ​ ​ My device Config - Ram - 4gb ( max free - 1.4-1.6 on good days) Rom - 64gb Os - Android 10 ​ All screenshots are from this device ​ And neither this text nor the application is vibe coded ,( ai autocomplete is used , but that's it) ​
Original Article

Similar Articles