Added direct model downloads right from the UI in Anubis OSS - if anyone would help test that would be great
Summary
Anubis OSS, an Apple Silicon Mac app for benchmarking local LLMs, now supports direct model downloads from the UI via a 'Browse Models' button that pulls from ollama.com library. The developer is seeking testers to confirm installation and functionality.
Similar Articles
Ollama Model Tester (GitHub Repo)
A small, dependency-free Python CLI tool that runs the same prompt against your local Ollama models and saves every response to disk, making it easy to compare models side by side.
ModelHub
ModelHub is a menu bar app for running local LLMs on Mac.
My local model setup on an M4 Pro Mac Mini
The author describes their local AI model setup on an M4 Pro Mac mini, using models like Qwen and Gemma with tools such as oMLX and Tailscale to achieve data privacy, cost predictability, and offline capability.
jundot/omlx
oMLX is a new open-source tool for optimized LLM inference on Apple Silicon Macs, featuring continuous batching and tiered KV caching managed via a menu bar app.
@jundotkim: oMLX 0.5.2 is out. (Sorry for the long silence!) https://github.com/jundot/omlx/releases… oMLX is the most convenient w…
oMLX 0.5.2 release adds live menu bar activity, a reorganized Models menu, Bonsai low-bit kernels, and improved performance with custom Metal kernels and native speculative decoding, making it the fastest way to run MLX models on Mac.