Added direct model downloads right from the UI in Anubis OSS - if anyone would help test that would be great
Summary
Anubis OSS, an Apple Silicon Mac app for benchmarking local LLMs, now supports direct model downloads from the UI via a 'Browse Models' button that pulls from ollama.com library. The developer is seeking testers to confirm installation and functionality.
Similar Articles
Ollama Model Tester (GitHub Repo)
A small, dependency-free Python CLI tool that runs the same prompt against your local Ollama models and saves every response to disk, making it easy to compare models side by side.
ModelHub
ModelHub is a menu bar app for running local LLMs on Mac.
jundot/omlx
oMLX is a new open-source tool for optimized LLM inference on Apple Silicon Macs, featuring continuous batching and tiered KV caching managed via a menu bar app.
@jundotkim: oMLX 0.5.2 is out. (Sorry for the long silence!) https://github.com/jundot/omlx/releases… oMLX is the most convenient w…
oMLX 0.5.2 release adds live menu bar activity, a reorganized Models menu, Bonsai low-bit kernels, and improved performance with custom Metal kernels and native speculative decoding, making it the fastest way to run MLX models on Mac.
@cevenif: For those running local LLMs on Macs, here's a tool worth watching — Rapid-MLX. It delivers 2-4x faster inference on M-series chips than Ollama, thanks to being built directly on Apple's MLX framework for more thorough utilization of the chip architecture. Key highlights: KV cache pruning plus…
Rapid-MLX is a local LLM inference tool optimized for Apple M-series chips. Built on the MLX framework, it achieves 2 to 4 times faster inference than Ollama, supports multiple models, tool calling, and an OpenAI API-compatible interface.