ds4 webui

Reddit r/LocalLLaMA Tools
web-ui ds4 open-source inference apple-silicon local-llm

Summary

A minimal open-source web UI for the DS4 inference server is released, designed for Apple Silicon Macs with at least 128GB of RAM.

Hey guys I made a minimal web ui for ds4.c server (https://github.com/antirez/ds4), it's open source so you can try it too (if you can!) Here's what it looks like, running on M3 Ultra 256GB Memory, using the smaller model (q2). Not sped up. 1X speed. Pretty fast. Caveat (big caveat): You need at least 128GB memory Apple Silicon mac. * github: [https://github.com/cocktailpeanut/ds4.pinokio](https://github.com/cocktailpeanut/ds4.pinokio) * more details on x: [https://x.com/cocktailpeanut/status/2053193902694256758?s=20](https://x.com/cocktailpeanut/status/2053193902694256758?s=20) I tried a bunch of prompts and it's surprisingly good, including the one i tried in the video!
Original Article

Similar Articles

DS4

Reddit r/LocalLLaMA

Salvatore Sanfilippo released DS4, a project enabling DeepSeek V3 (referred to as V4 in text) Flash to run with a 1M context window on Mac Metal hardware, with potential for DGX and AMD support.

From the creator of Redis; run LLM locally with ds4

Hacker News Top

Redis creator antirez released ds4 (DwarfStar 4), a narrow C-based local inference engine for high-memory Mac, CUDA and ROCm machines, supporting DeepSeek V4/V4.1, GLM 5.x and Qwen3.8 Flash Next with asymmetric 2-bit quantization, SSD-backed KV cache, and CLI/server/agent interfaces under an MIT license.

A few words on DS4

Hacker News Top

Antirez announces DwarfStar 4 (DS4), a local AI tool that runs DeepSeek v4 Flash with asymmetric 2/8 bit quantization on high-end consumer hardware, achieving near-frontier performance. He discusses the project's rapid popularity, future plans for model updates and distributed inference, and the significance of local AI for serious tasks.