@antirez: Why I'm taking this DwarfStar thing so serious? It is from the times of Redis that this didn't happen. I believe strong…
Summary
Salvatore Sanfilippo (antirez) expresses serious excitement about DwarfStar, a new project for local AI inference, comparing it to the early days of Redis.
Similar Articles
A few words on DS4
Antirez announces DwarfStar 4 (DS4), a local AI tool that runs DeepSeek v4 Flash with asymmetric 2/8 bit quantization on high-end consumer hardware, achieving near-frontier performance. He discusses the project's rapid popularity, future plans for model updates and distributed inference, and the significance of local AI for serious tasks.
@QuixiAI: https://x.com/QuixiAI/status/2068776183102067086
DwarfStar is a self-contained native inference engine optimized for DeepSeek V4 Flash and PRO models, supporting Metal, CUDA, and ROCm backends, with a focus on high-end personal machines and Mac Studios.
@antirez: DS4 is now called DwarfStar4, since you can put a lot of mass into a tiny space... And in a few minutes it is going to …
Antirez announces the renaming of DS4 to DwarfStar4 and teases improved 2-bit quantization for 128GB Macs using an in-house iMatrix method.
@antirez: First kinda working implementation of GLM 5.2 in DwarfStar. Will take some time to be good enough, but it is a promisin…
Antirez reports the first working implementation of GLM 5.2 in DwarfStar, using a 433 GB GGUF file on an M3 Ultra with 512GB RAM, though it needs further refinement.
@axiaisacat: Redis creator antirez drops another hardcore project: ds4. Not just another GGUF runner, but a local inference engine specifically written for DeepSeek V4 Flash: Metal / CUDA 2-bit quantization 1M context KV ...
Redis creator antirez released ds4, a local inference engine optimized for DeepSeek V4 Flash with 2-bit quantization and support for 1M context KV cache on Metal and CUDA.