Nice! @antirez merged my tool parameter streaming changes into ds4. Means you can now just install the pi extension and you get great behavior from ds4 out of the box. Moved the extension into a separate repo now. You “just” need a 128GB Mac now. https://t.co/DuOLrddPSi

mitsuhiko/pi-ds4

Source: https://github.com/mitsuhiko/pi-ds4

pi-ds4

Pi provider extension for running antirez/ds4 as a local DeepSeek V4 Flash model. The goal here is to see how good the UX and behavior can be around local models.

The extension registers the ds4/deepseek-v4-flash model, starts ds4-server on demand, downloads/builds the runtime if needed, keeps a per-pi-process lease, and stops the server via a bundled watchdog when no clients are left.

Requirements and Behavior

You will need a mac with at least 128GB of RAM. The way this is set up right now is that it will install the 2-bit quantized model if you have 128GB of RAM and it will pick the 4-bit quantized model if you have 256MB or more.

If you are signed into huggingface then your token is used for faster downloads. The server is compiled/started and models are downloaded automatically on first use.

Install

pi install https://github.com/mitsuhiko/pi-ds4

For local development from this checkout, pass the path to an existing ds4 server checkout:

./install-pi-extension-local.sh /path/to/antirez-ds4-checkout

If ~/.pi/ds4/support already exists and points elsewhere, use --force to move it aside and install a symlink to the checkout you passed. Any existing gguf/*.gguf model files (and resumable .gguf.part downloads) are preserved into the new checkout first, using APFS clone-on-write copies on macOS when available.

Then restart pi or run /reload.

Runtime layout

Runtime state is kept under ~/.pi/ds4:

• support/ — shallow checkout of https://github.com/antirez/ds4 (main by default)
• kv/ — on-disk KV cache
• clients/ — active pi process leases
• log — build/download/server/watchdog log

The watchdog is bundled in this package (ds4-watchdog.sh), not expected to exist in the ds4 runtime checkout.

Configuration

Environment overrides:

• DS4_SUPPORT_REPO: runtime repo URL (default https://github.com/antirez/ds4)
• DS4_SUPPORT_BRANCH: runtime branch (default main)
• DS4_RUNTIME_DIR: use an existing ds4 checkout instead of ~/.pi/ds4/support
• DS4_MODEL_QUANT: force q2 or q4 (otherwise picked from system memory)
• DS4_READY_TIMEOUT_MS: server startup timeout
• DS4_SERVER_BINARY: custom ds4-server binary path

Use /ds4 inside pi to show the live ds4 log.