Which current local models that can run within 128GB generate the best SVG pelicans?

Reddit r/LocalLLaMA News
local-llm svg-generation quantization qwen deepseek benchmark

Summary

The article benchmarks local LLMs running on 128GB Apple Silicon for generating SVG pelicans, comparing Qwen3.8 variants and DeepSeek V4 with quantizations by Unsloth.

I used a famous Simon Willison's pelican riding a bicycle prompt on the biggest local LLMs that can run on 128GB Apple Silicon. U used quantizations by Unsloth. Qwen3.8 Flash-Next gives a lot of details. DeepSeek V4 Flash is strangely underwhelming. Qwen3.8 27B still rocks, and I like its consistent minimalism. Is Qwen3.8 27B still large at 31GB? It is! But for this tasks 2-bit quantizations (at around 12GB) will give the same results. For more complicated coding, 4-bit are more than enough. RTX cards are well enough! See: Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses - Terminal-Bench 2.1, GPQA Diamond and IFBench Do Qwen3.6 27B quantizations break the pelican?
Original Article

Similar Articles

Qwen3.6-35B-A3B on my laptop drew me a better pelican than Claude Opus 4.7

Simon Willison's Blog

Simon Willison compares Qwen3.6-35B-A3B running locally on a MacBook Pro against Claude Opus 4.7, finding that Qwen produces better SVG illustrations of pelicans riding bicycles and flamingos on unicycles, though he notes this narrow benchmark doesn't reflect broader model capabilities.

Do Qwen 3.6 27B quantizations break the pelican?

Reddit r/LocalLLaMA

The article evaluates how different quantizations of the Qwen3.6-27B model affect output quality using KL divergence and top-1 token accuracy, as well as visual examples like SVG drawings.

Running local models on an M4 with 24GB memory

Hacker News Top

A guide on running local AI models like Qwen 3.5-9B on an M4 MacBook with 24GB RAM using tools like LM Studio, Ollama, and pi, including specific configuration tips for optimal performance.