small-gpu

Tag

Cards List
#small-gpu

A better coder for the small-GPU/small-RAM crowd!

Reddit r/LocalLLaMA ↗ · 2026-09-21

A new quantized AI model, Sharp-Spark-X2.5-4B-GGUF, is released with improvements for agentic coding on small GPUs and limited RAM, enhancing local coding capabilities for less privileged users.

0 favorites 0 likes
#small-gpu

Tmax-27b - a Qwen3.6-27b terminal agent for small GPUs trained with DPPO (RL)

Reddit r/LocalLLaMA ↗ · 2026-06-23

Ai2 released Tmax-27B, a terminal-agent LLM trained with DPPO (RL) on Qwen3.6-27B, and the author provides importance-matrix-calibrated GGUF quantizations that achieve competitive performance on agentic benchmarks even at very low bit-widths, with a grafted MTP draft head for speculative decoding.

0 favorites 0 likes
← Back to home

Submit Feedback