ternary-bonsai-27b

Tag

Cards List
#ternary-bonsai-27b

@ciruai: Finally 256k context for 16GB cards on smart models at high speeds! Using a 4080 Super 16GB I show you how to get full …

X AI KOLs Timeline · 14h ago Cached

Demonstrates achieving 256k context on a 16GB RTX 4080 Super using Ternary Bonsai 27B Q2_0 model with llama.cpp, achieving up to 141 tok/s generation speed.

0 favorites 0 likes
#ternary-bonsai-27b

Bonsai-27B & Ternary-Bonsai-27B - Updates (on PRs)

Reddit r/LocalLLaMA · yesterday

Updates on Bonsai-27B and Ternary-Bonsai-27B models, detailing upstream merge status in llama.cpp across CPU, Metal, CUDA, Vulkan backends, and discussing model limitations and roadmap.

0 favorites 0 likes
← Back to home

Submit Feedback