2-bit-format

Tag

Cards List
#2-bit-format

@HuggingModels: Meet Ternary-Bonsai-2-27B: a 27B parameter model squeezed into 2-bit ternary format. Runs on llama.cpp with CUDA and Me…

X AI KOLs Timeline ↗ · 6d ago Cached

Ternary-Bonsai-2-27B is a 27B parameter AI model compressed into 2-bit ternary format, running on llama.cpp with CUDA and Metal support, facilitating lightweight on-device AI deployment.

0 favorites 0 likes
← Back to home

Submit Feedback