Tag
ik_llama.cpp now fully supports PrismML's Ternary Bonsai 2 with native CUDA offload, lossless weight repacking, and fast CPU prompt ingestion via -rtr 1, eliminating prior sign tensor bottlenecks. The post provides a setup guide covering PQ2_0 conversion and recommended command-line flags.