Tag
A hobbyist details two days of tuning a single Tesla P40 24GB (PCIe x1) to run the 35B-A3B Ornith 1.5 MoE model at full 262k context, achieving ~60 t/s short-prompt and ~30 t/s at 100k depth without dropping below Q4 weights or q8 KV, via ECC disabling, int8 dp4a attention, and a trained MTP draft head check.