Tag
A hobbyist reports progress running the 320B-parameter GLM-5.3-Flash MoE model at ~8-9 tok/s on dual Huawei Ascend 310P cards using vllm-ascend, including hot-swapping modules, YaRN for 1M context, and a hybrid 'Ascend Sidecard' idea to offload weights from CUDA GPUs to Ascend cards.