Update #2: Post training yandex/AliceAI-80B-A3B [instruct!] from scratch

Reddit r/LocalLLaMA Models
post-training instruct-tuning moe qora open-source fine-tuning v100-gpu

Summary

Community developer posts a progress update on post-training Yandex/AliceAI-80B-A3B into an instruct model using synthetic distilled SFT data via QLoRA on three V100 GPUs, with plans to release GGUF quants, a llama.cpp patch, public checkpoints, and subsequent RL training.

Last update: https://www.reddit.com/r/LocalLLaMA/comments/1wu9ksu/update_yandexaliceai_80ba3b_fine_tune_progress/ - basically, an instruct fine tune on the base model using a synthetic distilled data set. I've been posting regular updates so I imagine at least a few people have seen this. Live stream: https://figure-bios-expect-cio.trycloudflare.com/ The initial train is finally almost done, after about 48 hours of humming. While the loss curve looks a little crazy, I've done some analysis (and some chatting with the LLMs) to understand that my average loss each epoch has been steadily decreasing (few reasons the loss curve looks wacky, vocabulary size, low to high token counts in epochs, etc) - but I'm pretty happy with what I'm seeing so far. I'm post training the attention and the shared expert, and leaving the base experts frozen - this is a behavioral and logic fine tune that preserves the original yandex training data. I plan on, within the next few days, releasing a few gguf quants of this, along with a llama.cpp patch for running it locally. I'm not sure how well the initial fine tune is going to work out - loss looks good but I'll have to do some evaluating. Either way, I plan on continuing training with reinforcement learning and an extended SFT set, as I have room and a ton of capacity left in my QLoRA adapter. I'll release this version as a public checkpoint anyways though (kinda like how deepseek did it) so people can play around with it and hopefully get excited for new checkpoints. Cheers! Stay tuned, this is a pretty fun model size to play with, I'm excited to release the instruct version. I'll open source whatever you guys want out of this - I already open sourced the distillation engine (see SFTMill, it's been posted in here in the last few days) - but I also have a custom kernel for training this for V100s and a few other patches I can share (this training has been plugging away on 3, 32gb v100s - man it took a while to get that to work). Mandatory plug for my own goals: if you're hiring remote or in NYC for a dev or ml engineer, hit me up!
Original Article

Similar Articles

Update #4: Post training yandex/AliceAI-80B-A3B [instruct!] from scratch

Reddit r/LocalLLaMA

社区成员持续在本地 3 张 32GB V100 上从头后训练 Yandex ALiceAI-80B-A3B，通过 Qwen 3.8 27B 的浅层蒸馏传授链式思维与对话能力；第一轮 SFT 已完成但严重欠拟合，正在扩大合成指令数据量并以更广的数据分布进行第二轮训练，同时开源了其离轨蒸馏引擎 sftmill。