@Hikari_07_jp: 35B-A6B Model Development Progress Report!! Huge breakthrough — I finally got access to an absolute beast of a server w…
Summary
The developer of a 35B-A6B model reports gaining access to a powerful server with 768GB VRAM and 1.5TB RAM, enabling full-scale evaluations and large-scale tuning. The breakthrough accelerates development of a high-quality AI model.
View Cached Full Text
Cached at: 07/07/26, 05:35 PM
35B-A6B Model Development Progress Report!!
Huge breakthrough — I finally got access to an absolute beast of a server with 768GB VRAM and 1.5TB RAM!! This changes everything. Massive leap forward for the project!
Right now I’m running full evaluations of the developing model simultaneously on my home lab + the workstation I’m borrowing from @x_xedo_x.RTX PRO 6000 will be 12 pieces in total and 1152GB.
Just blindly adding more experts only increases noise, so we’re going all-in on serious large-scale tuning. No shortcuts.
To everyone who shared my posts — thank you from the bottom of my heart. Because of you, this reached people who actually have spare compute lying around. Your help made this possible.
I’m pouring everything I’ve got into this. Gonna deliver a damn good model. Let’s keep pushing!!
Similar Articles
@0xSero: Best models for your hardware this week. 8-12GB - https://huggingface.co/LiquidAI/LFM2.5-8B-A1B… incredible model, so f…
A curated weekly roundup of the best AI models for different hardware configurations, from 8GB to 768GB VRAM, highlighting performance and benchmarks.
3k$ 128GB VRAM + 256GB RAM DDR4 Server
A user details building a home inference server with 128GB VRAM and 256GB DDR4 RAM for AI workloads, achieving satisfactory performance with Qwen3.8 models using a VLLM fork after initial setup issues.
@TheAhmadOsman: HOLYYYY 27B model under 6GBs and 4GBs Local AI will be the default P.S. We are gonna get this optimized in ODS by @Osma…
Ternary Bonsai 27B, a large language model, is demonstrated running locally on an NVIDIA RTX 5090 GPU, requiring under 6GB of memory and enabling end-to-end agentic workflows on consumer hardware.
@itsharmanjot: 384GB of VRAM. On your desk. Not in a datacenter. Autonomous, the company behind SmartDesk, just open sourced complete …
Autonomous open-sourced complete build guides for a personal AI computer with up to 384GB VRAM, enabling local running of open models with no API costs or service shutdown risks.
@servasyy_ai: This is absolutely insane! The local LLM landscape has just been turned upside down! Unsloth just released the latest Dynamic V3.1 quantized version of DeepSeek-V4.1-Flash, and now you can get it flying with just 64GB of RAM! Running a beast this size used to require racks of expensive servers, but this release smashes that barrier: …
Unsloth has released a Dynamic V3.1 quantized GGUF version of DeepSeek-V4.1-Flash-1017, enabling the model to run locally on devices with just 64GB of RAM. It claims up to 3× faster inference, support for a 1-million-token context window, and across-the-board leadership in benchmarks against comparable quantized models.