I built a server with 768GB VRAM for frontier, but all new frontier open source models are likely to be two trillion or above now, including next GLM 6, am I cooked?
Summary
An individual discusses building a server with 768GB VRAM for running frontier AI models but is concerned that new open-source models like GLM6 are becoming too large, prompting consideration of downsizing to smaller flash models.
Similar Articles
So is a "scaled-up Strata" coming for >128GB models?
A community post speculates whether a scaled-up or 'stratified' version of GLM 5.3-Flash (or similar) is coming for models over 128GB, while the author worries their newly built 256GB RAM Epyc server with dual RTX 5060 Ti 16GB GPUs might already be obsolete.
12GB VRAM gang, what's our plan?
Discussion about running LLMs on 12GB VRAM, noting current focus on dense models like Muse Glimmer 30B and Qwen 3.8 27B, and questioning whether upgrading to 24GB VRAM is needed.
How long can I expect to wait until the local ~30B A3B frontier catches up to GLM 5.3 Flash quality?
The user queries whether local AI models around 30B parameters can achieve GLM 5.3 Flash quality within a year, given current hardware constraints like 16GB RAM and 8GB VRAM.
Is there a GLM 5.3 Flash Antirez/DS4 GGUF targeted at 192 GB RAM?
The author asks whether a GLM 5.3 Flash Antirez/DS4 GGUF model around 192 GB RAM exists and seeks advice on creating such a model.
High VRAM local coding model — still Qwen 3.6 27B?
The user discusses their experience with Qwen 3.6 27B for local coding tasks and asks for recommendations for larger models (100B+) suitable for systems with 224GB of VRAM.