Anyone else completely tuning out these massive "open weight" drops?

Reddit r/LocalLLaMA News

Summary

A community member expresses frustration that massive open-weight models like GLM-5.2 (753B parameters) are impractical for local self-hosting due to extreme VRAM requirements, arguing the trend undermines the original spirit of the local AI community.

Tbh the benchmarks on stuff like GLM-5.2 look insane. 753B params, 1M context, MIT license... everyone is throwing a party on the front page right now. But like... what is actually "local" about this anymore? A 700B+ MoE isn't fitting on anyone's home rig. Even if you absolutely crush it down to a q1 or q2 GGUF, you're still not running it. I've got a dual-GPU setup running on a solid x8/x8 bifurcation board, and even heavily optimized under AMD ROCm, these behemoths are physically impossible to load without an enterprise server rack. I miss when this sub was actually about self-hosting. The vibe used to be sharing compile tricks, fighting with llama.cpp ⁠--batch⁠ sizes, testing new quants, and actually squeezing models into our hardware. Now half the posts are basically just free marketing for models that 99% of us can only use by paying for APIs or renting cloud instances. Which completely defeats the purpose. Don't get me wrong, it's cool that the weights are actually published instead of locked in a vault. But practically speaking? They might as well be closed source for normal people. Maybe I'm just salty about being VRAM poor lol, but the hype for these giant unrunnable drops is totally dead for me. Anyone else feeling this?
Original Article

Similar Articles

GLM-5.2 is a win for local AI

Reddit r/LocalLLaMA

GLM-5.2, a 753B parameter open-source model with MIT license, offers frontier-level coding capabilities and massive context window. Its distillation potential promises significant improvements for local AI setups.

GLM-5.2 is the new leading open weights model on Artificial Analysis

Hacker News Top

Z ai's GLM-5.2 has become the new leading open weights model on the Artificial Analysis Intelligence Index, scoring 51 and outperforming competitors like MiniMax-M3 and DeepSeek V4 Pro. The model features 744B total parameters, 40B active, MIT license, and 1M context window.