ram

A user shares their experience offloading the KV cache to RAM in llama.cpp, achieving comparable speeds while freeing VRAM for larger models and context windows, suggesting this trade-off is often worthwhile.

Discusses the trade-off between dense and Mixture-of-Experts (MoE) models for local AI, noting that high-RAM users have limited MoE options beyond Qwen 3.5 122B, and questioning if large GPU is the only viable path.

Explains the historical reason why 32-bit Windows client editions artificially limit RAM to 4 GB: driver compatibility issues with Physical Address Extensions (PAE) and Data Execution Prevention (DEP), as opposed to any nefarious motive.