Any good uses for a 192 GB DDR3 Server in the LLM world?
Summary
A discussion about potential uses for an older DDR3 server with 192GB of RAM in the context of large language model workloads.
Similar Articles
Local LLM CPU users... How long is it taking you to do anything?
A discussion about the performance of running large language models locally on CPU, especially with large context sizes, and the challenges of VRAM constraints.
If you had a 384GB (4x Blackwell), what model would you put on it and why?
User asks the community for recommendations on which large language model to deploy on a high-end local setup with 4 RTX PRO 6000 GPUs (384GB total), primarily for internal company policy management and thinking tasks.
Trying to make an uber-cheap local LLM server
An attempt to build a very inexpensive local server for running large language models.
How i managed to run a 193B Parameter model using only 24gb of Ram
Describes Iris Ai, a system that routes queries across 8 specialized LLMs on consumer hardware, achieving large-model performance with low memory by keeping only one model active at a time and dynamic model swapping.
2x 512gb ram M3 Ultra mac studios
A user shares their $25k hardware setup of two 512GB RAM M3 Ultra Mac Studios for running large language models locally, having tested DeepSeek V3 Q8 and GLM 5.1 Q4 via the exo distributed inference backend, while awaiting Kimi 2.6 MLX optimization.