Is it worth getting a 5090 for my needs?
Summary
User asks whether purchasing an RTX 5090 and high-end PC for ~$5500 is worth it for LLM experimentation and learning, compared to cloud compute alternatives.
Similar Articles
Is a high-end private local LLM setup worth it?
A user debates whether investing in a high-end private local LLM setup with 5×3090 GPUs can match cloud services like Claude or GPT while ensuring data privacy.
Which computer should I buy: Mac or custom-built 5090? [D]
A user seeks advice on whether to purchase a Mac (M5) or custom-built RTX 5090 for machine learning projects involving fine-tuning, custom pipelines, and image/video-heavy workflows, with curiosity about Apple's MLX framework as an alternative to NVIDIA CUDA.
Was my $48K GPU server worth it?
A former FAANG engineer recounts building a $48K GPU server with six RTX 6000 Ada cards for independent AI research, detailing the build process, power constraints, and a cost comparison against cloud GPU rentals.
If you had $150K for building a production-class local inference server to serve 300 people, what would you buy?
A user seeks advice on purchasing a failover inference server under $150K to serve 300 people, discussing options like used H100s, RTX Pro 6000, and DGX Station for running 122b AWQ models with vLLM.
The 'storage tax' on cloud GPUs for short LLM runs is brutal. What's your workflow?
User seeks advice on cost-effective cloud GPU workflows for short LLM testing sessions, highlighting storage fees as a key pain point when preserving environments between runs.