Don’t bite me for that question please…
Summary
A user asks how people are earning money with local LLM setups, given the high cost of GPU rigs, and explores potential career opportunities in hardware.
Similar Articles
Do you think dedicated hardware for running local LLMs will become affordable anytime soon?
Discusses the potential for affordable dedicated hardware for running local LLMs, considering Chinese manufacturers' ability to produce low-cost hardware at scale.
Do people building local LLM rigs track RTX Ada/workstation card prices, or just consumer cards like the 5090?
A discussion about whether builders of local LLM rigs monitor pricing on workstation GPUs like the RTX 6000 Ada or primarily focus on consumer cards like the RTX 5090, and whether dedicated tracking tools exist for these infrequent, high-stakes purchases.
Is a high-end private local LLM setup worth it?
A user debates whether investing in a high-end private local LLM setup with 5×3090 GPUs can match cloud services like Claude or GPT while ensuring data privacy.
AMD future GPU offerings. Some interesting offerings for a LLM build. What type of LLM rig would you build with these?
Discussion about upcoming AMD GPU offerings and their potential for building an LLM rig, asking the community for build suggestions.
Local LLMs aren't democratic anymore... the hardware barrier has gotten out of hand.
The author argues that running local LLMs has become inaccessible due to high hardware costs, contrasting with earlier days when consumer GPUs sufficed, and expresses frustration with the perceived lack of democratic access.