Could AI training be decentralized like Bitcoin mining? [D]

Reddit r/MachineLearning News

Summary

A discussion explores whether AI training could be decentralized like Bitcoin mining, with participants contributing GPU resources to train open-source models in exchange for tokens, raising questions about verification, fake gradients, and efficiency.

I’ve been thinking about whether the same basic concept behind Bitcoin could be applied to AI training. In Bitcoin, miners perform proof-of-work and are rewarded for contributing computational resources to secure the network. The actual computation itself isn’t particularly useful outside of the network, but it creates a decentralized system. What if a similar incentive structure could be used for training large language models? Instead of miners solving hash puzzles, participants would contribute GPU resources toward training an open-source AI model. In return, they would receive tokens or rewards based on their contribution. Some questions that immediately come to mind: 1. How could the network verify that a participant actually performed useful training work? 2. How would you prevent people from submitting fake or harmful gradients? 3. Could model improvements be measured objectively enough to determine rewards? 4. Would this be more efficient than training models in centralized data centers? 5. Could a decentralized network eventually compete with large AI companies? I know there are already decentralized AI and compute projects, but I’m specifically interested in whether a true “proof-of-training” mechanism could exist, where rewards are tied directly to improving a model rather than simply renting out compute. Curious to hear thoughts from people who understand distributed systems, machine learning, or crypto economics. Is this fundamentally impossible, or is there a viable architecture that could make it work?
Original Article

Similar Articles

Joing all GPUs to train a community model

Reddit r/LocalLLaMA

A discussion about pooling GPUs from a community to train a massive AI model, questioning the feasibility and existing projects despite known bottlenecks like latency and weight poisoning.

Why is AI training still so unfriendly for normal users?

Reddit r/artificial

A user questions why AI training workflows remain engineer-centric and difficult for beginners, suggesting a need for more user-friendly tools that handle GPU selection, billing limits, and deployment automatically.