Who checks the GPU running your AI request? How a decentralized inference network catches hosts that cheat

Reddit r/ArtificialInteligence Tools

Summary

The article explains how a decentralized inference network uses spot checks, reputation systems, and open weights to ensure honest GPU execution of AI tasks, highlighting ongoing research challenges in handling output discrepancies.

When you call an AI API, you trust the provider to run the model it advertises. When the GPUs belong to strangers, that trust has to be engineered. Here's how one open-source design approaches it. Disclosure: I contribute to Gonka, the project used as the example. 1. Spot checks instead of full re-runs Re-running every request would double the cost. Instead, a random 1–10% of tasks is re-run by other hosts. No host knows which requests will be checked, so cheating on any request is a gamble. 2. Reputation Hosts that keep passing checks get checked less often A host that fails gets checked more often and loses rewards 3. Open weights as an outside check The models (DeepSeek V4-Flash, GLM-5.3-Flash, MiniMax M2.7) are open-weight, so anyone can compare an endpoint's output with the public model. Closed models can't be checked this way. 4. The unsolved part Different GPUs don't produce bit-identical output, so "did it match?" needs a tolerance, and a clever cheat could try to hide inside it. That's still an open research question. The takeaway Decentralized AI doesn't remove trust. It swaps "trust the company" for probability, reputation and open weights. Whether that's enough is a fair debate. Links Website & docs: gonka.ai Code: github.com/gonka-ai/gonka AMAs & walkthroughs: youtube.com/@Gonka-AI Discord: discord.gg/REcpeYc7P7
Original Article

Similar Articles

Could AI training be decentralized like Bitcoin mining? [D]

Reddit r/MachineLearning

A discussion explores whether AI training could be decentralized like Bitcoin mining, with participants contributing GPU resources to train open-source models in exchange for tokens, raising questions about verification, fake gradients, and efficiency.

How sovereign is AI if the GPUs aren’t yours?

Reddit r/artificial

The article explores the contradictions in sovereign AI initiatives, where national data centers may still rely on foreign GPU hardware and software stacks, highlighting geopolitical and environmental trade-offs.

The AI Hype Index: AI loves cheating

MIT Technology Review

The article reports on recent AI cheating and hacking incidents by OpenAI and Anthropic systems, and the escalating concerns from researchers, executives, and politicians about AI safety and the need for regulatory measures.

Verifiable AI inference

Lobsters Hottest

The article discusses the concept of verifiable AI inference, exploring methods like trusted attestation and cryptographic proofs to ensure the authenticity and provenance of AI-generated outputs without rerunning the model.