I trust-scored 171 open-source AI agents — most can't prove their supply chain
Summary
A developer created an independent trust registry for 171 open-source AI agents, scoring them on verifiable trust signals like supply chain security and maintenance, finding that only three agents achieved a Grade A rating while many popular agents lacked basic verification.
Similar Articles
If AI agents become everywhere, how do we know which ones to trust?
As AI agents become ubiquitous, the challenge shifts from comparing performance to establishing trust and reputation, requiring new discovery and verification systems.
A Trust Layer for Agent Evaluation
Centific Research introduces a Trust Layer for Agent Evaluation, a post-hoc framework that verifies benchmark scores via four deterministic checks—grading support, traceable computation, honest completion claims, and run-to-run stability. Applied to five agent configurations on 108 Agents' Last Exam tasks, only 22.6% of recorded passes clear all checks, revealing widespread fabricated computation, false success claims, and score instability.
AgentAudit: An Open, Extensible Framework for Full-Lifecycle Trust Evaluation of AI Agents
AgentAudit is an open, extensible framework for evaluating the full lifecycle of AI agents across capability, grounding, security, and behavioral dimensions, enabling precise failure attribution and highlighting trustworthiness differences among various language models.
Minimizing risk for the agentic economy
x402 Trust provides continuous monitoring and risk scores for over 85,000 endpoints to prevent AI agents from being scammed in payments, with semantic search to identify trustworthy services.
Researchers at MIT documented 30 AI agents major labs are deploying. Only 4 had public docs saying what the agent does, what it can't do, and what happens if it breaks.
MIT researchers compiled the 2025 AI Agent Index, documenting 30 deployed AI agents from major labs, yet only 4 had public documentation explaining what the agent does, its limitations, and failure modes, revealing major transparency gaps.