arc-prize

The president of ARC Prize is soliciting ideas for games to test the AI model Astra's capabilities in areas where it has not yet succeeded.

OpenAI's reported 99.9% AGI benchmark score for GPT-6 Astra was achieved using a specific harness (Provider Adapter), while the standard harness yields a much lower 62.7% score, highlighting significant issues in AI model evaluation and benchmarking transparency.