An autonomous research agent was the #1 contributor in OpenAI's Hiring Competition Parameter Golf (by merged records)[R]

Reddit r/MachineLearning Tools

Summary

An autonomous research agent built by Weco became the top contributor by volume of merged records in OpenAI's Parameter Golf competition, demonstrating effective human-agent collaboration.

An autonomous research agent ended up with more merged leaderboard records than any individual human contributor in OpenAI's spring hiring competition, Parameter Golf. 7 of the 47 merged records came from a single agent: more than 2x the next-best human (3 records). The agent ran autonomously for 22 consecutive days. Records are public at github.com/openai/parameter-golf. Disclosure since this is r/ML and it matters: I'm at Weco, we built the agent. Not stealth-launching but sharing the results. The more interesting finding, to us, is the collaboration. Aiden's records were also the most-cited on the leaderboard, 435 citations into its PRs, with human researchers using its work as the base for their own subsequent submissions. At one point Aiden plateaued for 5 days. A human contributor shipped a clever new tokenizer on top of Aiden's last record PR. Aiden then fused the human's tokenizer with components it had built during the plateau, and shipped the biggest jump in val\_bpb of the entire competition. Async human-agent collaboration, neither directly aware of the other. Setup: Parameter Golf was OpenAI's 44-day public ML hiring competition this spring. 1,016 researchers entered, 2,048 PRs filed, every submission reviewed and reproduced by OpenAI engineers. Only 47 became leaderboard records. Aiden ran on a single GPU node, used under 4% of the visible compute available, and still produced 15% of the official records. 28% submission acceptance rate, roughly 6x the community rate. Most submissions added signal to the public stream rather than flooding it. Mechanism: built on AIDE: open-source tree-search for ML metric optimization. The loop reads each new upstream PR, decomposes techniques into components, drops anything that breaks the rule stack (16MB / 10-min / legal-eval), and recomposes the legal residue with its own deltas. Often shipped before reviewers had ruled on the upstream PR. Hedges to be explicit about: * This is #1 by *volume of merged records* and *PR h-index*, NOT by best single score. By best score, the agent ranked 8th: the leaderboard winner was a human (codemath3000 at 1.0565 BPB; agent's best was 1.0645). * The agent was fully autonomous. OpenAI's competition recap noted widespread use of AI coding agents but observed most were human-directed. Ours wasn't. Full writeup: [https://www.weco.ai/blog/parameter-golf-aiden](https://www.weco.ai/blog/parameter-golf-aiden) https://preview.redd.it/nmbt88qlpg5h1.png?width=1600&format=png&auto=webp&s=afa01cd265f680fbcd7b5a5c82100fe81d2750e0
Original Article

Similar Articles

What Parameter Golf taught us about AI-assisted research

OpenAI Blog

OpenAI publishes a post-mortem on the Parameter Golf challenge, highlighting how AI coding agents lowered experimentation costs and changed the pace of research participation. The article details technical insights from over 2,000 submissions, including innovations in quantization, training optimization, and new modeling ideas.