OpenAI Five Benchmark

OpenAI Blog Events

Summary

OpenAI Five completed a benchmark match against humans in Dota 2, demonstrating improved capabilities including expanded hero pool (18 heroes), Roshan pit mechanics, and wards. The system shows general training flexibility in acquiring complex game skills.

The OpenAI Five Benchmark match is now over!
Original Article
View Cached Full Text

Cached at: 04/20/26, 02:45 PM

# OpenAI Five Benchmark Source: [https://openai.com/index/openai-five-benchmark/](https://openai.com/index/openai-five-benchmark/) OpenAIThe OpenAI Five Benchmark match is now over\! ![Benchmark](https://images.ctfassets.net/kftzwdyauwt9/03f3aa19-f679-4f73-33a7c7701e4e/215aa7bc7109c41541576088ac3fc206/benchmark.jpg?w=3840&q=90&fm=webp) Because our training system[Rapid⁠](https://openai.com/index/openai-five/#rapid)is very general, we were able to teach OpenAI Five many complex skills since June simply by integrating new features and randomizations\. Many people pointed out that wards and Roshan were particularly important to include—and now we’ve done so\. We’ve also increased the hero pool to 18 heroes\. Many commenters thought these improvements would[take⁠\(opens in a new window\)](https://www.reddit.com/r/MachineLearning/comments/8tr11j/r_openai_five/e1ahy9i/)[another⁠\(opens in a new window\)](https://www.reddit.com/r/MachineLearning/comments/8tr11j/r_openai_five/e19olxa/)[year⁠\(opens in a new window\)](https://www.reddit.com/r/DotA2/comments/8vr66c/openai_will_be_playing_a_human_team_live_on/e1q0vsa)\. We’ll see how well these new game mechanics work on August 5th\! ![An aerial view of Rosh4 Healthbars](https://images.ctfassets.net/kftzwdyauwt9/46087103-e97a-4552-500e96787785/599903d524838e711aef144989857f5f/Rosh4_healthbars.png?w=3840&q=90&fm=webp) The latest version of OpenAI Five taking Roshan\. We will play with the following restrictions \(the crossed out restrictions are those lifted since the original OpenAI Five blog post\), which correspond to the last bits of the game we haven’t integrated: - **Pool of 18 heroes \(**[**Axe**⁠\(opens in a new window\)](https://liquipedia.net/dota2/Axe)**,**[**Crystal Maiden**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Crystal_Maiden)**,**[**Death Prophet**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Death_Prophet)**,**[**Earthshaker**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Earthshaker)**,**[**Gyrocopter**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Gyrocopter)**,**[**Lich**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Lich)**,**[**Lion**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Lion)**,**[**Necrophos**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Necrophos)**,**[**Queen of Pain**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Queen_of_Pain)**,**[**Razor**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Razor)**,**[**Riki**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Riki)**,**[**Shadow Fiend**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Shadow_Fiend)**,**[**Slark**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Slark)**,**[**Sniper**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Sniper)**,**[**Sven**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Sven)**,**[**Tidehunter**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Tidehunter)**,**[**Viper**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Viper)**, or**[**Witch Doctor**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Witch_Doctor)**\)**Mirror match of[Necrophos⁠\(opens in a new window\)](https://dota2.gamepedia.com/Necrophos),[Sniper⁠\(opens in a new window\)](https://dota2.gamepedia.com/Sniper),[Viper⁠\(opens in a new window\)](https://dota2.gamepedia.com/Viper),[Crystal Maiden⁠\(opens in a new window\)](https://dota2.gamepedia.com/Crystal_Maiden), and[Lich⁠\(opens in a new window\)](https://dota2.gamepedia.com/Lich) - **No**[**Divine Rapier**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Divine_Rapier)**,**[**Bottle**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Bottle),[Quelling Blade⁠\(opens in a new window\)](https://dota2.gamepedia.com/Quelling_Blade),[Boots of Travel⁠\(opens in a new window\)](https://dota2.gamepedia.com/Boots_of_Travel),[Tome of Knowledge⁠\(opens in a new window\)](https://dota2.gamepedia.com/Tome_of_Knowledge),[Infused Raindrop⁠\(opens in a new window\)](https://dota2.gamepedia.com/Infused_Raindrop) - **No**[**summons**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Summons)**/**[**illusions**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Illusions) - **5 invulnerable couriers, no exploiting them by scouting or tanking** - **No**[**Scan**⁠\(opens in a new window\)](https://dota2.gamepedia.com/Scan) - No[warding⁠\(opens in a new window\)](https://www.thescoreesports.com/dota2/news/13481-a-basic-guide-to-warding-in-dota-2) - No[Roshan⁠\(opens in a new window\)](https://dota2.gamepedia.com/Roshan) - No[invisibility⁠\(opens in a new window\)](https://dota2.gamepedia.com/Invisibility)\(consumables and relevant items\) We’ve increased the reaction time of OpenAI Five from 80ms to 200ms\. This reaction time is much closer to human level, though we haven’t seen evidence of changes in gameplay as OpenAI Five’s strength comes more from teamwork and coordination than reflexes\. The final date for the match is August 5, and will run as follows: - 12pm PT: doors open - 12:30pm PT: livestream begins with “for fun” audience games - 1:15pm PT: main event begins: intro and best\-of\-three versus 99\.95th percentile Dota players If you’d like to attend the match in person in San Francisco, please[request an invite⁠\(opens in a new window\)](https://docs.google.com/forms/d/e/1FAIpQLScD7voLwWw0maE-K06nZP7rmaoMxAa40YPeSl2FIwGlOqVWRQ/viewform)by Friday July 20 at 11:59p PT; invites will be sent by the end of Monday July 23\. Our venue is limited to 300 attendees, so we’ll be selecting invitees based on their answers to the request form\. If you’ve already requested an invite, you’ll receive an email linking to this form as well\.

Similar Articles

OpenAI Five Benchmark: Results

OpenAI Blog

OpenAI releases benchmark results for OpenAI Five, their Dota 2 playing system, detailing training methodology across six major revisions with compute requirements ranging from 8 to 35 petaflop/s-days and introducing new network architecture tooling.

OpenAI Five

OpenAI Blog

OpenAI Five is a reinforcement learning agent that masters Dota 2 through self-play training with curriculum learning and strategic randomization, progressing from random behavior to executing complex human-level strategies.

OpenAI Five defeats Dota 2 world champions

OpenAI Blog

OpenAI Five becomes the first AI to defeat world-champion esports professionals in Dota 2, winning two back-to-back matches against OG at the OpenAI Five Finals. The breakthrough was achieved through unprecedented scaling of training compute rather than novel algorithms, and the team is retiring OpenAI Five while announcing plans to deploy it for public internet play.

Dota 2 with large scale deep reinforcement learning

OpenAI Blog

OpenAI Five became the first AI system to defeat Dota 2 world champions using large-scale deep reinforcement learning with self-play, demonstrating superhuman performance on a complex game with long time horizons and imperfect information.

OpenAI Five Finals

OpenAI Blog

OpenAI is hosting the OpenAI Five Finals live event on April 13 in the Bay Area, showcasing its Dota 2 AI to demonstrate AI competence, scalability, and human-AI collaboration. The event aims to help the public better understand AI progress and its future impact.