We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

  • Professional StarCraft player Song Byung-gu playing against a real-time AI system on October 31.
  • Intelligent Machines

    Humans Are Still Better Than AI at StarCraft—for Now

    A StarCraft gamer won 4-0 in the world’s first contest between AI systems and professional human players.

    In the computer game StarCraft, humans still have an edge over artificial intelligence.

    That was clear on Tuesday after professional StarCraft player Song Byung-gu defeated four different bots in the first contest to pit AI systems against pros in live bouts of the game. One of the bots, dubbed “CherryPi,” was developed by Facebook’s AI research lab. The other bots came from Australia, Norway, and Korea.

    The contest took place at Sejong University in Seoul, Korea, which has hosted annual StarCraft AI competitions since 2010. Those previous events matched AI systems against each other (rather than against humans) and were organized, in part, by the Institute of Electrical and Electronics Engineers (IEEE), a U.S.-based engineering association.

    Though it has not attracted as much global scrutiny as the March 2016 tournament between Alphabet’s AlphaGo bot and a human Go champion, the recent Sejong competition is significant because the AI research community considers StarCraft a particularly difficult game for bots to master. Following AlphaGo’s lopsided victory over Lee Sedol last year, and other AI achievements in chess and Atari video games, attention shifted to whether bots could also defeat humans in real-time games such as StarCraft.

    Unlike Go, which allows bots and human players to see the main board and devote time to formulating a strategy, StarCraft requires players to use their memory, devise their strategy, and plan ahead simultaneously, all inside a constrained, simulated world. As a result, researchers view StarCraft as an efficient tool to help AI advance.

    A number of professional StarCraft gamers have said they welcome the challenge of playing against bots. Two leading players told MIT Technology Review earlier this year that they were willing to fight bots on broadcast TV, as in the AlphaGo match, if asked. Executives at Alphabet’s AI-focused division, DeepMind, have hinted that they are interested in organizing such a competition in the future.

    The event wouldn’t be much of a contest if it were held now. During the Sejong competition, Song, who ranks among the best StarCraft players globally, trounced all four bots involved in less than 27 minutes total. (The longest match lasted about 10 and a half minutes; the shortest, just four and a half.) That was true even though the bots were able to move much faster and control multiple tasks at the same time. At one point, the StarCraft bot developed in Norway was completing 19,000 actions per minute. Most professional StarCraft players can’t make more than a few hundred moves a minute.

    Song, 29, said the bots approached the game differently from the way humans do. “We professional gamers initiate combat only when we stand a chance of victory with our army and unit-control skills,” he said in a post-competition interview with MIT Technology Review. In contrast, the bots tried to keep their units alive without making any bold decisions. (In StarCraft, players have to destroy all of their competitors’ resources by scouting and patrolling opponents’ territory and implementing battle strategies.)

    Song did find the bots impressive on some level. “The way they managed their units when they defended against my attacks was stunning at some points,” he said.

    Sign up for The Download
    Your daily dose of what's up in emerging technology

    Kim Kyung-joong, the Sejong University computer engineering professor who organized the competition, said the bots were constrained, in part, by the lack of widely available training data related to StarCraft. “AlphaGo improved its competitiveness and saw progress by learning from data [about the game Go],” Kim pointed out.

    That will change soon. In August, DeepMind and the games company Blizzard Entertainment released a long-awaited set of AI development tools compatible with StarCraft II, the version of the game that is most popular among professional players.

    Other experts now predict that bots will be able to vanquish professional StarCraft players once they are trained properly. “When AI bots are equipped with [high-level] decision-making systems like AlphaGo, humans will never be able to win,” says Jung Han-min, a computer science and engineering professor at the University of Science and Technology in Korea.

    Learn from the humans leading the way in intelligent machines at EmTech Next. Register Today!
    June 11-12, 2019
    Cambridge, MA

    Register now
    More from Intelligent Machines

    Artificial intelligence and robots are transforming how we work and live.

    Want more award-winning journalism? Subscribe to Print + All Access Digital.
    • Print + All Access Digital {! insider.prices.print_digital !}*

      {! insider.display.menuOptionsLabel !}

      The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

      See details+

      12-month subscription

      Unlimited access to all our daily online news and feature stories

      6 bi-monthly issues of print + digital magazine

      10% discount to MIT Technology Review events

      Access to entire PDF magazine archive dating back to 1899

      Ad-free website experience

      The Download: newsletter delivery each weekday to your inbox

      The MIT Technology Review App

    You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.