Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

Intelligent Machines

An AI Poker Bot Has Whipped the Pros

It’s another seminal moment for machine learning, and a painful schooling for humans.

Humans have been bested by a computer in yet another game once considered too difficult for artificial intelligence to master.

Over the past three weeks, an AI poker bot called Libratus has played thousands of games of heads-up, no-limit Texas hold’em against a cadre of top professional players at Rivers Casino in Pittsburgh. And it beat them all.

Our own Will Knight recently explained why victory for Libratus, which was built by a pair of researchers at Carnegie Mellon University, would be such a big deal:

Poker requires reasoning and intelligence that has proven difficult for machines to imitate. It is fundamentally different from checkers, chess, or Go, because an opponent’s hand remains hidden from view during play. In games of “imperfect information,” it is enormously complicated to figure out the ideal strategy given every possible approach your opponent may be taking.

In heads-up, no-limit Texas hold’em, then, it's virtually impossible, for there is no single correct play. Instead, the AI must use game theory to calculate optimal plays given the uncertainties.

In the end, it wasn’t even close: Libratus made off with $1.8 million in chips, while all four of the pros ended up with a deficit. Artificial intelligence has never beaten top players at a game so lacking in information as no-limit Texas hold’em. Like DeepMind’s Go victory before it, then, the win is a seminal moment for the machine learning community.

But what was it like for the humans to play against? “It’s slightly demoralizing," Jason Les, one of the professionals, told the Guardian. "If you play a human and lose, you can stop, take a break. Here we have to show up to take a beating every day for 11 hours a day. It’s a real different emotional experience when you’re not used to losing that often.”

Daniel McAulay, another professional, explained to Wired that the AI's ability to hold different plays in its memory made it stand apart from human contenders. “It splits its bets into three, four, five different sizes,” he explained. “No human has the ability to do that.” Still, don’t feel too badly for the vanquished humans: despite losing, they're divvying up $200,000 between themselves based on how well they did during the tournament.

For the AI, though, this is just the start. Having proven that it’s possible to beat the professionals at their own game, there is now a very clear next challenge to chew on: multi-player no-limit Texas hold’em. But the game theory used in the current software falls down when there's more than one opponent, and it's not clear what technique to use instead.

Still, given the progress machine learning is currently making, and the fact that other AI poker bots are also being developed, that seemingly impossible challenge may not remain impossible for long.

(Read more: BloombergWired, The Guardian, “Why Poker Is a Big Deal for Artificial Intelligence,” “Poker Is the Latest Game to Fold Against Artificial Intelligence,” “Five Lessons from AlphaGo’s Historic Victory”)

Keep up with the latest in artificial intelligence at EmTech Digital.

The Countdown has begun.
March 25-26, 2019
San Francisco, CA

Register now
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to MIT Technology Review.
  • Print + All Access Digital {! insider.prices.print_digital !}* Best Value

    {! insider.display.menuOptionsLabel !}

    The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    6 bi-monthly issues of print + digital magazine

    10% discount to MIT Technology Review events

    Access to entire PDF magazine archive dating back to 1899

    Ad-free website experience

    The Download: newsletter delivered daily

  • All Access Digital {! insider.prices.digital !}*

    {! insider.display.menuOptionsLabel !}

    The digital magazine, plus unlimited site access, our online archive, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    Digital magazine (6 bi-monthly issues)

    Access to entire PDF magazine archive dating back to 1899

    The Download: newsletter delivered daily

  • Print Subscription {! insider.prices.print_only !}*

    {! insider.display.menuOptionsLabel !}

    Six print issues per year plus The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Print magazine (6 bi-monthly issues)

    The Download: newsletter delivered daily

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.