Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

  • Iconary
  • Intelligent Machines

    An AI is playing Pictionary to figure out how the world works

    Forget Go or StarCraft—guessing the phrase behind a drawing will require machines to gain some understanding of the way concepts fit together in the real world.

    It might be a frivolous after-dinner game to you, but Pictionary could perhaps give AI programs a deeper understanding of the world.

    AI’s lack of common sense is one of the main obstacles to the development of chatbots and voice assistants that are genuinely useful. What’s more, while AI programs can trounce the best human players of many games, including chess, Go, and (more recently) StarCraft, mastering them offers only a narrow measure of artificial intelligence. Learning to play chess, for instance, does nothing to help a computer play Sudoku.

    Researchers at the Allen Institute for AI (Ai2) believe that Pictionary could push machine intelligence beyond its current limits. To that end, they have devised an online version of the game that pairs a human player with an AI program.

    Sign up for the The Algorithm
    Artificial intelligence, demystified

    In case you’ve never played it before, Pictionary involves trying to draw an image that conveys a written word or phrase for your teammates to guess. This tests a person’s drawing skills but also the ability to convey complex meaning using simple concepts. Given the phrase “wedding ring,” for example, a player might try to draw the object itself but also a bride and groom or a wedding ceremony.

    “You’ve got to use a lot of sophisticated reasoning,” says Ali Farhadi, the lead research on the Ai2 project. “It actually teaches common sense.”

    That makes it the perfect vehicle to help teach machines. The team developed an online version of the game, called Iconary, that pairs a user with an AI bot called AllenAI. Both take turns as the artist and the guesser. Playing as artist, a user is given a phrase and then has to sketch things to convey it. The sketches are first turned into clip-art icons using computer vision; then the computer program tries to guess the phrase using a database of words and concepts and the relationship between them. If the program gets only part of the phrase, it will ask for another image to clarify.

    Given the phrase “turning a page,” for instance, a player could try drawing a book, a hand, and a curved arrow. In that particular case, the AllenAI program guesses correctly after just a couple of tries.

    The AI program uses a combination of AI techniques to draw and guess. Over time, by playing against enough people, AllenAI should learn from their common-sense understanding of how concepts (like “books” and “pages”) go together in everyday life, Fahadi says. It will also help the researchers explore ways for humans and machines to communicate and collaborate more effectively.

    In total there are 1,200 icons, 75,000 possible phrases, and a vocabulary of 20,000 words. And there are two modes: easy and hard. The plan is to create a leaderboard to bring out people’s competitive spirit—and help accelerate the AI's learning.

    Fahadi says Iconary is a better measure of AI smarts than Go or chess because it requires much broader intelligence. “Games have been a successful platform for testing AI,” he says, “but intelligence is more than pattern matching.”

    Eventually, he says, it could be used as a new kind of Turing test—players could try to guess whether their teammate is a human or a machine.

    Tech Obsessive?
    Become an Insider to get the story behind the story — and before anyone else.

    Subscribe today
    More from Intelligent Machines

    Artificial intelligence and robots are transforming how we work and live.

    Want more award-winning journalism? Subscribe to Print + All Access Digital.
    • Print + All Access Digital {! insider.prices.print_digital !}*

      {! insider.display.menuOptionsLabel !}

      The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

      See details+

      12-month subscription

      Unlimited access to all our daily online news and feature stories

      6 bi-monthly issues of print + digital magazine

      10% discount to MIT Technology Review events

      Access to entire PDF magazine archive dating back to 1899

      Ad-free website experience

      The Download: newsletter delivered daily

    /3
    You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.