Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Intelligent Machines

Facebook Wants to Merge AI Systems for a Smarter Chatbot

A framework called ParlAI will let researchers combine dialogue systems and get feedback from real humans.

It’s possible to have a computer use conversational tricks that provide the appearance of intelligence for a few minutes, but the complexity of language eventually destroys the illusion.

Facebook has released a platform that could combine different advances in artificial intelligence and make machines a lot more articulate.

The framework, called ParlAI, offers researchers a simpler way to build conversational AI systems, and to combine different approaches to machine dialogue. The framework should make it easier for developers to build chatbots that aren’t so easily stumped by an unexpected question. A common criticism of the chatbots released to date, including those available via Facebook, is that they are too narrowly focused and too easily confused.

The long-term hope is that ParlAI will help advance the state of the art in natural language research by reducing the amount of work required to develop and benchmark different approaches.

ParlAI comes with more than 20 different natural language data sets built in. These include question-and-answer examples from Stanford, Microsoft, and Facebook. And it provides ways to use several popular machine-learning libraries. Creating algorithms capable of learning to perform multiple different things—such as answering various types of questions—is seen as an important challenge in AI research.

The system is also integrated with Amazon’s Mechanical Turk, a platform for outsourcing small tasks. This means researchers will be able to ask humans to help train their dialogue systems, something that many see as vital to the development of smarter conversational agents.

Creating a machine capable of holding a decent conversation remains one of the holy grails of artificial intelligence (see “AI’s Language Problem”). It’s possible to have a computer use conversational ticks and tricks that provide the appearance of intelligence for a few minutes. But the complexity of language, and the way it taps into learning and common-sense knowledge, causes this to quickly unravel.

“This is a problem that goes beyond simply getting machines to understand language or generate speech,” says Yann LeCun, Facebook’s director of AI and a major figure in the field.

Facebook and others also believe that better dialogue systems could have myriad commercial applications. The social network has created tools to allow outside developers to build chatbots on its platform that perform useful tasks, like looking up information or ordering products. Facebook has also poured significant resources into its own conversational assistant, called M, which is being tested by a select group of users (see “Facebooks Perfect, Impossible Chatbot”).

ParlAI represents recognition of the challenge that remains, but it could spur progress.

Subscribe to Weekend Reads
Our guide to stories in the archives that put technology in perspective.
Manage your newsletter preferences

“A complete question-answering system requires a lot of different components, which this framework looks to provide,” says Richard Socher, chief scientist at Salesforce and a well-respected expert on machine learning and computer dialogue. “The community will benefit immensely from a larger data set testing platform like this.”

Oren Etzioni, head of the Allen Institute for AI in Seattle, says ParlAI should be welcomed by anyone working on natural language understanding. “It isn’t a breakthrough, but it should be a helpful enabling technology,” Etzioni says.

Etzioni adds that there has been relatively little focus on dialogue systems in recent years. He also says that new machine approaches such as reinforcement learning, which mimics the way animals learn through positive feedback, could help make conversational machines way smarter.

“I think you will see real progress in the next five years,” he says.

Hear more about deep learning at EmTech MIT 2017.

Register now
It’s possible to have a computer use conversational tricks that provide the appearance of intelligence for a few minutes, but the complexity of language eventually destroys the illusion.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look: exclusive early access to important stories, before they’re available to anyone else

    Insider Conversations: listen in on in-depth calls between our editors and today’s thought leaders

  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning magazine and daily delivery of The Download, our newsletter of what’s important in technology and innovation.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.