Intelligent Machines

IBM Pushes Deep Learning with a Watson Upgrade

IBM is combining different AI techniques, including deep learning, in the commercial version of Watson.

To mimic real intelligence, machine-learning techniques they will need to be combined with other approaches.

IBM’s Jeopardy!-playing computer system, Watson, combined two separate areas of artificial intelligence research with winning results. Natural language understanding was merged with statistical analysis of vast, unstructured piles of text to find the likely answers to cryptic Jeopardy! clues.

Now IBM aims to add another powerful AI technique, known as deep learning, to the commercial version of Watson. The move could make the platform considerably smarter and more useful, and points to a promising future direction for AI research.

In its effort to commercialize Watson, IBM has made some of the features developed for the Jeopardy! challenge, as well as some new ones, available to developers via a cloud application programming interface (API). It has now added three deep-learning-based features to this Watson API: translation, speech-to-text, and text-to-speech. These could be used to build, for example, apps or websites that offer translation or transcription services. But developers could also connect them to other Watson services that parse questions and search for answers in large amounts of text. This could lead to an app that makes it possible to search large numbers of documents with naturally spoken queries.

The company has also said that it will collaborate with Yoshua Bengio, a professor at the University of Montreal in Canada, a prominent figure in the field of deep learning.

Deep learning involves training a computer to recognize often complex and abstract patterns by feeding large amounts of data through successive networks of artificial neurons, and refining the way those networks respond to the input. In recent years, the approach has proved very effective for recognizing spoken words or other audio, or classifying visual information (see “Breakthrough Technologies 2013: Deep Learning”).

Rapid advances have been made in deep learning in recent years thanks to large quantities of classified data becoming available, especially online, and because powerful parallel graphics processors have proved particularly effective at performing the necessary computations. Some of the world’s largest technology companies are keen to apply deep learning in commercially relevant ways (see “Facebook Launches AI Effort to Find Meaning in Your Posts” and “Is Google Cornering the Market in Deep Learning?). Google and Facebook have also hired leading figures in deep learning to apply the technology to their businesses.

However, although the results produced by deep learning systems are often spectacular, the systems responsible are extremely specialized, and they can fail in surprising ways because they don’t comprehend the world in a very meaningful way. If deep learning can be combined with other AI techniques effectively, that could produce more rounded, useful systems.

“You can imagine a lot of different use cases,” says Jerome Pesenti, vice president of core technologies for Watson. “Let’s say you have a banking or insurance product, you can talk over the phone and say, ‘Hey, this is my problem,’ and have something that actually interacts back with you automatically, or gives you to an actual human when the system doesn’t know how to answer. That’s the kind of system we’re putting out there right now.”

Combining disparate strands of AI research could become an important trend in coming years.

“A key challenge for modern AI is putting back together a field that has almost splintered among these methodologies,” says James Hendler, director of the Rensselaer Polytechnic Institute for Data Exploration and Applications in Troy, New York. RPI has access to an early version of Watson donated to the university by IBM, and Hendler teaches courses based on the technology. “The key thing about Watson,” he says, “is that it’s inherently about taking many different solutions to things and integrating them to reach a decision.”

Applying learning from one area, such as vision, to another, such as speech, is known as a multimodal approach. It could make future AI systems far more useful and could yield fundamental insights into the nature of intelligene.

When it comes to commercializing such advances,IBM may have, thanks to Watson, a head start on integrating new techniques in useful ways. Pesenti says that his team is already making progress in this area. “If I talk to you about a dog, it’s very hard to have an understanding of what a dog is without having an experience of that dog, which you get through a multimodality view of that,” he says. “We believe down the line that’s actually a really, really big part of our strategy.” 

Weren't able to make it to EmTech Digital?
We've got you covered.

Watch videos here

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Insider Basic.
  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning magazine and daily delivery of The Download, our newsletter of what’s important in technology and innovation.

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.