A new company called Cognitive Code has built software that it believes will let everyday gadgets talk with humans. At the Techcrunch40 conference in San Francisco on Monday, the startup unveiled a developer’s studio with a set of algorithms that convert strings of words into concepts and formulate a wordy response. The developer’s studio could let businesses, such as cell-phone manufacturers and toy makers, use the technology to add conversational abilities to a product.
Instead of composing an e-mail on a PDA, says Leslie Spring, the company’s chief technology officer, imagine instructing a handheld to “send an e-mail to Tom and tell him ‘I’ll be there in 10 minutes.’” Spring says that such a feature could be possible with the algorithms–based on 15 patents–that Cognitive Code has developed.
The problem that the company is tackling is called natural-language processing, and it’s been the subject of intense research at world-renowned research labs for decades. Some computer programs are already able to parse basic information from inputs that don’t match exact commands. Well-known examples are chatbots such as Alice and Jabberwacky, programs that simulate a conversation via text input.
Spring claims that Cognitive Code’s product, SILVIA (which stands for symbolically isolated, linguistically variable intelligence algorithm), is more advanced than chatbots for a couple of reasons. First, SILVIA remembers and understands the context of a conversation. For instance, if you’re talking about the movie Star Wars and ask what the plot is, the system refers to earlier pieces of the conversation to retrieve an explanation of the movie’s plot instead of giving a general definition of plot, or the plot of some other movie or book that was discussed before Star Wars. The other key aspect of SILVIA that makes it different, says Spring, is its ability to comprehend concepts that are worded in a variety of ways and produce uniquely worded responses. “You can speak to SILVIA using whatever phrase you want,” says Spring, “and it extracts meaning. And on the reverse end, we have algorithms that can put [responses] back into human language. Sometimes we’re surprised at the way SILVIA creates these things.”
Click here to see an early version of SILVIA interact with Cognitive Code chief technology officer Leslie Spring.
The system works like this: during a conversation, words are turned into conceptual data, Spring explains. SILVIA takes these concepts and mixes them with other conceptual data that’s stored in short-term memory (information from the current discussion) or long-term memory (information that has been established through prior training sessions). Then SILVIA transforms the resulting concepts back into human language. Sometimes the software might trigger programs to run on a computer or perform another task required to interact with the outside world. For example, it could save a file, query a search engine, or send an e-mail.
This high-level explainer could describe a number of conversational artificial-intelligence systems, but Spring claims that the major advance is that SILVIA’s core algorithms can be implemented into a variety of applications and devices. At the Techcrunch40 conference demo, for instance, Spring showed a couple of the tricks that SILVIA can do when installed on a computer. For example, using SILVIA, Spring was able to open and close Word documents simply by making the request verbally in a conversational manner. (There are some programs that let people perform operations on computers with spoken words, but they require specific verbal commands.)
Spring says that SILVIA could work with Windows, Mac, or Linux operating systems. Also, Cognitive Code has shown that the algorithms can be compressed enough to run on a smart phone. Initially, however, Spring says that Cognitive Code is targeting the toy market, and he hopes to see products, akin to Teddy Ruxpin, with “SILVIA Inside” within a couple of years.
It’s still unclear, however, exactly how easy it will be to plug SILVIA into any system. Vasant Honavar, a professor of computer science at Iowa State University, says he expects that it would take a fair amount of work by engineers to put SILVIA into each platform. Honavar adds that in some of the applications that Cognitive Code is targeting, the responses will need to be much more accurate than the technology behind chatbots. “If you want it to delete a file and it deletes the wrong one, that wouldn’t be good,” he says.
And while Honavar is pleased to see Cognitive Code exploring business models for natural-language processing technology, he is hesitant to get too excited. “What I worry about [with] all this AI in general is that sometimes it’s oversold, and it’s hard to deliver on what’s promised.”
This is part of the reason that Cognitive Code is initially targeting the toy market, says Spring. There’s a lot of flexibility in a teddy bear’s conversation with a child, and the outcome isn’t necessarily as critical as it could be on a computer used for business.
Meta has built a massive new language AI—and it’s giving it away for free
Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3
The gene-edited pig heart given to a dying patient was infected with a pig virus
The first transplant of a genetically-modified pig heart into a human may have ended prematurely because of a well-known—and avoidable—risk.
Saudi Arabia plans to spend $1 billion a year discovering treatments to slow aging
The oil kingdom fears that its population is aging at an accelerated rate and hopes to test drugs to reverse the problem. First up might be the diabetes drug metformin.
Yann LeCun has a bold new vision for the future of AI
One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.