Text and Voice Translation in Real Time
The translation technology in Google’s smart-phone apps is the closest thing to a universal translator today. Google Goggles, for example, extracts text from an image snapped by a user and converts it with the help of a technique called statistical machine translation, relying on a cloud server for the necessary processing power. So far it can recognize text in just five European languages and translate the text into any of those languages plus another 12. But Google is aggressively expanding into new languages, particularly those used in markets where mobile devices are often the only computers people own.

Augmented reality could integrate such translation services into everyday views of a foreign city. With Word Lens, from Quest Visual of San Francisco (see “A New Reality”), a user can aim the phone at a sign or document and immediately consult the display to see translated text replacing the original. Because the translation takes place inside the device and doesn’t rely on network connections, it’s handy when traveling. So far Word Lens can translate only between Spanish and English. More languages are in the works.
Google recently launched a cloud-based app that can take in spoken phrases in any of 15 languages and synthesize translated speech in any of 23. The next frontier: translating live speech. In “conversation mode” you speak into your Android device; Google Translate will read a translation. At a January conference, Google chairman Eric Schmidt said the system “seems to work like magic.” Yet it works only between speakers of English and Spanish, and accents and noise degrade accuracy. Adding languages and improving accuracy is an active area of research.
Deep Dive
Uncategorized
Our best illustrations of 2022
Our artists’ thought-provoking, playful creations bring our stories to life, often saying more with an image than words ever could.
How CRISPR is making farmed animals bigger, stronger, and healthier
These gene-edited fish, pigs, and other animals could soon be on the menu.
The Download: the Saudi sci-fi megacity, and sleeping babies’ brains
10 Breakthrough Technologies 2023
Stay connected
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.