Technology Review - Published By MIT
Advertisement
[1] 2 Next »

Tuesday, May 08, 2007

Audio Menus for iPods

Researchers are testing ways to let people listen to gadget menu options instead of looking at them.

By Kate Greene

smaller text tool iconmedium text tool iconlarger text tool icon
Hear this: Above are two potential menu displays for an auditory menu on a gadget, such as Apple’s iPod, that uses a circular track pad. When a person’s finger is in a particular position on the track pad, a recording of a human voice states the menu item. An item is selected when a person removes his or her finger.
Credit: University of Toronto

Clicking through the menu on your iPod demands a significant amount of visual attention, which can be a hassle (while jogging) and even dangerous (while driving). But engineers at the University of Toronto and Microsoft Research are working on software that could make it possible to navigate the menus of gadgets that use circular touch pads, like the iPod, without looking at them--only audio cues would be used.

The researchers have designed an auditory menu technique--called earPod--that provides audio feedback when a person drags his or her finger around the touch pad. Although it's not ready to replace the expansive menus on real iPods, the results are encouraging, says Patrick Baudisch, a research scientist at Microsoft Research, in Seattle, who worked on the project. Within 30 minutes of beginning to use the technology, people can navigate two levels of earPod menus faster than traditional visual menus, and just as accurately.

"Requiring constant visual attention while using a PC is reasonable," says Baudisch, "but if you're using an iPod on the road, [constant visual attention] is unreasonable." In addition to giving people back their eyes, he says, audio menus could help gadgets save battery life by not wasting energy on a screen, and they could add functions to the screen-free devices such as the iPod shuffle.

The idea of using audio menus isn't new. Auditory interfaces can, after all, be found in touch-tone phone menus and in various assisted technologies for seeing-impaired users. But historically, handheld consumer gadgets haven't widely used audio menus. There are a few reasons for this, says Bruce Walker, professor in the school of psychology and college of computing at Georgia Institute of Technology. One reason, he says, is that audio hardware and software have been resource intensive, requiring significant amounts of computation and energy. In addition, audio software has been difficult to program.

But computing power is becoming cheaper, and there is an increasing need to find different ways to interact with handheld devices, says Walker. Within the past 10 years, he says, the ubiquity of mobile devices with small displays "has made us all visually impaired." Currently there are only a handful of researchers who are systematically looking at ways to make better audio interfaces for various devices, but Walker expects the ranks to grow in the coming years.

This first earPod prototype has a two-level menu hierarchy with 8 items per category, for a total of 64 items. To test how well people use the system, the researchers assigned to the first menu level a random assortment of categories: "clothing," "fish," "instrument," "color," and four others. The next level contained eight examples of these items. The iPod analogy would be found in the opening menu, which includes "music," "extras," "settings," and then lower menus that include "playlists," "artists," and "albums," for instance. The earPod approach could be extended to read off a limited number of names of artists and songs as well.

[1] 2 Next »

Comments

  • What a waste
    jeandesnoyers on 05/09/2007 at 7:24 AM
    Posts:
    1
    Apple is all about simplicity.

    Who on Earth would want to start memorising which sound does what ?

    I think some ppl just don't get it.
    Rate this comment: 12345
    • Re: What a waste
      FOOD HERO on 05/09/2007 at 12:05 PM
      Posts:
      1
      What a waste your comment is. Adding aural cues does make things simpler. Evolution has provided us with the tools - our senses, in order to make sense of the world, they are millions of years in the making.  We experience the world multi-sensorially, and so letting just one sense (sight) dominate our sensorial panorama is  just plain, well simple. Here is an example: when riding your bike down the street, you use more than just your visual sense to navigate, sound plays a crucial role in this, whether you are aware of it or not.

      Oh, and it has nothing to do with memorizing, quite the opposite, this has more related to a passive dynamic whereby you don't have to memorize, navigating becomes intuitive. It's not that people don't get it, simply you don't get it, and don't make the mistake of speaking for others when it is you who "don't get it"

      TREACH
      Rate this comment: 12345
  • Rockbox already has speaking Menus on Ipods
    Domonoky on 05/09/2007 at 10:32 AM
    Posts:
    1
    Hey,

    Those researchers should take a look at Rockbox, a free open source firmware replacement for Digital Audio Players like Ipods, (and other brands). www.rockbox.org

    This Firmware has taking Menus so its easy to navigate blindly, and you dont have to remember position of the entrys, it reads it out.
    It has also many other benefits, like support for many different file formats and many more.

    Or at least those Researchers should have used this Firmware or ipodlinux, and implement this UI on a real device.

    Rate this comment: 12345
  • Can't wait for this to be on an iPod
    GadgetMan on 07/18/2007 at 2:24 PM
    Posts:
    1
    I can let everyone know that I've tried this and it's a really neat, yet simple concept.  I listen to my iPod every day going to school and during the winter in Toronto, if I want to change the song, I know the structure of the iPod's circular wheel so I know how to move to the next song or to pause and play.  However, if I want to choose a different song, I have to take out the iPod and navigate the visual menu. 

    I think this would be a beneficial interface for all people who listen to the iPod or some time of audio device that is on the go, where your attention is not visual but audial. 
    Rate this comment: 12345
Advertisement

Current Issue

Technology Review September/October 2008
How Obama Really Did It
Social technology helped bring him to the brink of the presidency.
•  Subscribe
Save 41%
•  Table of Contents
•  MIT News

Magazine Services

Career Resources

MIT Technology Insider

Stories and breaking news from inside MIT about the latest research, innovations, and startups--in a convenient monthly e-newsletter. Subscribe today

Follow us on Twitter

Twitter

Get Technology Review updates via the web, cellphone, or Instant Messager – Follow techreview on Twitter!

Advertisement

More Technology News from Forbes

Advertisement
Advertisement
TECHNOLOGY RESOURCES
Advertisement
MIT Massachusetts Institute of Technology