Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Connectivity

Pause Your Tunes by Taking Out Your Earbuds

Researchers look at how the speakers and microphones already built into gadgets can be used for wireless sensing.

Speakers and microphones can be used for a lot more than just playing and recording sounds.

Researchers at Carnegie Mellon University are exploring what else they can do with a project called SweepSense. It takes advantage of the speakers and microphones already common in gadgets like smartphones, laptops, and earbuds, sending out ultrasonic frequencies and measuring the strength of the reflected sound, which is then used to trigger actions such as halting tunes when you remove your earbuds from your ears.

Gierad Laput, a graduate student at Carnegie Mellon and the leader of the project, says the idea is to use speaker-and-microphone pairs to add functionality beyond what they’re designed to do, without having to add any more hardware.

“The infrastructure is already there, so you’re just riding on top of it,” he says.

A paper on the work will be presented at a conference on intelligent user interfaces in Sonoma, California, in March.

The project is the latest signal that ultrasound technology could become increasingly useful in a range of gadgets, and also perhaps in settings like cars or even subway stations. There are a number of companies working on bringing ultrasound technology to electronics already, such as Elliptic Labs, which makes software that employs ultrasound for gesture recognition and proximity sensing on phones, and Chirp Microsystems, which uses ultrasound for gesture recognition, though the technology has not yet become widespread.

The researchers came up with a couple of ways to use the SweepSense approach with a smartphone and a laptop. On the phone, with a pair of earbuds plugged in and each bud emitting different ultrasonic frequencies that were picked up by its built-in microphone, they were able to analyze the sounds to determine if a user was wearing the left or right earbud, both earbuds, or neither of them. Software could then use this information to, say, pause music if both earbuds are taken out of your ears—an application researchers actually tried out. A user might also be able to answer an incoming call by removing just one of the earbuds.

On a laptop, the researchers used its built-in speakers and microphone with SweepSense software to figure out when the computer display’s angle was changed. Ultrasound frequencies should reflect differently according to the screen’s angle, Laput says; spotting this change would make it possible to do things like pull up a utility dashboard when someone tilts the display forward, for example.

Researchers have also started testing out SweepSense with a car, Laput says, since a number of vehicles have speakers and microphones, too. The idea there is to see if ultrasound sensing can determine whether a door is open (and if it’s open, how far open) and whether or not there are passengers in the car, he says.

One problem with using ultrasound frequencies, as the researchers note, is that low-frequency ultrasound may be audible to some people (such as kids and the elderly) and to animals, which could annoy them. Laput says using a different range of ultrasound that isn’t audible is possible, but not all speakers that are already embedded in devices can emit such sounds; he hopes that future hardware improvements will make this more common.

Get stories like this before anyone else with First Look.

Subscribe today
Already a Premium subscriber? Log in.
More from Connectivity

What it means to be constantly connected with each other and vast sources of information.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

    Bimonthly digital/PDF edition

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special interest publications

    Discount to MIT Technology Review events

    Special discounts to select partner offerings

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning print magazine, unlimited online access plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

  • Insider Online Only {! insider.prices.online !}*

    {! insider.display.menuOptionsLabel !}

    Unlimited online access including articles and video, plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.