Connectivity

Radio Waves Offer Cheap Gesture Detection on Smartphones

Researchers say it’s possible to identify gestures around a phone by analyzing interference in the wireless signals it transmits.

Touch-screen smartphones dominate the market, but touch isn’t always the most convenient way to interact with them.

A research project at the University of Washington shows a way to add gesture control to phones without requiring sophisticated new sensors. It works by identifying the interference that hand gestures cause in the radio signals that are already transmitted to and from a phone.

SideSwipe, a University of Washington research project, adds gesture detection to phones by measuring how hand movements interfere with the GSM signals that the handsets normally transmit.

Called SideSwipe, the project could make it possible to answer a call with a wave of a hand, even if your device is buried deep in a bag. It might let you scroll through a recipe without putting your dirty hands on the display, or navigate a map without having to obscure any part of it with your fingers.

The key to SideSwipe is looking at how hand movement changes the wireless signal and using that to determine specific gestures. A paper on the project will be presented in October in Hawaii at the annual ACM User Interface Software and Technology Symposium.

The researchers investigated signal interference on phones that use the wireless standard GSM because it’s extremely common around the world (in the U.S., T-Mobile and AT&T use it), though they say the technology could also work with newer wireless standards like LTE.

To detect gestures in the lab, researchers connected a Samsung Nexus S smartphone to an array of four receiving antennas that could measure changes to GSM signals resulting from gestures made in various directions when calls were in progress. Researchers tested the system by asking 10 people to use 14 gestures each. The system could accurately detect those gestures 87 percent of the time at a distance of 25 to 30 centimeters from the handset.

The researchers say this kind of gesture recognition could be added to smartphones using antennas already within the phone or by printing additional antennas on a phone’s circuit board. But to become part of your smartphone, SideSwipe would need to pique the interest of smartphone makers.

The SideSwipe prototype smartphone was used to sense gestures only when the phone was in the process of making a call, because that guaranteed a GSM signal. But Chen Zhao, a UW graduate student and coauthor of the research paper, says an app running in the background on the phone could potentially sniff out and translate incoming gestures at other times, providing it could access the device’s GSM module.

For now, the researchers are refining their external antenna design, and plan to test SideSwipe with activities like walking and running, and explore how it can work with other wireless network technologies. 

Cut off? Read unlimited articles today.

Become an Insider
Already an Insider? Log in.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Connectivity

What it means to be constantly connected with each other and vast sources of information.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look: exclusive early access to important stories, before they’re available to anyone else

    Insider Conversations: listen in on in-depth calls between our editors and today’s thought leaders

  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning magazine and daily delivery of The Download, our newsletter of what’s important in technology and innovation.

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.