Rather than playing games like Angry Birds by swiping your finger across a touch screen, you may someday be able to do so by swiping your finger across your arm.
Researchers at Carnegie Mellon University are making this possible through a project called SkinTrack. You’d wear a ring on your index finger that emits an electrical signal that can be picked up by an electrode-laden smart watch on your other arm. A paper on it will be presented next week at the Association for Computing Machinery’s computer-human interaction conference in San Jose, California.
Wearable gadgets like smart watches can be hard to interact with because they tend to have tiny displays. So the researchers figured that using your skin—specifically your wrist and hand—as a touch pad could make it easier to do things like navigate maps, make calls, or play games.
Gierad Laput, a graduate student at Carnegie Mellon University and one of the researchers behind the project, says SkinTrack works similarly to how cell towers triangulate signals to figure out your phone’s location. The researchers got SkinTrack to determine when the finger was on the skin 99 percent of the time. And by arranging the electrodes in the smart watch in a certain way, they could determine in real time where the finger was, tracking its movements on the arm and hand.
To try out SkinTrack, the researchers made several demos, including one of an Angry Birds game that could be played on their smart watch. You swipe your finger up your arm to pull the bird back in a slingshot on the watch’s display. “And when you release, the app can know the finger is off the skin, so that’s like releasing the slingshot,” he says.
As a video of the project shows, it can also be used for all kinds of gestures—like swiping left, right, up, or down. It could also be used for making the skin a virtual number pad or other kind of button pad, Laput says, or opening an app by tapping a specific spot or gesturing a letter on your arm (writing an “M” with your finger might prompt music to start playing, for instance).
SkinTrack needs work if it’s going to make it onto your body at some point, though: the ring would likely have to be much sleeker, and boast decent battery life. Laput thinks it would take a few years to make it accurate enough for anyone to use.
What to know about this autumn’s covid vaccines
New variants will pose a challenge, but early signs suggest the shots will still boost antibody responses.
DeepMind’s cofounder: Generative AI is just a phase. What’s next is interactive AI.
“This is a profound moment in the history of technology,” says Mustafa Suleyman.
Human-plus-AI solutions mitigate security threats
With the right human oversight, emerging technologies like artificial intelligence can help keep business and customer data secure
Next slide, please: A brief history of the corporate presentation
From million-dollar slide shows to Steve Jobs’s introduction of the iPhone, a bit of show business never hurt plain old business.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.