Skip to Content

In the Future, Magnets May Track Your Fingers in Virtual Reality

Oculus and university researchers are working on a project that relies on electromagnets to keep an eye on all your fingers in virtual space.
December 22, 2015

A research project may hint at how Facebook’s Oculus device will let you explore virtual reality someday: by using a bunch of electromagnets and sensors to track the motions of your individual fingers in three dimensions.

Each finger gets its own electromagnet so Finexus can track its position in 3-D.

Called Finexus, the project employs four magnetic sensors to track fingernail-sized electromagnets placed on each of the user’s fingertips; it has been found to be accurate to within 1.3 millimeters. The project was created by a group of researchers from the University of Washington and Oculus Research.

Keyu Chen, a graduate student at the University of Washington’s ubiquitous-computing lab, started the project while he was an intern at Oculus Research in Redmond, Washington, last summer. He imagines Finexus being used for games as well as tasks that require a variety of delicate finger motions, like playing a virtual piano, painting, or writing in the air. (A video of Finexus in action shows an example of the latter.)

“Sometimes you want something where you can actually use your fingers for dedicated motion,” Chen says.

Oculus had no comment on the project, which is slated to be presented in a research paper at the ACM CHI 2016 conference on computer-human interaction in San Jose, California, in May.

The interactions Chen imagines could be more detailed than what many of us will experience early on with virtual reality. Oculus’s first consumer headset, Rift, will rely on a plastic controller for input, which may not feel that immersive. (Rift, which is due to be released this winter, will come with a wireless Xbox controller; Oculus will also sell a pair of controllers called Oculus Touch that work with Oculus’s optical-tracking system to give you finer controls, but it’s shipping these a bit later on.)

Finexus tracks individual fingers in three dimensions using electromagnets and magnetic sensors.

Unlike tracking systems that rely on cameras to figure out where your head or specific body parts are located, Finexus doesn’t need a direct line of sight between the electromagnet and the sensor. That means, for instance, that if you bend over while playing a virtual-reality game, obscuring the electromagnets on your hands from the sensors, Finexus should still be able to figure out your finger movements.

Chen envisions Finexus eventually being built into a glove and wristband or smartwatch; the glove would house the electromagnets, while the wrist-worn device would hold the sensors. For now, the maximum distance between the sensors and electromagnets is just 12 centimeters, but Chen believes it could be as great as 25 centimeters. Regardless, such a short distance would limit the system to being housed on the body.

Finexus works kind of like a GPS system: the distances between an electromagnet and the four magnetic sensors is calculated, then the intersection of each of those four distances is determined and used to figure out the electromagnet’s position in space. Each electromagnet operates on a different frequency, which Chen says makes it easier to identify them individually.

Chen says electromagnets could be added to the system without requiring more sensors, so you could track all your fingers or render your hands more precisely by placing more than one electromagnet on each finger.

His next step, he adds, will be to refine the Finexus hardware and miniaturize it. After that, he’s not sure what will happen.

“I do not know if [Oculus is] going to put this in a future product, but that is one possibility,” he says.

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

OpenAI teases an amazing new generative video model called Sora

The firm is sharing Sora with a small group of safety testers but the rest of us will have to wait to learn more.

Google’s Gemini is now in everything. Here’s how you can try it out.

Gmail, Docs, and more will now come with Gemini baked in. But Europeans will have to wait before they can download the app.

This baby with a head camera helped teach an AI how kids learn language

A neural network trained on the experiences of a single young child managed to learn one of the core components of language: how to match words to the objects they represent.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.