Omek’s Gestural Interface Makes Perceptual Computing Human-Friendly
I recently reviewed Intel’s prototype “perceptual computing” interface, and while the product vision was compelling, the user experience needed a lot of work. Just because you can plop a depth camera on top of your laptop and wave your hands in front of the screen, does that mean you should? Luckily, an Israeli company called Omek Interactive has applied some actual thought and research toward answering this question. Their “Arc Menu” is the first close-range, consumer-grade gestural UI I’ve seen that takes comfort and basic ergonomics into account. Here’s a demo the company did at CES for LazyTechGuys:
The basic idea behind the Arc Menu is the kind of thing that sounds obvious only in retrospect: human beings tend to move their limbs in arcing motions, not vertical or horizontal lines. This means that gridlike interfaces, like the Windows 8 Start screen, feel subtly cumbersome and tiring in a gestural context. Omek did an enormous amount of user testing and iteration to arrive at this insight, but once they had it, the solution was clear: redesign the gestural menu into an arc that curves from the upper right part of the screen downwards. If you’re typing at your computer and raise your right hand to make a swiping movement, it will probably follow this arcing path through the air.
Consider, though, the other assumptions that Omek employs to make this design work. For one, their depth camera isn’t mounted on top of the computer screen like a webcam; it’s positioned between the screen and the keyboard, so that its “capture volume” hovers just above the keys, but below the user’s eyeline to the screen. As I said in my Intel review, what good are close-range gestures if they obscure your own view of what you’re doing?
Omek’s designers clearly understand this constraint–and what it implies about how close-range gestures might actually be useful. Quick, casual movements in between touching the screen or typing on the keyboard–not precise, complicated, Minority-Report-like “gestural commands”–are what makes sense for perceptual computing, at least for now. Further iterations will reveal even more subtleties about how real live humans want to interact with their technology with gestures. But Omek’s work is a welcome reminder that we have to focus on the humans first, not the technology, to make that kind of progress.
The inside story of how ChatGPT was built from the people who made it
Exclusive conversations that take us behind the scenes of a cultural phenomenon.
How Rust went from a side project to the world’s most-loved programming language
For decades, coders wrote critical systems in C and C++. Now they turn to Rust.
ChatGPT is about to revolutionize the economy. We need to decide what that looks like.
New large language models will transform many jobs. Whether they will lead to widespread prosperity or not is up to us.
Design thinking was supposed to fix the world. Where did it go wrong?
An approach that promised to democratize design may have done the opposite.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.