I recently reviewed Intel’s prototype “perceptual computing” interface, and while the product vision was compelling, the user experience needed a lot of work. Just because you can plop a depth camera on top of your laptop and wave your hands in front of the screen, does that mean you should? Luckily, an Israeli company called Omek Interactive has applied some actual thought and research toward answering this question. Their “Arc Menu” is the first close-range, consumer-grade gestural UI I’ve seen that takes comfort and basic ergonomics into account. Here’s a demo the company did at CES for LazyTechGuys:
The basic idea behind the Arc Menu is the kind of thing that sounds obvious only in retrospect: human beings tend to move their limbs in arcing motions, not vertical or horizontal lines. This means that gridlike interfaces, like the Windows 8 Start screen, feel subtly cumbersome and tiring in a gestural context. Omek did an enormous amount of user testing and iteration to arrive at this insight, but once they had it, the solution was clear: redesign the gestural menu into an arc that curves from the upper right part of the screen downwards. If you’re typing at your computer and raise your right hand to make a swiping movement, it will probably follow this arcing path through the air.
Consider, though, the other assumptions that Omek employs to make this design work. For one, their depth camera isn’t mounted on top of the computer screen like a webcam; it’s positioned between the screen and the keyboard, so that its “capture volume” hovers just above the keys, but below the user’s eyeline to the screen. As I said in my Intel review, what good are close-range gestures if they obscure your own view of what you’re doing?
Omek’s designers clearly understand this constraint–and what it implies about how close-range gestures might actually be useful. Quick, casual movements in between touching the screen or typing on the keyboard–not precise, complicated, Minority-Report-like “gestural commands”–are what makes sense for perceptual computing, at least for now. Further iterations will reveal even more subtleties about how real live humans want to interact with their technology with gestures. But Omek’s work is a welcome reminder that we have to focus on the humans first, not the technology, to make that kind of progress.
Meta has built a massive new language AI—and it’s giving it away for free
Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3
The gene-edited pig heart given to a dying patient was infected with a pig virus
The first transplant of a genetically-modified pig heart into a human may have ended prematurely because of a well-known—and avoidable—risk.
Saudi Arabia plans to spend $1 billion a year discovering treatments to slow aging
The oil kingdom fears that its population is aging at an accelerated rate and hopes to test drugs to reverse the problem. First up might be the diabetes drug metformin.
Yann LeCun has a bold new vision for the future of AI
One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.