Gestural computing: ever since a be-gloved Tom Cruise blew everyone’s minds in Minority Report, interface dorks have been trying hard to bring it into the real world. But here’s the problem: who actually wants to spend their whole workday wildly waving their arms around?
And here’s the best part: unlike those room-sized setups you’ve seen on TED talks, Toscanini fits a ramen-noodle-sized budget. The free software runs on Texas Instruments’ “Wireless Watch Development Tool” – an accelerometer-equipped, programmable sports watch that costs just $50.
So what the hell does it do? Basically, it provides a bridge between your movements and digital instruments like synthesizers and keyboards – or anything else you can control from your computer through a MIDI connection. Think of it like Microsoft Kinect, but for making weird performance art instead of playing Xbox.
“Currently it acts like a MIDI keyboard, except you can control the knobs with your movements,” says Lindsey Mysse, who co-created Toscanini during a 24-hour hacking contest. “But it doesn’t have to make music. It can control a mouse. You just put it on your wrist and make something happen.”
Toscanini’s on-screen interface.
Granted, you’ll have to be something of a hacker to truly take advantage of Toscanini’s power – the software is in alpha and uses a visual programming language called Max/MSP. But that’s the whole point, says co-creator Robby Grodin: “Unlike Kinect or Wii, this is intended to be hacked. You can record your movements as musical ‘macros’, or build your own apps.”
Mysse thinks Toscanini will appeal to artsy types who wish to add an element of “true randomness” to their digital creations. “Gestural expression puts your personal imprint on the data,” he says. “It’s random, but it’s also you. 500 people can play three notes on a piano and not sound much different, but with our watch it will always sound very different.”
Mysse and Grodin are considering building a product ecosystem around the watch, including paid apps and musical accessories produced via 3D printing. But their near-term goal is appropriately bohemian: “We want to hook up with a dance company,” says Grodin. “That’s our dream.”
Meta has built a massive new language AI—and it’s giving it away for free
Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3
The gene-edited pig heart given to a dying patient was infected with a pig virus
The first transplant of a genetically-modified pig heart into a human may have ended prematurely because of a well-known—and avoidable—risk.
Saudi Arabia plans to spend $1 billion a year discovering treatments to slow aging
The oil kingdom fears that its population is aging at an accelerated rate and hopes to test drugs to reverse the problem. First up might be the diabetes drug metformin.
Yann LeCun has a bold new vision for the future of AI
One of the godfathers of deep learning pulls together old ideas to sketch out a fresh path for AI, but raises as many questions as he answers.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.