Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

David Zax

A View from David Zax

Conjuring Music, Sans Instruments

At the TEDGlobal Conference, Imogen Heap debuts futuristic gloves that let her compose, arrange, and perform music on the fly.

  • July 31, 2011

I’ve never conducted an orchestra before, but I imagine it must bring with it an enormous sense of power. With the mere waving of your arms, a symphony pours forth. The tempo, the rhythm, the dynamics of the music are all conjured with the motions of your body – and you’re not even holding an instrument.

Imogen Heap, the Grammy Award-winning musician, must be feeling something similar, after debuting a pair of musical gloves at the recent TEDGlobal conference in Edinburgh. With a team of sound engineers at Fifth Dimension Technologies and x-IO, Heap contributed to the development of technology-laden gloves that allow her to compose, arrange, and perform music.

It all sounds something like that elusive (and over-referenced) “Minority Report interface,” only applied to music. Sadly, the TED video doesn’t appear to be live yet, but Mashable’s description gives a taste of how it works: “Those movements include, for example, the ability to record a loop by opening her hand, filtering sound by bringing her hands together and panning by pointing in the desired direction. Volume can also be manipulated with some fitting gestures — a ‘shh’ movement initiates quiet mode and a horn sign prompts ‘rock out mode.’” Heap has said that she’d like to start incorporating the gloves into her conferences, and someday might like to build an entire hour-long concert “walking on stage with nothing but the gloves.”

Heap got the idea for the gloves after seeing a similar pair developed by an MIT researcher named Elly Jessop (a member of the “Opera of the Future” research group there). As Tom Mitchell, a University of West England in Bristol researcher involved in the project, tells me in an e-mail, “Imogen subsequently started to dream about a system that would enable her to perform an entire show live without having to disengage from the audience to perform unknown interactions with electronic equipment.” (Mitchell’s collaboration with Heap is slightly longstanding.)

That notion–that the gestures that control the music should themselves become part of the performance–was at the heart of the project. Continues Mitchell: “One of the main challenges and successes of the work is the emphasis on performance which preceded any developmental work. Imogen has been there every step of the way to discuss the design of the gestures and their mapping onto audio processes.”

Mitchell cautions that gloves like Heap’s probably won’t become widespread anytime too soon. “[T]he main factor here is the availability, convenience and cost of the required technology,” he says. “It’s not convenient to have to set up external tracking equipment like cameras whenever you want to do something.” The gloves themselves are a bundle of a dozen different technologies – there’s various sensors, a gyroscope, wireless microphones, an accelerometer, a magnetometer. It would take considerable R&D to commercialize a package like that.

There has been more research and development in the realm of gestural music than you might imagine, though – we’ve moved well beyond that gestural sci-fi music staple, the theremin. Michel Waisvisz, who debuted his musical interface, dubbed “the Hands,” back in the ’80s, was a pioneer here. Here’s a video of him performing with them at the New Interfaces for Musical Expression conference, which for 11 years has helped spur research of the sort that led to Imogen Heap’s gloves.

Someday in the future, then, will a handmade cello seem as obsolete a curio as the paperbound book?

Tech Obsessive?
Become an Insider to get the story behind the story — and before anyone else.

Subscribe today

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

    Bimonthly digital/PDF edition

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special interest publications

    Discount to MIT Technology Review events

    Special discounts to select partner offerings

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning print magazine, unlimited online access plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Bimonthly print magazine (6 issues per year)

  • Insider Online Only {! insider.prices.online !}*

    {! insider.display.menuOptionsLabel !}

    Unlimited online access including articles and video, plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    What's Included

    Unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.