Technology Review - Published By MIT
Advertisement

Digital Sound Separator

Continued from page 1

By John Borland

Wednesday, April 16, 2008

smaller text tool iconmedium text tool iconlarger text tool icon
Recorded chords: Direct Note Access, as implemented in Celemony's Melodyne 2 plug-in.
Credit: Celemony Software

Neubäcker says that he spent time looking at spectral analyses, seeking "structures in the signal" that could identify a chord's fundamental notes and link each of them with its own overtones. Because sound waves blend and interfere with each other, this is a hideously complicated task. But as Celemony's demonstrations show, it's one that Neubäcker has apparently accomplished.

Direct Note Access represents the notes of a chord graphically: they look like blobs of ink on a timeline. The blobs can be moved up or down to change their pitch, or back and forth to change their timing. An existing chord can be changed from major to minor; notes played at the same time can be strung out to occur in sequence, in what's called an arpeggio.

Neubäcker is quick to admit that the software isn't perfect. It works well with clean, unprocessed instruments, such as acoustic guitar or piano. It will work on a heavily distorted electric guitar but may, for example, read some high-pitched harmonics as separate notes.

Nor is the software quite the equivalent of a human ear, able to distinguish actual instruments from one another. Like an audio idiot savant, it can tease individual notes out of a complicated six-note chord. But feed it a recording in which two instruments are playing the same note--say, the trumpet and piano on an old Ellington record--and it will treat them as a single entity, rather than distinguishing their separate voices.

Like Celemony's Melodyne, Direct Note Access is likely to find its way quickly into studios' tool kits.

"I've seen the video, and I was blown away," says J. Chris Griffin, a producer at the Cutting Room studio in New York, who has worked with such artists as Madonna and Kelly Clarkson. "I can't wait to try it. I'm definitely planning on getting it."

The tool may have cultural costs as well as benefits, however.

Already, vocal tracks on virtually all radio-ready albums are cleaned up; they're perfectly in tune and in time but may lack the unique character of a vocal performance by, say, Billie Holiday or Bob Dylan. Direct Note Access's power could accelerate that homogenization of pop music, says Berklee's Bierylo.

Direct Note Access will be released commercially this fall as a plug-in compatible with most major audio-recording software packages. A stand-alone version will be released later.

But Neubäcker is already thinking about ways to expand the tool's capabilities, perhaps even allowing it to recognize and distinguish the sounds of individual instruments.

"My approach is not to focus on making a product but to understand what sound is all about," he says.

Comments

Log In

Forgot your password?     Register »
Advertisement

Videos

Stealthy Nanoparticles Attack Cancer Cells
Technology Review November/December 2009

Current Issue

Natural Gas Changes the Energy Map
The United States has vast supplies of this cleaner fossil fuel. But how should we use it?
•  Subscribe
Save 36%
•  Table of Contents
•  MIT News
Featured Content
Sponsored by:
White Papers

Twelve ways to reduce costs with SQL Server 2008
Find out how to reduce costs and get more efficient

Download

Total Economic Impact of SQL Server 2008 Upgrade
Forrester reports on increasing productivity and management capabilities

Download 

Achieving Cost and Resource Savings with UC
How Office Communications Server R2 and Exchange Server can make your business smarter and more efficient

Download 

The Compelling Case for Conferencing
Read how you can improve workload support and find IT efficiencies

Download

How Windows Server 2008 R2 Helps Optimize IT and Save you Money
Read how you can improve workload support and find IT efficiencies

Download

Windows Server 2008 R2 Hyper-V Live Migration
See how Windows Server 2008 R2 and Hyper-V enable virtualization and Live Migration

Download
Advertisement
Subscribe to Technology Review's daily e-mail update. Enter your e-mail address

TECHNOLOGY RESOURCES
Advertisement
MIT Massachusetts Institute of Technology © 2009 Technology Review. All Rights Reserved.