Halo effect: This MIDI controller is surrounded by virtual controls. Four of the virtual buttons control discrete tasks, including playing or pausing a track. The physical knobs provide finer control of the same function than the four virtual sliders.
Microsoft Research

Computing

Mixing Real and Virtual Controls

A Microsoft project lets a touch screen control other hardware.

  • Thursday, April 9, 2009
  • By Kate Greene

Large touch-screen tables have emerged as a useful way for several people to collaborate on projects like video editing or graphic design, but often these tasks require fine controls that can be difficult to simulate on a touch surface with limited resolution. When a person needs precision, it may be best to use a physical controller instead, says Dan Morris, a researcher at Microsoft.

Morris and his colleagues have developed software for touch-screen surfaces that allows physical controls to be added to them. In addition, the software lets people define the functions that each knob, button, and slider on a controller will perform.

The researchers' system, called Ensemble, was presented on Monday at the Computer-Human Interaction (CHI 2009) Conference in Boston. It consists of a touch table, made by former Microsoft intern Bjoern Hartmann, which is six feet long and four feet wide, and several portable sound-editing controllers that connect to the computer that controls the surface. The table is similar to Microsoft's Surface, but larger. As with Surface, cameras underneath the tabletop are used to sense when a user touches the surface or when an object is placed on top of it.

Advertisement

The idea of incorporating traditional input devices like mouses or keyboards with a touch display is not new, but the Microsoft researchers show with Ensemble that it's possible to make hardware do more than a single specified task.

Cameras within the Ensemble table detect a special tag on the bottom of each audio control box to recognize each box and determine its position on the surface. The software then produces an "aura" around each device, including touch-surface controls like "play," "pause," and "stop," and virtual sliders that correspond to physical knobs on the box.

Video

A person can then edit a music track, for example, using both the physical device and the touch-surface controls. The virtual sliders can be used to zoom in on the audio waveform of a track, or to go to a different location on the waveform by panning. The physical knobs on the box perform the same function but offer much finer control. The system also allows a person to change the function of the knobs to, say, control the volume of a trumpet track instead.

Print

Related Articles

A Kitchen Countertop with a Brain

A depth-sensing camera and palm-top projector turn an ordinary work surface into an interactive one.

Finding Pages from Browser History

A new tool aims to make a Web browser's history more useful.

What's Next for Computer Interfaces?

Touch tricks for small and large displays could be the next big thing.

Close Comments

To comment, please sign in or register

Forgot my password

Guest (historian70)

  • 1035 Days Ago
  • 04/09/2009

Another Microsoft puff

This isn't a news article, it's a re-hashed Microsoft press release.

"[Microsoft] ... developed software for touch-screen surfaces that allows physical controls to be added to them. In addition, the software lets people define the functions that each knob, button, and slider on a controller will perform."
This isn't new. The control system for the SPS, developed at CERN in the mid-1970s, did all that. Not only did the software let you define "the functions that each knob, button and slider on a controller will perform", but in addition it set the tactile feedback on these controls, making a knob stiffer to turn if it controlled a large current than if it controlled a small current (for example).
Presumably when Microsoft gets round to something like that in a year or two, we'll see another article in Technology Review about Microsoft's ground-breaking new research.

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Sponsored Content

Technologies from National Instruments

Taking a Measurement
Learn how to use your PC to take measurements

> Click here for more National Instruments Videos <
Whitepaper

BUILD VERSUS BUY
Understanding the Total Cost of Embedded Design

National Instruments has gathered customer information and data regarding some of the cost differences between building a custom solution versus using NI off-the-shelf tools. Using this data, we built the Graphical System Design ‘Build vs. Buy’ Calculator. The calculator can help show the financial differences between building a custom solution versus buying an off-the-shelf system. This paper discusses the benefits and drawbacks of both a traditional custom design approach and off-the-shelf embedded tools.

View full PDF > Listen to story >
Find us on Youtube

Videos

A Robot Recruit that Can Do It All

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Goldwind Science and Technology

BIND Biosciences

Synthetic Genomics

Complete Genomics

More

Advertisement

Facebook

Advertisement