Skip to Content

Touch Screens with Pop-up Buttons

Future touch screens may need to supply tactile feedback.
April 28, 2009

Touch-screen technology has become wildly popular, thanks to smart phones designed for nimble fingers. But most touch screens have a major drawback: you need to keep a close eye on the screen as you tap, to make sure that you hit the right virtual buttons. As touch screens become more popular in other contexts, such as in-car navigation and entertainment systems, this lack of sensory feedback could become a dangerous distraction.

Touchy-feely: A new type of touch-screen display also has physical buttons. An air pump can manipulate a latex layer that covers the screen. When the pump is off, the screen is flat.

Now researchers at Carnegie Mellon University have developed buttons that pop out from a touch-screen surface. The design retains the dynamic display capabilities of a normal touch screen but can also produce tactile buttons for certain functions.

Graduate student Chris Harrison and computer-science professor Scott Hudson have built a handful of proof-of-concept displays with the morphing buttons. The screens are covered in semitransparent latex, which sits on top of an acrylic plate with shaped holes and an air chamber connected to a pump. When the pump is off, the screen is flat; when it’s switched on, the latex forms concave or convex features around the cutouts, depending on negative or positive pressure.

To illuminate the screens and give them multitouch capabilities, the researchers use projectors, infrared light, and cameras positioned below the surface. The projectors cast images onto the screens while the cameras sense infrared light scattered by fingers at the surface.

The idea of physically dynamic interfaces isn’t new, and in recent years, researchers have explored using screens made from polymers that can alter their shape when exposed to heat, light, and changes in a magnetic field. However, these materials are still experimental and relatively expensive to make.

Simpler systems, such as those that use a flexible material like latex and a pneumatic pump, have also been explored by researchers in the past. However, these systems haven’t had all the capabilities of the Carnegie Mellon project, Harrison says. He explains that the display is the first to combine moving parts (the pop-up buttons), display dynamic information, and be touch sensitive. Other projects and products usually achieve two of these three criteria, he says.

“Microsoft Surface does graphics, and you can touch it, but it’s totally fixed,” Harrison says. “Buttons on a dashboard have great tactile input, but there’s no display. And it’s not like you can just deform an LCD screen and … make it electrically conductive at the same time.”

Building blocks: A top layer of acrylic has shapes corresponding to different buttons cut out of it. A passage into an air chamber below allows air to flow in and out.

Because the system is pressurized, the pressure information can itself be used as an input, Harrison says. For example, if the screen were used to control an MP3 player, a person could press a button harder to scan through radio stations or songs faster. While many touch-screen displays can also register different levels of pressure, the glass or rigid plastic used doesn’t provide any tactile feedback.

Rob Miller, a professor of electrical engineering and computer science at MIT, says that this type of interface is particularly likely to find its way into car dashboards. “When you’re driving a car, you’re situationally impaired,” he says. “Your eyes need to be on the road, not hunting for the right button and watching whether you pressed it right.”

In a small user study involving the Carnegie Mellon display, testers found the pneumatic buttons as easy to use as static ones while taking a simulated driving test. They also glanced at the pneumatic buttons only as often as they glanced at the physical buttons.

Due to its pneumatic nature, the system is currently fairly large, but Harrison says that he is trying to find ways to shrink it. “You can’t get a pump inside a cell phone,” he says, “but one possibility is to have a balloon and squeeze it using a conventional motor.”

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

The problem with plug-in hybrids? Their drivers.

Plug-in hybrids are often sold as a transition to EVs, but new data from Europe shows we’re still underestimating the emissions they produce.

Google DeepMind’s new generative model makes Super Mario–like games from scratch

Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.

How scientists traced a mysterious covid case back to six toilets

When wastewater surveillance turns into a hunt for a single infected individual, the ethics get tricky.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.