Skip to Content
MIT News magazine

High-Res 3-D Imaging on the Go

Portable device allows precise imaging, easier inspections
October 25, 2011

By combining a clever physical interface with computer-vision algorithms, researchers in MIT’s Department of Brain and Cognitive Sciences have created a simple portable imaging system that can achieve resolutions previously possible only with large and expensive lab equipment. The device could provide manufacturers with a way to inspect products too large to fit under a microscope and could have applications in medicine, forensics, and biometrics.

The heart of the system, dubbed GelSight, is a transparent slab of synthetic rubber, one of whose sides is coated with a paint containing tiny flecks of metal. When pressed against the surface of an object, the paint-coated side of the slab deforms. Cameras mounted on the other side of the slab photograph the results, and computer-vision algorithms analyze the images.

Although GelSight’s design is simple, it addresses a fundamental difficulty in 3-D sensing. Micah Kimo Johnson, a former postdoc in the laboratory of BCS professor Edward Adelson, illustrates the problem with a magnified photograph of an emery board, whose surface, in close-up, looks a lot like marmalade—a seemingly gelatinous combination of reds and oranges.

“The optical property of the material is making it very complicated to see the surface structure,” Johnson says. “The light is interacting with the material. It’s going through it, because the crystals are transparent, but it’s also reflecting off of it.”

When a surface is pressed into the GelSight gel, however, the metallic paint conforms to its shape, making the optical properties of the surface perfectly uniform. “Now the surface structure is more readily visible, but it’s also measurable using some fairly standard computer-­vision techniques,” Johnson explains.

GelSight is able to register physical features less than a micrometer in depth and about two micrometers across. Moreover, because it makes multiple measurements of the rubber’s deformation, with light coming in at several different angles, it can also produce 3-D models of an object. The prototype sensor is about the size of a soda can and can produce micrometer-scale 3-D images in almost no time, compared with minutes or even hours for conventional equipment.

Adelson and Johnson are already in discussion with a major aerospace company and several manufacturers of industrial equipment, all of whom are interested in using GelSight to check the integrity of their products.

Keep Reading

Most Popular

still from Embodied Intelligence video
still from Embodied Intelligence video

These weird virtual creatures evolve their bodies to solve problems

They show how intelligence and body plans are closely linked—and could unlock AI for robots.

pig kidney transplant surgery
pig kidney transplant surgery

Surgeons have successfully tested a pig’s kidney in a human patient

The test, in a brain-dead patient, was very short but represents a milestone in the long quest to use animal organs in human transplants.

conceptual illustration showing various women's faces being scanned
conceptual illustration showing various women's faces being scanned

A horrifying new AI app swaps women into porn videos with a click

Deepfake researchers have long feared the day this would arrive.

thermal image of young woman wearing mask
thermal image of young woman wearing mask

The covid tech that is intimately tied to China’s surveillance state

Heat-sensing cameras and face recognition systems may help fight covid-19—but they also make us complicit in the high-tech oppression of Uyghurs.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.