By combining a clever physical interface with computer-vision algorithms, researchers in MIT’s Department of Brain and Cognitive Sciences have created a simple portable imaging system that can achieve resolutions previously possible only with large and expensive lab equipment. The device could provide manufacturers with a way to inspect products too large to fit under a microscope and could have applications in medicine, forensics, and biometrics.
The heart of the system, dubbed GelSight, is a transparent slab of synthetic rubber, one of whose sides is coated with a paint containing tiny flecks of metal. When pressed against the surface of an object, the paint-coated side of the slab deforms. Cameras mounted on the other side of the slab photograph the results, and computer-vision algorithms analyze the images.
Although GelSight’s design is simple, it addresses a fundamental difficulty in 3-D sensing. Micah Kimo Johnson, a former postdoc in the laboratory of BCS professor Edward Adelson, illustrates the problem with a magnified photograph of an emery board, whose surface, in close-up, looks a lot like marmalade—a seemingly gelatinous combination of reds and oranges.
“The optical property of the material is making it very complicated to see the surface structure,” Johnson says. “The light is interacting with the material. It’s going through it, because the crystals are transparent, but it’s also reflecting off of it.”
When a surface is pressed into the GelSight gel, however, the metallic paint conforms to its shape, making the optical properties of the surface perfectly uniform. “Now the surface structure is more readily visible, but it’s also measurable using some fairly standard computer-vision techniques,” Johnson explains.
GelSight is able to register physical features less than a micrometer in depth and about two micrometers across. Moreover, because it makes multiple measurements of the rubber’s deformation, with light coming in at several different angles, it can also produce 3-D models of an object. The prototype sensor is about the size of a soda can and can produce micrometer-scale 3-D images in almost no time, compared with minutes or even hours for conventional equipment.
Adelson and Johnson are already in discussion with a major aerospace company and several manufacturers of industrial equipment, all of whom are interested in using GelSight to check the integrity of their products.
A Roomba recorded a woman on the toilet. How did screenshots end up on Facebook?
Robot vacuum companies say your images are safe, but a sprawling global supply chain for data from our devices creates risk.
A startup says it’s begun releasing particles into the atmosphere, in an effort to tweak the climate
Make Sunsets is already attempting to earn revenue for geoengineering, a move likely to provoke widespread criticism.
10 Breakthrough Technologies 2023
These exclusive satellite images show that Saudi Arabia’s sci-fi megacity is well underway
Weirdly, any recent work on The Line doesn’t show up on Google Maps. But we got the images anyway.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.