By combining a clever physical interface with computer-vision algorithms, researchers in MIT’s Department of Brain and Cognitive Sciences have created a simple portable imaging system that can achieve resolutions previously possible only with large and expensive lab equipment. The device could provide manufacturers with a way to inspect products too large to fit under a microscope and could have applications in medicine, forensics, and biometrics.
The heart of the system, dubbed GelSight, is a transparent slab of synthetic rubber, one of whose sides is coated with a paint containing tiny flecks of metal. When pressed against the surface of an object, the paint-coated side of the slab deforms. Cameras mounted on the other side of the slab photograph the results, and computer-vision algorithms analyze the images.
Although GelSight’s design is simple, it addresses a fundamental difficulty in 3-D sensing. Micah Kimo Johnson, a former postdoc in the laboratory of BCS professor Edward Adelson, illustrates the problem with a magnified photograph of an emery board, whose surface, in close-up, looks a lot like marmalade—a seemingly gelatinous combination of reds and oranges.
“The optical property of the material is making it very complicated to see the surface structure,” Johnson says. “The light is interacting with the material. It’s going through it, because the crystals are transparent, but it’s also reflecting off of it.”
When a surface is pressed into the GelSight gel, however, the metallic paint conforms to its shape, making the optical properties of the surface perfectly uniform. “Now the surface structure is more readily visible, but it’s also measurable using some fairly standard computer-vision techniques,” Johnson explains.
GelSight is able to register physical features less than a micrometer in depth and about two micrometers across. Moreover, because it makes multiple measurements of the rubber’s deformation, with light coming in at several different angles, it can also produce 3-D models of an object. The prototype sensor is about the size of a soda can and can produce micrometer-scale 3-D images in almost no time, compared with minutes or even hours for conventional equipment.
Adelson and Johnson are already in discussion with a major aerospace company and several manufacturers of industrial equipment, all of whom are interested in using GelSight to check the integrity of their products.
Why China is still obsessed with disinfecting everything
Most public health bodies dealing with covid have long since moved on from the idea of surface transmission. China’s didn’t—and that helps it control the narrative about the disease’s origins and danger.
These materials were meant to revolutionize the solar industry. Why hasn’t it happened?
Perovskites are promising, but real-world conditions have held them back.
Anti-aging drugs are being tested as a way to treat covid
Drugs that rejuvenate our immune systems and make us biologically younger could help protect us from the disease’s worst effects.
A quick guide to the most important AI law you’ve never heard of
The European Union is planning new legislation aimed at curbing the worst harms associated with artificial intelligence.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.