Robots That Sense Before They Touch

Intel researchers are using electric-field sensors to build pre-touch technology into robots to help them size up objects and people they encounter.

At Intel's research labs, in Seattle, a robotic arm approaches three plastic bottles, two of which are filled with water, one of which is empty. Without touching the bottles, the sensors at the end of the arm scan them, collecting information about their conductive properties. After each bottle has been sensed, the arm returns to the empty bottle and, as programmed, knocks it off the table.

Gentle grabber: The top image is a computer-aided design illustration of a robotic hand enabled with electric-field sensing. The bottom image is the actual gripper. When a conductive object comes near the sensors, the hand detects it, and an algorithm estimates the object’s shape and position. Credit: Ryan Wistort

Multimedia •  Watch the robotic hand in action.

The demonstration showcases technology, called pre-touch, that is currently under development at Intel. The researchers have incorporated the sensors into a robotic hand as well, allowing mechanical fingers to adjust to the size and shape of an object that they encounter (see video). The goal, explains Josh Smith, senior research scientist at Intel Research Seattle, is to "improve the ability of robots to grasp objects in unstructured human environments."

Currently, robotic arms and hands routinely grab and hold objects on factory floors, where the uncertainty has been engineered away, Smith says. By adding pre-touch to a robot, it can sense the shape and size of unfamiliar objects at close range and react accordingly. Smith hopes that by improving this close-range interaction, robots will be more useful in homes, able to bring an elderly person a glass of water, for example, or pick up objects on a floor before the Roomba vacuums.

The way that Smith's pre-touch sensors work is fairly straightforward. Each sensor consists of simple electrodes that can be made of copper and aluminum foil; in the case of a robotic hand, an electrode is at the tip of the thumb and each finger. When the researchers apply an oscillating voltage to the electrode in, say, the thumb, it creates an electric field that in turn induces a current in the electrodes of the fingers. When a conducting object--metal, or anything with water in it, such as an apple or a person--comes close to the sensors, it reduces the induced current in the fingers' electrodes. This change in the electric field is detected by the sensors. Specialized algorithms process the data and instruct the robotic fingers to move around the object appropriately.

Story continues below

Sensors used in the Intel robotic hands are known as electric-field (EF) proximity sensors. While Smith was a student at MIT, he developed EF sensors similar to those in his robots to determine the position of a person sitting in a car--a piece of information critical to helping make airbags deploy more safely. Now, EF sensors have been incorporated into all cars with side airbags made by Honda.

Much of Smith's EF sensing research now involves developing algorithms that can make sense of the data, as EF signals tend to be complex, especially when an object or robot is in motion. Just a single measurement, made at one time by a stationary sensor and object, isn't very difficult to understand, says Smith, but it's challenging to decode the signals of a moving object or sensor.