Assisted repair: A United States Marine uses an augmented-reality headset to find and start a repair inside a light armored vehicle (top). The headset overlays text and illustrations on what he sees (bottom).
Augmented reality helps mechanics fix vehicles.
Source: “Evaluating the Benefits of Augmented Reality for Task Localization in Maintenance of an Armored Personnel Carrier Turret”
Steven J. Henderson and Steven Feiner
IEEE International Symposium on Mixed and Augmented Reality, October 19-22, 2009, Orlando, FL
Results: An “augmented reality” system developed by researchers at Columbia University helped mechanics with the United States Marines repair a light armored vehicle. Mechanics wearing the system’s head-mounted displays were able to locate and begin each task in about half the time it would take to do so using a repair manual on a laptop computer, which is the conventional approach.
Why it matters: The system could make the repair process faster and more efficient. Similar equipment could eventually help civilian car mechanics or consumers.
Methods: To identify what part of the vehicle a mechanic is looking at, the researchers installed 10 cameras that track the positions of three infrared light-emitting diodes attached to the headgear, which reveal its position and orientation. The system uses this information, combined with a 3-D computer model of the interior of the vehicle, to automatically update the display as the mechanic looks around. Arrows appear on the screen to direct the mechanic to parts in need of repair or maintenance. For complex tasks, it then displays additional visual information such as an animated 3-D model that shows how to use the tools required to complete the task.
The researchers compared the performance of six mechanics as they used the augmented-reality system, an untracked headset displaying static information, and an LCD monitor that showed the same graphics. In tests, the mechanics started repair tasks in 56 percent less time when they used the augmented-reality system than they did when they used the untracked headset and in 47 percent less time than they did using the LCD monitor.
Next steps: The researchers want to improve the system so that it provides additional real-time feedback to help mechanics complete repairs more effectively. They would also like to incorporate the tracking sensors into the headset rather than relying on external cameras, which would allow the system to be used in other environments.