Intelligent Machines

AR Is Making Its Way into the OR

Doctors may soon be able to augment their view of your body, but it will be some time before it’s commonplace.

“Scalpel. Forceps. Suction. Oh, and nurse, pass me the HoloLens.”

That’s not the kind of conversation you’ll currently overhear in an operating room, but it’s certainly the direction in which we’re headed. Late last year, engineers at Duke University announced that they were developing systems to test how Microsoft’s augmented reality device might provide doctors with extra information during brain surgery. And now, in the past week, two firms have offered up further takes on how the HoloLens could be used during procedures.

First up is a system being developed by the software company Scopis that's designed to help during spinal surgery. It can put scans into the field of view of a surgeon, or provide a simulated view of how pedicle screws—the metal rods used to repair vertebrae—are being positioned during the procedure.

More ambitious is a project by Cambridge Consultants that seeks to provide surgeons with the ability to load results from MRI and CT scans into software that renders them into a 3-D visualization of a patient’s organs. The idea: surgeons would be able to perform keyhole procedures with an extra layer of information in front of them, allowing them to take better-informed actions.

The concept is certainly a good one. Such approaches could allow the technology to alert surgeons if they, say, stray too close to a particularly delicate part of anatomy during a procedure. Or else they could help guide less experienced doctors during complex procedures.

But that, of course, raises some interesting questions. Namely, how comfortable would most people feel about surgeries carried out based on data provided via a HoloLens? As Shafi Ahmed, a surgeon at Royal London Hospital, explained to New Scientist: “We can’t trust these systems at the moment.” So the answer is: probably not very, for now at least.

There are clearly some hurdles to overcome. One of the largest will be that of image registration: loading MRI scans into a HoloLens is all well and good, but the body itself moves around naturally, and can look different during surgical procedures—the device will need to adjust the AR image accordingly, which is harder than it sounds. And at any rate, most doctors like to be sure of the technology they’re dealing with, so adoption of the most advanced surgical AR systems will be slow at first.

It is, however, easy enough to imagine the systems being used for less complex augmentation—such as providing relevant numbers or stills of medical scans in the periphery of a surgeon’s vision. So don't be too alarmed if your surgeon asks for the HoloLens as you're about to go under the knife.

(Read more: Engadget, New Scientist, “Microsoft’s New Idea: A Hologram Headset to Rewrite Reality”)

Become an MIT Technology Review Insider for in-depth analysis and unparalleled perspective.

Subscribe today

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Premium {! insider.prices.premium !}*

    {! insider.display.menuOptionsLabel !}

    Our award winning magazine, unlimited access to our story archive, special discounts to MIT Technology Review Events, and exclusive content.

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

    Access to the Magazine archive. Over 24,000 articles going back to 1899 at your fingertips.

    Special Discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

    First Look. Exclusive early access to stories.

    Insider Conversations. Listen in as our editors talk to innovators from around the world.

  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

    Access to the Magazine archive. Over 24,000 articles going back to 1899 at your fingertips.

    Special Discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning magazine and daily delivery of The Download, our newsletter of what’s important in technology and innovation.

    See details+

    What's Included

    Bimonthly home delivery and unlimited 24/7 access to MIT Technology Review’s website.

    The Download. Our daily newsletter of what's important in technology and innovation.

/
You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.