Google Glass Enables Surgeons To Consult Remotely

When surgeon Brent Ponce wore Google Glass during a shoulder replacement, the ghostly hand of a remote collaborator coached him along.

Brent Ponce wasn't the first surgeon to bring Google Glass into the operating room, but he may have been the first to use it as a truly collaborative tool.

While performing a complete shoulder replacement at the University of Alabama at Birmingham Highlands Hospital, Ponce wore the Glass display under a moonsuit-style surgical hood, allowing the camera built into the frame to capture video and beam it to a colleague, Phani Dantuluri, M.D., tuning in from his office in Atlanta. At the same time, on the Glass' tiny video screen, Ponce could see a virtual hand pointing things out. It was Dantuluri's hand, captured by video on the other end of the Internet connection and superimposed over the surgical field of view.

This was accomplished with the use of a Glass app from VIPAAR, which makes software for remote assistance via video. It's technology that got its start in healthcare, although it's also used for other purposes such as field-servicing equipment. The software works on PCs as well as mobile devices, and now on Google Glass, using a camera to capture hand movements and superimpose them on video from a remote location.

Ponce had used VIPAAR's technology before, in combination with conventional cameras and monitors, as part of a medical education demonstration project with the Veterans Administration. In that case, he was the one coaching surgical residents performing a procedure, monitoring it by video from the surgeon's lounge rather than leaning over the surgeon's shoulder. "I was able to reach my hand into the surgical field and have it appear on the same monitor as the resident I was doing the case with," Ponce said.

Importantly, he was able to demonstrate that coaching could be delivered that way without slowing down the procedure and requiring only about 15 minutes of setup time. "It also offers much greater autonomy to the resident -- I'm not breathing over them." A scientific presentation on that work, "Telesurgery: Use of Augmented Reality in Orthopaedic Education," was one of the prize winners at this year's American Academy of Orthopedic Surgeons conference.

Ponce is convinced this sort of virtual coaching -- where a collaborator can not only give spoken instructions but point out exactly where to place an instrument or make an incision – has great potential. "It's not unreasonable to say that this will be the standard of care in the near future," he said.

[ Learn more about how Google Glass could change healthcare. See Google Glass Enters Operating Room.]

As a practical matter, a setup employing a high-definition camera and monitor is still a superior experience compared with Google Glass, at least as the technology exists today, Ponce said. After all, it's still a prototype rather than a commercial product, and it does not yet provide HD video. "This technology, while amazing, is going to need several iterations to refine it," he said.

The Google Glass demonstration, which occurred in September, was also a somewhat artificial scenario. The operation was the sort of surgery Ponce performs on a routine basis, meaning he didn't need a lot of coaching. Still, he found having Dantuluri virtually engaged interesting. "What we really don't do as surgeons, we rarely attend surgery with one another. So it was nice to see where he likes to put his retractors, the way he likes to do things."

Where he thinks this sort of remote consultation could be extremely useful is when surgeons are called on to perform a procedure that they don't normally do. For example, as someone who paid for medical school with military service, in 2006 he found himself serving in Iraq as an orthopedic surgeon, but called on to perform emergency vascular surgery. A soldier came in with a large vein cut in his thigh, and it was situation where, "if it wasn't me, it wasn't going to be anybody," Ponce recalled. "It wasn't arterial, but it did need to be repaired. I was able to do it, but it would have been nice to have been able to dial up a vascular surgeon to assist."

Follow David F. Carr on Twitter @davidfcarr or Google+. He is the author of Social Collaboration For Dummies (October 2013).

Though the online exchange of medical records is central to the government's Meaningful Use program, the effort to make such transactions routine has just begun. Also in the Barriers to Health Information Exchange issue of InformationWeek Healthcare: why cloud startups favor Direct Protocol as a simpler alternative to centralized HIEs. (Free registration required.)

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.