How doctors used VR to save twins’ lives
Conjoined newborns safely separated using 3D modelling and imaging before surgery
During an 18-year career in medicine, Daniel Saltzman — the chief of pediatric surgery at University of Minnesota Masonic Children’s Hospital — has grown accustomed to looking at X-rays as if they were imperfect road maps of the human body.
He compares this exercise to looking at a one-dimensional traffic map on your smartphone and thinking about that image in three-dimensional terms in your mind. Like any other road map, an X-ray image is an incomplete reduction of reality that can misrepresent challenges or include distortions, which explains why, even in 2017, high-stake surgeries can involve a shocking degree of guesswork and improvisation.
“That’s why medicine is still an art as much as a science,” Saltzman told the Washington Post.
For decades, increasingly sophisticated imaging techniques have allowed doctors to peer into the human body before they cut it open, reducing uncertainty and helping them prepare for complicated procedures.
Now, advances in virtual reality may flip that dynamic on its head, allowing doctors to confront the unknown before they even enter the body.
The latest evidence of this revolutionary shift in health care is the successful separation of two conjoined newborn sisters in Minnesota.
Until their separation in May, Paisleigh and Paislyn Martinez were attached from their lower chest to their belly buttons — a condition known as thoraco-omphalopagus. Both babies survived the dangerous, nine-hour procedure, a development that Saltzman and other surgeons involved link directly to their use of virtual reality before surgery.
“It felt like I was working in the future,” Saltzman said. “It was extraordinarily exhilarating.”
Conjoined twins are extremely rare, occurring as infrequently as one in 200,000 live births to up to one in a million births, depending on how the babies are attached, according to University of Minnesota doctors.
Separating them is a risky procedure, though survival rates differ depending on how the siblings are connected and which organs they share, according to the University of Maryland Medical Center. The Medical Center notes that twins “joined at the sacrum at the base of the spine have a 68-per-cent chance of successful separation, whereas, in cases of twins with conjoined hearts at the ventricular (pumping chamber) level, there are no known survivors.” In the latter case, the hearts are completely joined.
Experts said they were unaware of any other example of virtual reality being used to prepare for the separation of twins partially conjoined at the heart. Virtual reality has been used to assist in the separation of twins conjoined at the head on three occasions, two of which were carried out by U.S. Housing and Urban Development Secretary Ben Carson, experts said.
Anthony Azakie — chief of pediatric cardiac surgery and co-director of the Heart Center at the University of Minnesota Masonic Children’s Hospital — called the university’s procedure a “once-in-a-lifetime event.”
Using goggle-like virtual reality headsets a month before surgery, Saltzman, Azakie and their team were able to explore a 3D model of the twins’ hearts, virtually embedding themselves inside the walnutsized organs as if the infant’s anatomy had been blown up to the size of a living room.
“It’s completely surreal and the resolution is unbelievable,” Azakie said. “The details are absolutely superb.”
The experience was not only riveting but revelatory, doctors said, so much so that the stunned surgeons decided to alter their entire opera- tive strategy. Within minutes after strapping on the headsets, Saltzman and Azakie discovered something unexpected: new connective tissue — a “bridge” — linking the girls’ intertwined hearts, one of which had become heavily reliant upon the other to filter impurities and remain beating because of a severe congenital heart defect.
That defect meant that the lives of both babies were in jeopardy and doctors would have to conduct the surgery several months early, before the twins were as robust and healthy as doctors had hoped they’d be.
Standing inside the 3D rendering of the infants’ hearts, the challenge before the physicians was daunting. They realized that improperly severing that connection could lead to the twins bleeding to death. Placing pressure on the hearts could cause blood loss or arrhythmia so severe that the organs could stop beating entirely. They needed to find a way to navigate around the connection that didn’t damage each delicate organ.
The team members interacted with the 3D model using a “track system” that allowed them to turn their heads without distortion. Doctors said the ease of the virtual interaction helped the team arrive at a simple yet elegant solution, which they drew on a whiteboard moments later.
The surgeons decided to flip the babies around on the operating table so that the procedure occurred from the opposite angle. In the end, doctors said, the straightforward solution to a complicated quandary may have saved the twins’ lives.
“In our line of work — especially in pediatric cardiac surgery — it’s important that one is able to think on their feet and plan for the unexpected,” Azakie said.
“The imaging helped us prepare by developing an approach in the event that we came across something we didn’t expect.
“It was like the Oculus Rift of pediatric heart surgery.”
The planning effort to get to that point was methodical, with weekly meetings, endless tests and trial runs with a team of nearly 50 hospital staffers who practised each stage of the surgery using baby dolls that had been sewn together.
To create the virtual model of the infants’ hearts, Saltzman and Azakie and other team members partnered with the University of Minnesota’s Earl E. Bakken Medical Devices Center, where experts used software to turn MRIs and CT scans from both infants into a detailed virtual model. The university’s Visible Heart Lab also created a 3D printed model of the hearts using a printer purchased online for $300.
Two months after their separation, the twins were recovering, but doctors said that they’ll lead healthy, independent lives, with a scar on their chests the only evidence that they were ever conjoined.
Doctors said they expect the 3D modelling and imaging used to appear in medical journals, setting a precedent for surgeries that ripples beyond procedures involving conjoined twins.
“Separating these infants was no small feat,” he said. “The fact that we got to do it using virtual reality for direct patient care makes that feat truly incredible.”
“It was like the Oculus Rift of pediatric heart surgery.” ANTHONY AZAKIE UNIVERSITY OF MINNESOTA MASONIC CHILDREN’S HOSPITAL