Highlights

• Vision Pro used by scrub nurse in UK spinal surgery.
• AR technology enhances surgical precision and efficiency.
• Surgeon Syed Aftab praises Vision Pro for reducing human error.
• Marks a significant advancement in AR technology for healthcare.

In a ground breaking move that showcases the burgeoning relationship between technology and healthcare, Apple’s recently launched Spatial Computing headset Vision Pro has recently made headlines for its role in a surgical procedure in the UK.

With the Vision Pro, the realms of surgery and digital technology have intersected in a manner previously unimagined, heralding a new era of precision and efficiency in medical procedures.

“We’re thrilled to see the incredible apps that developers across the healthcare community are bringing to Apple Vision Pro,” said Susan Prescott, Apple’s vice president of Worldwide Developer Relations. “The imagination and drive of our developers, combined with the technical capabilities of visionOS, are igniting new possibilities for physicians, frontline workers, and even students, and we can’t wait to see what’s to come.”

“The myMako app for Apple Vision Pro allows surgeons the ability to access intricate surgical plan details and insights at their fingertips in a 3D-native, intuitive, and dynamic way. This level of insight — anytime, anywhere — was previously not possible,” said Robert Cohen, Stryker’s president of Digital, Robotics, and Enabling Technologies. “With Apple Vision Pro, Stryker’s market-leading enabling technologies such as Mako SmartRobotics have the exciting potential to transform the way surgeons think about preoperative planning and the intraoperative experience, all consistent with Stryker’s mission to make healthcare better.”

“CyranoHealth utilizes spatial computing to revolutionize the training of healthcare professionals, offering immersive, lifelike simulations to enhance learning and combat burnout. The app represents a significant leap forward in healthcare training, blending technology and medicine to create a future-ready workforce,” said John Brownstein, Ph.D., Boston Children’s chief innovation officer.

“At Apple, we believe technology can play an important role in the evolution of healthcare,” said Sumbul Desai, MD, Apple’s vice president of Health. “With the ability to transform a user’s space, display 3D objects at life size, and see all relevant data in one view, the opportunities for health developers to use Apple Vision Pro to help improve procedural planning, education, and outcomes are limitless.”

“Cinematic Reality gives people the opportunity to immerse themselves in a world of photorealistic renderings of the human anatomy,” said Christian Zapf, Siemens Healthineers’ head of Digital & Automation. “Apple Vision Pro perfectly presents that three-dimensional experience, combined with great flexibility and standalone use. We see great potential for the technology for clinical as well as educational purposes.”

“Creating the first electronic health record experience for spatial computing was an exciting project for our developers,” said Seth Howard, Epic’s senior vice president of Research & Development. “With Apple Vision Pro, clinicians will be able to interact with their patients’ health information in new, immersive ways. We welcome ideas from the physician community about how this technology can expand the future of healthcare delivery.”

“Apple Vision Pro’s stunning display offers a gateway into a world of immersive, interactive behavioral health support — a quantum leap beyond previous technologies,” said Brennan Spiegel, MD, MSHS, professor of medicine, director of Health Services Research, and director of the master’s degree program in Health Delivery Science at Cedars-Sinai. “With Xaia, we leverage every pixel of that remarkable resolution and the full spectrum of vivid colors to craft a form of immersive therapy that’s engaging and deeply personal. With this remarkable device, our team was able to completely reimagine how spatial computing can support behavioral health and overall wellbeing in ways never before possible.”

Enhancing Surgical Precision with AR

The Vision Pro headset is being used by a scrub nurse during a spinal operation at Cromwell Hospital, London and not the surgeon.

This distinction is crucial, as it emphasizes the headset’s role in streamlining the preparationand execution of surgical tasks rather than directly assisting in the surgery itself.

The scrub nurse, equipped with the Vision Pro, was able to access all necessary information from the surgery plan in real-time.

This capability has the potential to transform the way surgical teams operate, allowing for a level of efficiency and familiarity akin to that of a team with years of collaborative experience.

Surgeon Syed Aftab lauded the technology for its ability to enhance team dynamics and efficiency.

‘It eliminates human error. It eliminates the guesswork,’ said Suvi Verho, lead scrub nurse at London Independent Hospital 

A New Milestone for Medical Technology

The successful application of the Apple Vision Pro in a surgical context marks a significant achievement for Apple and the field of medical technology at large.

While the integration of AR into surgery might seem like a small step in the broader tech landscape, its implications are profound.

This development is particularly noteworthy given the relatively nascent stage of AR technology in healthcare.

With Apple’s Vision Pro making a tangible impact so early in its introduction to the medical field, the possibilities for future advancements and applications are boundless.

The Vision Pro’s successful deployment in surgery is not just a win for Apple but a promising glimpse into a future where technology and healthcare work hand in hand to achieve unprecedented levels of care and efficiency.

FAQs

What role did the Apple Vision Pro play in the recent UK surgery?

The Apple Vision Pro was utilized by a scrub nurse during a spinal operation at Cromwell Hospital, London, providing real-time access to surgery plans and enhancing operational efficiency.

How does the Vision Pro improve surgical procedures?

By enabling scrub nurses to access necessary information in real-time, the Vision Pro helps reduce human error and guesswork, significantly improving the precision and efficiency of surgeries.

Who can benefit from using the Apple Vision Pro in a surgical setting?

While directly used by scrub nurses to access information, the entire surgical team benefits from the increased efficiency and precision that the Vision Pro brings to procedures.

What does the use of Vision Pro in surgery signify for medical technology?

The successful deployment of Vision Pro in surgery highlights a major leap forward in integrating augmented reality with healthcare, promising future advancements in medical procedures.

How has the surgeon reacted to the introduction of Vision Pro in surgical operations?

Surgeon Syed Aftab has lauded the Vision Pro for its significant impact on reducing human error and enhancing team dynamics, likening its efficiency boost to working with an experienced colleague.

Apple Vision Pro unlocks new opportunities for health app developers. Details?

For decades, medical institutions and developers have taken advantage of Apple’s innovative products and frameworks to help achieve better patient outcomes, increase cost savings, broaden research opportunities, and improve efficiency.

From using iPad to lower the cost and shorten the length of NICU stays so newborns can be at home with their families, to iPhone helping nurses respond faster to alerts and alarms and improve medication administration, the healthcare community has driven purposeful change with powerful Apple products at their fingertips.

Now, with the introduction of Apple Vision Pro, developers have unparalleled opportunities to deliver experiences that can positively impact people’s lives, whether they’re at home or at a clinic.

Vision Pro seamlessly blends digital content with the physical world, unlocking powerful spatial experiences in an infinite canvas.

And with the unique capabilities of visionOS, healthcare developers are creating new apps that were not previously possible, transforming areas such as clinical education, surgical planning, training, medical imaging, behavioral health, and more.

Here are just a few of the apps currently available on Apple Vision Pro in the healthcare and wellness space.

Surgical Planning and Education

More than 1 million Americans receive a knee or hip replacement surgery every year, and that number will continue to rise as the population ages.1 When surgeons use Stryker’s Mako SmartRobotics for total hip, total knee, and partial knee replacements, it can help lead to better patient outcomes like less pain and shorter recovery times, compared to traditional joint replacement surgeries.

With the new myMako app, Stryker is extending a surgeon’s experience in and beyond the operating room with Apple Vision Pro and iPhone. For better preparation, myMako allows surgeons to visualize and review patients’ Mako surgical plans at any time in a brilliant, immersive visual experience.

To alleviate some of the timely challenges healthcare workers face in onboarding and training, Boston Children’s Hospital developed a comprehensive learning experience in a safe, universally accessible virtual environment.

Created for Apple Vision Pro, CyranoHealth places a spotlight on skills related to new medical equipment, like medical infusion pumps, helping improve confidence and reduce anxiety for frontline workers, beginning with nurses.

This immersive, multisensory approach allows students to familiarize themselves with the latest advancements in healthcare technology, helping to prepare them to navigate real-world challenges.

Productivity and Collaboration

Siemens Healthineers’ Cinematic Reality app on Apple Vision Pro allows surgeons, medical students, and patients to view immersive, interactive holograms of the human body captured through medical scans in their real-world environment.

Using Metal and the power of the M2 processor, the app integrates advanced path-tracing technology, simulating light interactions with virtual objects to deliver breathtakingly realistic lighting and reflections.

Medical records are core to any clinician’s work with a patient, whether it’s understanding their health history or finding new opportunities to support improved health outcomes.

Epic Systems, an electronic health records company, is introducing its Epic Spatial Computing Concept for Apple Vision Pro to allow physicians and clinicians to easily complete charting, review labs, communicate using secure chat, and complete In Basket workflows through intuitive gestures, like simply tapping their fingers to select, flicking their wrist to scroll, or using a virtual keyboard or dictation to type.

Behavioral Health and Wellness

Cedars-Sinai’s Xaia app takes full advantage of the unique capabilities of Apple Vision Pro to support patients’ mental health needs. Through its trained digital avatar, Xaia offers patients AI-enabled, conversational mental health support in relaxing spatial environments where they can also do deep breathing exercises and meditation.

The immersive therapy sessions take place in environments that are most comfortable to users — whether they choose to remain in their own space, or transform their environment into a relaxing location like a beach. Privacy remains core to the app; it requires no personal information or health information.

What are Additional apps in surgical planning and education ?

Fundamental Surgery, which delivers surgical training through spatial computing for Apple Vision Pro.

CollaboratOR 3D by KARL STORZ, which enhances surgical learning opportunities while allowing teams to scale their training efforts.

Elsevier’s Complete HeartX, designed exclusively for Apple Vision Pro, which provides a captivating experience as it delves into the intricacies of the human body to create a realistic and engaging learning environment.

Insight Heart, which lets users understand the human heart like never before. With ARKit, users can easily scan their physical surroundings and visualize 3D hearts using CT data, as well as explore various heart conditions.

What are Additional apps in productivity and collaboration ?

Visage Ease VP, which supports immersive spatial experiences for diagnostic imaging and multimedia. UC San Diego Health became the first health system to pilot the technology with the goal of improving patient care, looking at opportunities like potentially helping inefficient tumor board reviews and creating collaborative spaces in healthcare.
Falcon Vue, which unleashes the power of spatial medical imaging viewing across all modalities.

Medivis, which brings SurgicalAR Vision to Apple Vision Pro, enhancing medical imaging to support surgical precision and patient care.

What are Additional apps in behavioral health and wellness ?

The Mindfulness app on Apple Vision Pro, designed to transform users’ surroundings into a calming, immersive environment.

TRIPP, which delivers signature experiences for Vision Pro with illuminating visuals and Spatial Audio for guided breathing exercises and sleep experience.

Healium, which brings beautifully designed experiences to Vision Pro users, helping them relax and build resilience by creating stress-reducing memories of nature-based escapes.

Odio, which uses Spatial Audio and intuitive gestures to display beautiful 3D images in a user’s space for focus, relaxation, or peaceful sleep.

Also Read: Apple Vision Pro Once Lost, Cannot be Located on the Find My Network

Also Read: Apple Vision Pro Faces Returns and Prescription Limitations: Users Share Discomfort and Accessibility Issues

Also Read: Apple Vision Pro vs Meta Quest 3 Headset Showdown: Which One is Better Value for Money?