3D hearts: How 5G and AR are helping to transform the operating theatre

Today, immersive technologies such as Augmented Reality (AR) and Virtual Reality (VR), are helping to transform the healthcare industry. Delivering faster and more effective training, diagnoses, and surgical operations.

Working with innovative Italian start-up Artiness in Milan, we’ve been using these technologies to create a solution that allows cardiologists to view and interact with 3D models of the patient's heart and, Boston Scientific, a global medical technology leader, has become the first company to adopt the solution in Italy, looking to use it to help train cardiologists.

Training for 3D heart surgery

To encourage communication and dialogue between medical doctors, the solution aims to bring more expertise in to analyse treatment options, more effective interpretation of the data so that the right option is selected delivering the best outcome for the patient.

Using an AR headset, connected through 5G edge computing technology, cardiologists will now be able to access and interact with medical data and a patient-specific holographic model of the heart for training purposes.

The hologram can zoom in, cut, section and virtually replicate the medical information necessary for positioning and implantation of devices such as catheter and stents.

Therefore, the surgeon can benefit from discussing options with specialists and be trained on how to conduct the surgery, or implant such devices, thanks to the speed and reliability of 5G.

Expert advice

By providing three-dimensional images of a patient’s heart and health data, medical teams can more accurately and quickly assess the best form of treatment and whether a specialist consultant is needed during surgery.

The initial phase of the implementation will see Boston Scientific’s RHYTHMIA HDx™ Mapping System replicated in 3D and augmented reality, which can then be visualised and manipulated in the virtual and three-dimensional context of relevant clinical cases.

This means the observation and training of medical staff can take place in a highly technological, interactive, safe environment and even closer to the real user experience.

Digitising healthcare

Tools like this will be vital in the industry, streamlining processes, supporting staff and improving overall patient care.

At Vodafone, we already connect more than 20 million devices globally to healthcare, and, through our 5G trial in Milan, we have developed several use cases in this space. From telemedicine projects and rehabilitation to service robotics and connected ambulances.

Looking to the future, we will continue to work with like-minded partners such as Deloitte, to accelerate the innovation and adoption of more digital health solutions.