Siemens Healthineers
Anatomy on the Apple Vision Pro thanks to Cinematic Reality app
Siemens Healthineers sees great potential: with a new app for Apple's groundbreaking 3D glasses, doctors can view immersive, interactive holograms of the human body in a real environment. The visualisation of medical scans is intended to help with surgical planning and physician training.
| »Cinematic Reality gives us the opportunity to immerse ourselves in a world of photorealistic representations of the human anatomy. The Apple Vision Pro is perfect for this three-dimensional experience thanks to its great flexibility and autonomous use. We see great potential for both clinical purposes and medical education.« |
|---|
| Christian Zapf, Director Digital and Automation at Siemens Healthineers |
The »Vision Pro« is the first spatial computer from Apple. The 3D glasses seamlessly connect digital content with the physical world and enable users to interact with apps by simply looking at them, tapping with their fingers to select something, moving their hands to scroll, or using a virtual keyboard or voice recognition to enter text.
View in the Human Body Without a Computer
With the Cinematic Reality app on Apple Vision Pro, you can zoom into the intricacies of clinical images, enlarge content, rotate a rendering of the human body, and use basic two-dimensional tools such as scrolling. Clinical cases can be visualised directly via the native app - no connection to an additional computer is necessary.
With the new Cinematic Reality app, Siemens wants to use the current 3D hardware flagship from Cupertino to create a solid foundation for future AR/VR developments. The app is intended to help visualise organs or body parts more realistically. This could make clinical cases easier to understand with patients, clinical questions about referrals between doctors could be discussed or anatomy training in medical studies could be supported.
Highly Realistic Rendering on the M2 processor
»We have further optimised the existing Cinematic Reality algorithm to enable computationally intensive methods on the Apple Vision Pro M2 processor,« says Sebastian Krüger, lead developer of the Cinematic Reality app at Siemens Healthineers. »The rendering technique is used to simulate the way light interacts with objects in a virtual environment. This creates highly realistic lighting and reflections in the resulting images.«
According to Siemens Healthineers, the 3D application can also be used in the future for pre-operative planning in surgery, to promote interdisciplinary communication between specialists or to help non-radiologists and patients to better understand scans and their state of health.
Prototype with Medical Potential
The cinematic reality app is currently in prototype status; it is still unclear when and whether the application will be used in everyday medical practice. Nevertheless, the app is now available to download from the Apple App Store. Visitors to the HIMSS trade fair in Orlando, Florida, USA, will also be able to experience it live at the Siemens Healthineers stand from 12 to 14 March. (uh)
