Advanced Interfaces of Interactions with Virtual Organs for Surgical Pre-Operative Planning

The visualization of 3D models of the patient’s body emerges as a priority in surgery both in pre-operative planning and during surgical procedures and the introduction of new modalities of interaction with the 3D models of the human organs could be required.
A multi-touch screen has been developed that provides a user interface customized for doctor requirements and allows many users to interact at the same time with 3D models of the human body built from CT images. The use results very simple and evident for the user and the system can be a helpful tool for the diagnosis and the surgical pre-operation planning.




Virtual Touch Screen for the Interaction with 3D Models of Human Body

The developed system is the first prototype of a virtual interface designed to avoid any contact with the computer so that the surgeon can visualize the models of the patient’’s organs and interact with these in a more effective way.
Using the virtual touch screen, the interactions with the 3D models of the patient’s organs happen in real-time and the interface appears as a touch-screen suspended in the free space in a position chosen by the user when the application is started up. The finger movements are detected by means of the optical tracking system and are used tosimulate touch with the virtual interface.