An Augmented Reality Platform for Medical Planning: Cases of Study in Mitral Valve and Cerebral Aneurysm Minimally Invasive Surgeries

Researching in new technologies for diagnosis, planning and medical treatment have allowed the development of computer tools that provide new ways of representing data obtained from routine imaging studies. Laboratory studies, such as computed tomography (CT) and magnetic resonance imaging (MRI) have become the standard for med- ical diagnosis, so today they are used to give a first diagnosis of the treatment to be followed depending on the patient’s condition. Also, surgeons use these images to obtain information about the best way to reach certain structures within the human body before the surgery. In this sense, augmented reality (AR) technologies provide a new form of data representation by combining the common analysis using images and the ability to superimpose virtual representations of any structure of the human body on a view of the real world on real-time. In this paper, we describe the development of a generic computer platform based on aug- mented reality technology for surgical planning. To validate the system, we focused in two cases of study: navigation through aorta artery for mitral valve repair surgery and navigation through vascular structures in the brain for the treatment of cerebral aneurysms.

Spatial Augmented Reality

We are experimenting with the use  of Video Mapping technology, one of the most innovative in Augmented Reality field, in order to provide a new tool for Storytelling. Video Mapping allows the surface of any object or buildings to turn into a virtual skin through projection of images by developing impressive visual illusion. We are now exploiting the Video Mapping technology in order to develop one performing show dedicated to the city of Galatina (Lecce):  the whole storyboard focus on  the history of the building, the Clockwork Tower, and on the history of the Taranta folk tradition.


The BRAVO project aims to create an advanced game based therapeutic environment able to help young people with ADHD (Attention Deficit Hyperactivity Disorder) in the acquisition of cognitive and behavioral skills on which ADHD impacts.

The BRAVO gaming environment aims to:

  • Improve the relationship of young patients with therapies;
  • Implement therapy processes customized;
  • Support therapists and families in the management of the rehabilitation program.

The Bravo virtual gaming system involves children in an environment where therapy is turned into a playground.

Users of BRAVO system will therefore be: patients, who will be able to access the games developed to benefit from personalized therapy; the therapists, who will be able to access the system to assign the therapies and control the evolution of the therapy administered.


The Project RESPIRO aims to build a network of expertise in the design and supply of technology products and services for the elderly and people with different forms of disability. The project is focused on the development of technologies and systems in the field of Ambient Assisted Living in order to support of prevention processes and self-management of health, diagnosis, treatment and follow-up with the aim to permit a comprehensive and personalized management of chronic disease in the home environment.