Imec and VUB project hologram-assisted surgery

The Imec research group at the Vrije Universiteit Brussel (VUB) is developing technology that projects medical scans on the body of patients in real time during surgery. Using augmented reality (AR), the 3D models are shown in the exact place of operation, allowing for more precision. Also, the AR technology can be used to train medical students.

Generally, surgeons use MR or CT scans that are projected on a screen during an operation. This means that they have to divide their attention between the screen and the patient. The Imec.icon project Sara is now looking at using AR to give 3D images of these scans that overlap with the patients, helping surgeons to keep their eyes on them. The goal is to improve upon computer-supported surgery and to decrease cognitive pressure on the doctors.

An example of using the headset could be making a tumor visible within a patient’s skull, even before an incision has been made. This may help a surgeon to choose the perfect location for entering and to avoid critical parts of the body. A person wearing the headset can still walk around the room and look at the model from different angles. In addition to this, the images are live-streamed to an external monitor, allowing outsiders to see what the headset sees.