Individual health is not only a lead topic at the Fraunhofer Institute for Computer Graphics Research IGD but also a hot topic at MEDICA 2017. It encompasses subjects such as medical data acquisition, preparation and analysis or navigation assistance for surgery.
(Darmstadt/Rostock, Germany) Patient data analysis forms the basis of personalized medicine. The researchers at Fraunhofer IGD have created solutions for such analysis in Health@Hand and VA4RAdiomics. The former comprises a visual control center which automatically combines and analyses data and presents them in a visual format. The latter consists of a system which merges doctors' experiences, image data, and general patient data for decision-making purposes. The Fraunhofer researchers are also showcasing an augmented reality (AR) system at this year's MEDICA – 3D-ARILE, which provides navigation assistance to doctors during operations.
Health@Hand – acquire patient data at a glance
Time is being called on long searches. Digital patient records are set to contain all patient data in the future. Doctors, nurses, and care home staff will simply look at a tablet or a central multi-touch table to view all patient data at a glance. Health@Hand integrates all different systems for the first time, merging all data and presenting them in easy-to-understand visual formats. Staff will thus be able to view treatment appointments, drug administration, cleaning intervals, and bed occupancy capacities together in a clearly arranged visual format.
VA4Radiomics – learning from patient data
As many similar treatment cases as possible are needed to best evaluate how a patient's particular illness can be treated to an optimum extent. VA4Radiomics does exactly this by collecting information from radiological image data and linking it to the corresponding patient data. This enables the creation of patient groups and the visualization of individual patient features. These in turn can be compared by medical staff for diagnoses, therapies and treatment outcomes. Doctors can also include patients that they would never personally meet in the comparison, such as those suffering from very rare illnesses. Visual analytics methods will help doctors to present clinical, radiological and pathological data in a meaningful manner.
3D-ARILE – AR glasses used to assist in tumor operations
During surgery, it is difficult to spot the exact location of sentinel nodes – lymph nodes where a malignant tumor drains to first – or know whether an affected lymph node has been completely removed. One help in removing such nodes is 3D-ARILE, a system which uses AR glasses to overlay the exact position of the lymph node as a virtual mark. It creates marks to assist doctors in locating affected nodes. Firstly, the patient is injected with a fluorescent dye in the immediate vicinity of the tumor. This dye then spreads throughout the lymphatic channels and gathers in the sentinel lymph nodes. Infrared cameras capture the fluorescence and reconstruct the affected lymph node in 3D. The AR glasses then overlay its exact position for the doctor in real time.
The Fraunhofer researchers will be showing how they present health data in visual format and what possibilities augmented reality presents for operation theaters at Booth G05 in Hall 10 at MEDICA 2017 in Düsseldorf between 13 and 16 November.