NMY and five cooperation partners from science and research backgrounds, as well as the industry are collaborating on a government-funded XR- and machine-learning system that enables diagnostics, training, and assistance of people with age-related visual impairments.
The Bundesministerium für Bildung und Forschung (BMBF) funds the project called „Integriertes Diagnose- und e-Assistenzsystem für Patienten mit altersbedingter Makula-Degeneration“ (IdeA, integrated diagnostics and e-assistance system for patients with age-related macular degeneration). The project partners aim to develop an innovative and technology-driven solution that increases quality of life for older patients who are visually impaired.
Mixed reality expert NMY participates in the three-year long research project. We’re part of a multidisciplinary team that endeavors to employ technologies in a radically new way to help people. Together with specialists from the LMU university of Munich, ZEISS, Karl-Eberhards University of Tübingen, TalkingEyes and Blickshift we develop and validate technology-driven approaches. To do this we anticipate technologies that have not been introduced to the market, yet. The project consists of three innovative strategies that, with the help of XR technologies, will turn into real applications very soon.
Following the first strategy, we want to make diagnostics tools available for patients by implementing them into ordinary hardware. The goal is to enable early detection of eye diseases such as macular degeneration. We’ve already developed a virtual reality prototype that includes state-of-the-art eye tracking technology for perimetric eye examination. This examination allows for a scan of the patient’s field of vision and the discovery of possible deficits, making it a valuable diagnostics instrument for doctors and patients.
Additionally, we’re developing an assistance system for a mixed reality headset that substitutes information in a patient’s visual center. This will be achieved by blending in information in the peripheral field of vision. The application also features a training function that enables patients to perform exercises wherever they are in order for them to learn how to deal with their disability. By implementing artificial intelligence (AI), eye movement patterns will be identified so that the system understands what the user is looking for. The user-centered application supports ordinary everyday activities of visually impaired patients.
The last step in the project is a telemedical portal that will ease communication between patients, doctors, therapists and family members. Developing a virtual doctor’s office means no unnecessary visits to the doctor and it optimizes the allotted time doctors have with patients.
The IdeA project enables us to discover the potential of extended and mixed reality applications for the healthcare industry. At the same time, the patient-oriented approach makes a good case for the use of new technologies in medicine, because they work completely independently of age and gender.