![\"\"](\"https:\/\/www.nmy.de\/en\/wp-content\/uploads\/sites\/5\/2025\/02\/xr_idea_article_xr_patient_physician.jpeg\")
<\/figure>Not for Entertainment (Only)<\/h2>\n\n\n\n
The fields of application for mixed reality technologies, such as augmented and virtual reality, are endless. They can be used for entertainment purposes, but also for more serious, business, and even scientific use. More and more, we find out about how augmented and virtual reality apps help change the way we navigate our lives, and how businesses optimize workflows and processes by employing new technologies.<\/p>\n<\/div><\/div>\n\n\n\n
Mixed Reality for Visually Impaired People<\/h2>\n\n\n\n
Mixed reality technologies have an important feature in common: they attract the visual system. But what about the people, who no longer have a fully functioning visual system? Can visually impaired people participate in mixed reality technologies? Or, can they even benefit from them? Let\u2019s focus on a target audience, that does not spring to mind as soon as state-of-the-art technologies are implied: The over-60s. Even though 60 is the new 40, older generations are not at the forefront of VR and AR users. This could potentially change very soon.<\/p>\n\n\n\n
Age-Related Macular Degeneration (AMD)<\/h2>\n\n\n\n
AMD can lead to partial or even complete loss of vision in one eye or both. The causes are destructive metabolic products that accumulate in the sensory cells of the macula lutea as is common due to the aging process of humans. As the macula is responsible for color, central, and high-resolution vision, any kind of damage is obviously not good news. Early stages of AMD occur in every fifth 70-year-old and in 30\u201340% of 85-year-old people. To support therapy and relieve symptoms of AMD, a conglomerate of scientific and technological partners collaborates on the so-called IDeA project: Integrated Diagnosis- and E-assistance System for Patients with Age-related Macular Degeneration.<\/p>\n\n\n\n
Science to the Rescue. Mixed Reality for AMD Patients<\/h2>\n\n\n\n
Since December 2018, NMY has been involved in the IDeA project that features partners such as the universities of Munich and T\u00fcbingen, as well as optics company ZEISS. The main objective of the government-funded research project is to develop solutions that improve quality of life for people suffering from AMD. By developing a system that combines several crucial functions specifically tailored to AMD patients, the IDeA partners have come together for a duration of 3 years. IDeA revolves around three main strategies for diagnosis, assistance, and training.<\/p>\n\n\n\n
Diagnose. Assist. Train.<\/h2>\n\n\n\n
Clinical diagnoses can be supported by inexpensive and portable tests in virtual reality or the analysis of eye movements in everyday life. Furthermore, our system enables learning and improvement of visual coping strategies for patients. Last but not least, those affected in difficult situations will be offered an easily recognizable visual extension of reality to make information more easily accessible.<\/p>\n<\/div> improve the quality of life of AMD patients<\/p>\n<\/div>\n\n\n\n develop an assistance system for AMD patients<\/p>\n<\/div>\n\n\n\n facilitate diagnostic processes<\/p>\n<\/div>\n\n\n\n facilitate training processes<\/p>\n<\/div>\n<\/div>\n\n<\/div>\r\n<\/section>\r\n<\/div>\n\n\n\n Early diagnosis is crucial. The development of AMD takes years and since it often affects one eye, the healthy eye compensates for the loss of vision for a long time, before the patient becomes aware of it. In the meantime, the disease has progressed. Regular check-ups at the ophthalmologist are essential for early diagnosis and therapy because they prevent the disease from developing further and can even lead alleviate and overall improve symptoms.<\/p>\n\n\n\n In the context of IDeA, we have identified two approaches. First, we will take advantage of the increasing popularity and availability of mixed reality technologies, to integrate diagnostic tests into everyday life. Plus, we want to create slimmed-down versions of classic clinical tests to be used at home. This helps to prevent unnecessary, time-consuming (or, due to AMD symptoms, often difficult) trips to the doctor\u2019s office. We will investigate how eye movements in real and virtual spaces can be used to draw conclusions about the existence, size, and location of visual field defects. For this purpose, the user wears a mixed reality headset with integrated eye tracker and environment camera that allow continuous reading and evaluation of eye movements. The aim is to detect pathological deviations from normal gaze behavior associated with AMD in \u201cnormal\u201d activities like reading, cooking, or shopping as early and automatically as possible, in order to detect the extend of defects. This comes with a degree of accuracy that allows the adaptation of AR-based assistance functions.<\/p>\n\n\n\n Standardized procedures for the examination of visual function in AMD will be made available for telemedical and everyday use. For this purpose, computer-aided, AR\/VR-based variants of the procedures will be developed and validated. The focus will be on procedures that are both technically feasible and promise the greatest knowledge gain during a telemedical examination. Furthermore, it will be examined to what extent the duration of individual test sessions can be shortened by integrating test items into everyday activities without reducing the validity of the testing procedure.<\/p>\n\n\n\n enables earlier diagnosis which can lead to a milder course in AMD patients<\/p>\n<\/div>\n\n\n\n renders frequent visits at the doctor\u2019s unnecessary<\/p>\n<\/div>\n\n\n\n will use technology that is easily available<\/p>\n<\/div>\n\n\n\n increases the frequency of measurements taken of the eyes<\/p>\n<\/div>\n\n\n\n improves the database doctors use to make decisions<\/p>\n<\/div>\n<\/div>\n\n<\/div>\r\n<\/section>\r\n<\/div>\n\n\n\n For the development of user-centered assistance functions, we have identified augmented reality (AR) as eligible technology to support AMD patients with everyday activities. The assistance system that will be implemented in AR glasses, will compensate declining vision as well as additionally projecting information into the intact visual field. At later stages, the assistance software will also enable context awareness, i.e. the system will selectively and automatically apply functions at the exact moment they are needed by the patient.<\/p>\n\n\n\n Moreover, the system will respond to individual visual needs of users. To achieve this goal, functional AR demonstrators for AR glasses are needed that use object recognition. There are endless applications for AR-based assistance in daily situations: Purchasing tickets from a machine, recognizing familiar faces at events, reading clocks, etc.<\/p>\n<\/div><\/div>\n\n\n\n At the end of the day, let\u2019s not forget we are talking future developments here. AR hardware is not up to speed as of today. We are developing the strategies and software matching hardware that does, in fact, not exist yet. However, we are confident that it is not a matter of \u201chow\u201d but \u201cwhen\u201d. AR hardware will be a common device for people of all age groups.<\/p>\n<\/div> helps patients in their everyday life<\/p>\n<\/div>\n\n\n\n depends on the development of more practical hardware<\/p>\n<\/div>\n\n\n\n needs to adapt to individual patient requirements<\/p>\n<\/div>\n<\/div>\n\n<\/div>\r\n<\/section>\r\n<\/div>\n\n\n\n A process we are hoping to support with our training strategy is fixation behavior, because AMD patients tend to alter it, leading to further deterioration of vision. In order to create a valid training program, we conduct experiments to evaluate \u201cfree\u201d eye movement behavior with respect to its \u201cfixation quality\u201d. The next step will be to test various training methods for efficiency and level of invasiveness.<\/p>\n\n\n\n At a later stage, we will develop a training concept for everyday use. Initially, visual field defects will be simulated in VR. Training methods include the additional manipulation of visual content which optimizes the development of an eccentric fixation site (e.g. augmentation of the defect by binocular presentation, presentation of defect edge areas, or systematic masking of image content). The training program will later be applied and validated on AMD patients in real environments.<\/p>\n<\/div><\/div>\n\n\n\n can be a real asset in the therapy of AMD patients<\/p>\n<\/div>\n\n\n\n will be based on real needs and real situations<\/p>\n<\/div>\n\n\n\n has to be validated based on virtual data and real people<\/p>\n<\/div>\n\n\n\n can be done remotely (e.g. at home)<\/p>\n<\/div>\n<\/div>\n\n<\/div>\r\n<\/section>\r\n<\/div>\n\n\n\n As mentioned above, the IDeA project is focused on developing concepts and strategies in anticipation of hardware that is currently not available on the market. However, since mixed reality hardware development has been taken on by all big software and hardware players, it is good to know that the software will be ready to go the moment the right MR hardware is launched. AMD patients will benefit from diagnostics, training, and assistance systems in a way that is unheard of today \u2014 but will be standard in the (near) future.<\/p>\n\n\n\n![\"\"](\"https:\/\/www.nmy.de\/en\/wp-content\/uploads\/sites\/5\/2025\/02\/bmbf-xr-eye-tracker-nmy-feature-03.jpg\"){kind=tracking}
<\/figure><\/div>\n\n\n\nTo summarize: The IDeA-project aims to\u2026<\/h3>\n\n\n
![\"\"](\"https:\/\/www.nmy.de\/en\/wp-content\/uploads\/sites\/5\/2025\/05\/icon-pfeil-hell-gruen.svg\"){kind=icon}
<\/figure>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\nDiagnosis with Mixed Reality: Early Detection Is Key<\/h2>\n\n\n\n
How Can We Improve Diagnostics for Patients?<\/h2>\n\n\n\n
Support and Substitute Clinical Diagnosis<\/h2>\n\n\n\n
To summarize: Diagnosis with Mixed Reality\u2026<\/h3>\n\n\n
<\/figure>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\nAn Assistance System that Actually Helps<\/h2>\n\n\n\n
![\"\"](\"https:\/\/www.nmy.de\/en\/wp-content\/uploads\/sites\/5\/2025\/02\/xr_idea_article_headset-2.jpeg\")
<\/figure>![\"\"](\"https:\/\/www.nmy.de\/en\/wp-content\/uploads\/sites\/5\/2025\/02\/600px-blog2.png\")
<\/figure><\/div>\n\n\n\nTo summarize: AR Assistance\u2026<\/h3>\n\n\n
<\/figure>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\nXR Training \u2014 An Eye Trainer of\/for the Future<\/h2>\n\n\n\n
![\"\"](\"https:\/\/www.nmy.de\/en\/wp-content\/uploads\/sites\/5\/2025\/02\/600px-blog3.png\")
<\/figure>To summarize: VR training\u2026<\/h3>\n\n\n
<\/figure>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\n<\/figure>\n\n\n\nDeveloping Software for the Future of Mixed Reality Hardware<\/h2>\n\n\n\n