R33EY033689

Vis4ion-Thailand (Visually Impaired Smart Service System for Spatial Intelligence and Onboard Navigation) - RESUB - 1 - Project Summary/Abstract

Visual impairment engenders mobility losses, debility, illness, and premature mortality. These mobility losses have been associated with unemployment rates that reach 80% globally and to severe compromises in quality of life (QOL). In many cases, health and wellbeing are 'attacked' by vision loss in any form factor, and psychosocial barriers such as anxiety and depression are compounding influences that increase as deficits scale.

The fear of falling is a threat that contributes to this downward 'spiral' and often goes unchecked; this fear is alarmingly justified, as visual impairment precipitates substantial increases in mechanical trips, falls, and long-bone fractures. This perfect storm leaves considerable swaths of the population poor, disenfranchised, and experiencing adverse health outcomes.

These startling facts, although true in almost every high-income country, are even more severe in low- and middle-income countries, such as Thailand. When considered at a basic functional level, visual impairment destroys access to information about our three-dimensional world and the objects in it, leading to poor spatial cognition and an inability to navigate successfully, whether that be to a place of employment or a grocery store.

Advanced wearables provide a potential solution to close this gap and provide consistent and reliable access to the information needed for mobility and orientation during navigation. Our team was instrumental in developing a novel wearable - Vis4ion (Visually Impaired Smart Service System for Spatial Intelligence and Onboard Navigation), a personal mobility solution that serves as a customizable, human-in-the-loop, sensing-to-feedback platform to deliver functional assistance in real-time.

Our central hypothesis is that wearables support spatial cognition in visually impaired (VI) populations, augmenting personal freedom and agency, and promoting health and wellbeing. We seek to enhance this technology with next-generation mapping and localization software fashioned into a microservice to support spatial cognition in the VI. We will assess the performance of this new approach (e.g., mapping) as well as its impact on function (e.g., navigation efficiency), health (e.g., falls), and wellness (e.g., QOL) metrics.

The proposal has five aims in two phases focused on validating this approach in a global setting. First, we will implement semantic segmentation and image-query-based localization networks in a small Thai campus to operate independently of both environmental (sensor-based) and Wi-Fi/cell infrastructure. We will then deploy this augmented platform with VI students. Third, we will assess for acceptability, appropriateness, and feasibility, focusing on experiences with Vis4ion. If milestones are met for this first phase (R21), we will progress to the second phase (R33).

Fourth, we will test the effectiveness of the improved system over an extended-use period. Lastly, an additional urban area in Bangkok will be selected, and a 3D environmental map built for generalizability testing, ensuring that Vis4ion is able to handle multiple locations with disparate contextual elements. Given this foundation and planned advances, we predict the platform will substantially mitigate fall and immobility risks and associated adverse health outcomes.

New York University

NOT APPLICABLE

93.867 - Vision Research

National Eye Institute (NEI) [HHS - NIH]

New York, New York 100165818 United States

Single Zip Code

Mobile Health: Technology and Outcomes in Low and Middle Income Countries (R21/R33 - Clinical Trial Optional) (PAR-19-376)

Amendment Since initial award the total obligations have increased 99% from $288,651 to $573,623.