SmartHMD for Improved Mobility

James Weiland

Status: Completed

Conditions: Low Vision; Orientation; Navigation, Spatial; Visual Impairment; Mobility Limitation

Treatments: Device: SmartHMD version 3; Device: SmartHMD version 2; Device: SmartHMD version 4; Device: SmartHMD version 1

Study type: Interventional

Funder types: Other

Identifiers

NCT03781583

HUM00141598

Details and patient eligibility

About

The National Eye Institute estimated about 3 million people over age 40 in the US had low vision in 2010 and projects an increase to nearly 5 million in 2030 and 9 million in 2050. Current assistive technologies are a patchwork of mostly low-technology aids with limited capabilities that are often difficult to use, and are not widely adopted. This shortfall in capabilities of assistive technology often stems from lack of a user-centered design approach and is a critical barrier to improve the everyday activities of life (EDAL) and the quality of life (QOL) for individuals with low vision.

An intuitive head mounted display (HMD) system on enhancing orientation and mobility (O&M) and crosswalk navigation, could improve independence, potentially decrease falls, and improve EDAL and QOL. The central hypothesis is that an electronic navigation system incorporating computer vision will enhance O&M for individuals with low vision. The goal is to develop and validate a smartHMD by incorporating advanced computer vision algorithms and flexible user interfaces that can be precisely tailored to an individual's O&M need. This project will address the specific question of mobility while the subject crosses a street at a signaled crosswalk. This is a dangerous and difficult task for visually impaired patients and a significant barrier to independent mobility.

Full description

This study was originally intended as a single-arm study. Early results and unanticipated events related to component availability made it clear that multiple configurations of the device would be necessary to produce a functional device. Therefore, the study was split into multiple cohorts representing each iteration of the device and testing process, as follows:

As the trial progressed, the participants recruited were consistently unable to perform tasks without smartHMD. This is due to the recruitment of participants with severe vision loss. Due to this finding, data was only acquired when participants used the smartHMD when active instead of collecting data with and without the system being active.

The participants performed a subset of experiments due to time constraints. Some performed only outdoor trials; some performed only indoor trials; others performed both. The outcome measures depend on which experiments were performed.

After the first test involving the initial three participants, the ODG system became unsupported by the company that produced the device. In response, the study team developed a prototype system (RGBD), which was used in the ODG system's place for the remaining tests. The RGBD was initially used indoors with laptop and subsequently outdoors with mobile hardware and new software.

Enrollment: 21 patients

Sex: All

Ages: 14 to 89 years old

Volunteers: Accepts Healthy Volunteers

Inclusion criteria

• Diagnosed with low vision
• Self reported difficulty with mobility and finding doors (either indoors or outdoors) and using signalized crosswalks.
• Ability to cooperate for tests
• Able to participate in all visits

Exclusion criteria

• Unable to use head mounted display technology
• Unstable age-related macular degeneration within the past 3 months
• Unstable diabetic retinopathy within the past 3 months
• Unstable diabetes within the past 3 months
• Ocular infection or ocular inflammation in the past 3 months
• Ocular trauma within the past 6 months
• Intraocular surgery within 6 months
• Optical coherence tomography retinal findings of concern to investigator for unstable vision during the study
• Women who are pregnant (due to risk of falls and change in gait).
• Uncontrolled seizure disorder in the past 6 months
• Cerebrovascular accident occurring in the past 6 months
• Parkinson disease or neurological condition that limits mobility
• Alzheimer disease or other forms of dementia
• Conditions of concern to investigator that would confound orientation and mobility, such as severe arthritis, pain that limits ambulatory activities, or orthopedic surgery (e.g., hand, arm, shoulder, knee, or hip surgery within 12 months)

Trial design

Primary purpose: Other

Allocation: Non-Randomized

Interventional model: Single Group Assignment

Masking: None (Open label)

---

21 participants in 4 patient groups

Outdoor and ODG

Experimental group

Description:

Participants used the first version of the SmartHMD device, which used custom software running on commercially available ODG R7 smart glasses and accompanying earbuds. Participants used the device to navigate across an outdoor crosswalk.

Treatment:

Device: SmartHMD version 1

Indoor and Laptop

Experimental group

Description:

Participants use the second version of the SmartHMD device, which uses RGB-D smart glasses, custom software running on a laptop, and bone-conducting earphones. Participants use the device to locate the door within an indoor course.

Treatment:

Device: SmartHMD version 2

RGBD & Jetson - Indoor Course

Experimental group

Description:

Participants use a new iteration of the SmartHMD device, which uses RGB-D smart glasses, bone-conducting earphones, a Jetson mobile computer, and custom software. Participants use the device to navigate their way through an indoor course.

Treatment:

Device: SmartHMD version 3

RGBD & Jetson - Outdoor Crosswalk

Experimental group

Description:

Participants use the SmartHMD device, which uses RGB-D smart glasses, bone-conducting earphones, a Jetson mobile computer, and a specific version of custom software. Participants use the device to navigate their way through an outdoor crosswalk.

Treatment:

Device: SmartHMD version 4