News Release

Virtual games help the blind navigate unknown territory

Peer-Reviewed Publication

The Journal of Visualized Experiments

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

video: This video is Dr. Merabet's article as it appears in JoVE. view more 

Credit: <a target="_Blank"href="http://Jove.com">Jove.com</a>

On March 27th JoVE (Journal of Visualized Experiments) will publish a new video article by Dr. Lotfi Merabet showing how researchers in the Department of Ophthalmology at Massachusetts Eye and Ear Infirmary and Harvard Medical School have developed a virtual gaming environment to help blind individuals improve navigation skills and develop a cognitive spatial map of unfamiliar buildings and public locations.

“For the blind, finding your way or navigating in a place that is unfamiliar presents a real challenge,” Dr. Merabet explains. "As people with sight, we can capture sensory information through our eyes about our surroundings. For the blind that is a real challenge… the blind will typically use auditory and tactile cues."

The technique utilizes computer generated layouts of public buildings and spatial sensory feedback to synthesize a virtual world that mimics a real world navigation task. In the game, participants must find jewels and carry them out of the building, without being intercepted by roaming monsters that steal the jewels and hide them elsewhere. Participants interface with the virtual building by using a keyboard and wearing headphones that play auditory cues that help spatially orient them to the world around them. This interaction helps users generate an accurate mental layout of the mimicked building. Dr. Merabet and his colleagues are also exploring applications of this technology with other user interfaces, like a Wii Remote or joystick.

"We have developed software called ABES, the Audio Based Environment Simulator that represents the actual physical environment of the Carol Center for the Blind in Newton Massachusetts. The participants will use the game metaphor to get a sense of the whole building through open discovery, allowing people to learn room layouts more naturally than if they were just following directions."

The technology will invariably be useful for the 285 million blind people world-wide, 6 million of which live in the United States. It will also have applications beyond the blind community for individuals with other visual impairments, cognitive deficits, or those recovering from brain injuries.

Dr. Merabet considers publication in JoVE's video format especially helpful. "It is conceptually difficult for a sighted person to understand 'a video game for blind people.' What JoVE allows us to do is break down layouts of the game and strategy, show how the auditory cues can be used and how we quantify performance going from the virtual game to the physical world."

###

Merabet et. al.; http://www.jove.com/video/50272/development-an-audio-based-virtual-gaming-environment-to-assist-with

About JoVE, the Journal of Visualized Experiments:

JoVE, the Journal of Visualized Experiments, is the first and only PubMed/MEDLINE-indexed, peer-reviewed journal devoted to publishing scientific research in a video format. Using an international network of videographers, JoVE films and edits videos of researchers performing new experimental techniques at top universities, allowing students and scientists to learn them much more quickly. As of March 2013, JoVE has published video-protocols from an international community of nearly 6,000 authors in the fields of biology, medicine, chemistry, and physics.

URL: http://www.jove.com

To link to this release, please use this link: http://www.jove.com/about/press-releases/55/new-early-warning-system-for-brain-development-babies-published-video

Contact:
Rachel Greene
Marketing Director
The Journal of Visualized Experiments
p. 617-250-8451
e. press@jove.com

Press Access

We offer complimentary access to verified press contacts. If you are interested in being on our press list, please create an account and send an email request to press@jove.com.

Please make sure to follow our Twitter account. If you have any questions or requests, contact us at press@jove.com.


Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.