image: This is a demonstration of magnifying smartphone application using Google Glass for visually impaired. view more
Credit: Gang Luo, Ph.D.
(BOSTON) - Researchers from the Schepens Eye Research Institute of Massachusetts Eye and Ear/Harvard Medical School have developed a smartphone application that projects a magnified smartphone screen to Google Glass, which users can navigate using head movements to view a corresponding portion of the magnified screen. They have shown that the technology can potentially benefit low-vision users, many of whom find the smartphone's built-in zoom feature to be difficult to use due to the loss of context. Their results are published online in the journal IEEE Transactions on Neural Systems and Rehabilitation Engineering.
"When people with low visual acuity zoom in on their smartphones, they see only a small portion of the screen, and it's difficult for them to navigate around -- they don't know whether the current position is in the center of the screen or in the corner of the screen," said senior author Gang Luo, Ph.D., associate scientist at Schepens Eye Research Institute of Mass. Eye and Ear and an associate professor of ophthalmology at Harvard Medical School. "This application transfers the image of smartphone screens to Google Glass and allows users to control the portion of the screen they see by moving their heads to scan, which gives them a very good sense of orientation."
An estimated 1.5M Americans over the age of 45 suffer from low vision -- severe visual impairment caused by a variety of conditions. People with low vision often have great difficulty reading and discerning fine details. Magnification is considered the most effective method of compensating for visual loss. The researchers developed the head-motion application to address the limitations of conventional smartphone screen zooming, which does not provide sufficient context and can be painstaking to navigate.
In an evaluation of their new technology, the researchers observed two groups of research subjects (one group that used the head-motion Google Glass application and the other using the built-in zoom feature on a smart phone) and measured the time it took for them to complete certain tasks. The researchers showed that the head-based navigation method reduced the average trial time compared to conventional manual scrolling by about 28 percent.
As next steps for the project, the researchers would like to incorporate more gestures on the Google Glass to interact with smartphones. They would also like to study the effectiveness of head-motion based navigation compared to other commonly-used smartphone accessibility features, such as voice-based navigation.
"Given the current heightened interest in smart glasses, such as Microsoft's Hololens and Epson's Moverio, it is conceivable to think of a smart glass working independently without requiring a paired mobile device in near future." said first author Shrinivas Pundlik, Ph.D. "The concept of head-controlled screen navigation can be useful in such glasses even for people who are not visually impaired."
To view a demonstration of the technology, please view this video created by the researchers.
###
Authors on the IEEE Transactions on Neural Systems and Rehabilitation Engineering paper include last author Gang Luo, Ph.D., first author Shrinivas Pundlik, Ph.D., Huaqi Yi, Rui Liu, M.D., Ph.D., and Eli Peli, O.D., of Schepens Eye Research Institute of Massachusetts Eye and Ear and Harvard Medical School.
This research study was supported by an unrestricted gift from Google, Inc, and the Eleanor and Miles Shore Fellowship Award of Harvard Medical School.
About Massachusetts Eye and Ear
Mass. Eye and Ear clinicians and scientists are driven by a mission to find cures for blindness, deafness and diseases of the head and neck. Now united with Schepens Eye Research Institute, Mass. Eye and Ear is the world's largest vision and hearing research center, developing new treatments and cures through discovery and innovation. Mass. Eye and Ear is a Harvard Medical School teaching hospital and trains future medical leaders in ophthalmology and otolaryngology, through residency as well as clinical and research fellowships. Internationally acclaimed since its founding in 1824, Mass. Eye and Ear employs full-time, board-certified physicians who offer high-quality and affordable specialty care that ranges from the routine to the very complex. U.S. News & World Report's "Best Hospitals Survey" has consistently ranked the Mass. Eye and Ear Departments of Otolaryngology and Ophthalmology as top in the nation. For more information about life-changing care and research, or to learn how you can help, please visit MassEyeAndEar.org.
About Harvard Medical School Department of Ophthalmology
The Harvard Medical School (HMS) Department of Ophthalmology is one of the leading and largest academic departments of ophthalmology in the nation. More than 350 full-time faculty and trainees work at nine HMS affiliate institutions, including Massachusetts Eye and Ear, Schepens Eye Research Institute of Massachusetts Eye and Ear, Massachusetts General Hospital, Brigham and Women's Hospital, Boston Children's Hospital, Beth Israel Deaconess Medical Center, Joslin Diabetes Center/Beetham Eye Institute, Veterans Affairs Boston Healthcare System, VA Maine Healthcare System, and Cambridge Health Alliance. Formally established in 1871, the department has been built upon a strong and rich foundation in medical education, research, and clinical care. Through the years, faculty and alumni have profoundly influenced ophthalmic science, medicine, and literature--helping to transform the field of ophthalmology from a branch of surgery into an independent medical specialty at the forefront of science.
Journal
IEEE Transactions on Neural Systems and Rehabilitation Engineering