Public Release: 

Virtual reality technology opens new doors of (spatial) perception

Using immersive technology in the lab has enabled researchers to study sound perception in realistic settings

Acoustical Society of America

IMAGE

IMAGE: A mannequin wears a VR headset in an anechoic chamber to measure the effects of simulated sound cues from different positions. view more 

Credit: Keli Lawrence

WASHINGTON, D.C., May 9, 2018 -- We rely on our ears to tell us where sounds -- from the chirp of a bird to the call of your name in a crowd -- are coming from. Locating and discriminating sound sources is extremely complex because the brain has to process spatial information from many, sometimes conflicting, cues. Using virtual reality and other immersive technologies, researchers are able to use new methods to investigate how we make sense of the word with sound.

"These technologies allow us to bring the real world into the lab and, ultimately, the lab into the real world," said G. Christopher Stecker, associate professor of hearing and speech sciences at Vanderbilt University. Stecker uses these immersive tools to probe auditory spatial awareness in naturalistic, yet controlled settings. He foresees that these technologies will yield improved hearing aids, more accurate diagnoses of auditory disorders, and video games with richer sound experiences.

This 360-degree view helps us direct our attention to where sounds originate -- crucial for navigating the environment to avoid danger, like detecting an oncoming car.

At the 175th Meeting of the Acoustical Society of America, held May 7-11, 2018, in Minneapolis, Minnesota, Stecker will survey his team's use of virtual reality and augmented auditory reality to study how people use explicit and implicit sound cues.

In an ongoing study, subjects wear head-mounted displays, immersing them in a parklike setting, and are told to turn their heads in the direction they hear sound. In the background, doctoral student Travis Moore manipulates two essential locational cues. The first is a difference in time -- measured in millionths of a second -- when sound waves reach each ear. The other is the difference in sound pressure levels registered in each ear.

Consistent with earlier work, Moore has found considerable variability in how much weight subjects' brains assign to each cue. "This is an important step because we really don't know how this process of integrating two cues plays out in real-world listening tasks," Stecker said.

Another ongoing study, meant to simulate a busy cocktail party, looks at how differences in acoustics and the resultant differences in sound qualities, echoes and reverberations influence spatial awareness. "In the ear, there's a very clear representation of sound frequency and intensity, or loudness, but place has to be computed by the brain," Stecker said. "The ear doesn't know where things are. The brain figures it out."

Stecker imagines that studies examining these more implicit aspects of spatial awareness could lead to augmented reality devices that remotely render realistic virtual versions of people. "Consider a chat with your grandmother," Stecker said. "This kind of technology could make it look and sound as if she were sitting on the couch across from you. To achieve that on the sound side, we will need to make the acoustics of that simulation indistinguishable from the real world."

###

Presentation 3aAA1 "Validating auditory spatial awareness with virtual reality and vice-versa," by G. Christopher Stecker, is at 8:55 a.m. CDT, May 9, 2018, in room Nicollet C at the Hyatt Regency Minneapolis.

MORE MEETING INFORMATION

The 175th Meeting of the Acoustical Society of America

The meeting is being held May 7-11, 2018, in Minneapolis, Minnesota.

USEFUL LINKS

Main meeting website: http://acousticalsociety.org/asa-meetings/

Technical program: http://acousticalsociety.org/program-of-175th-meeting-of-the-acoustical-society-of-america/

Meeting/Hotel site: http://acousticalsociety.org/asa-meetings/

Press Room: http://acoustics.org/world-wide-press-room/

WORLD WIDE PRESS ROOM

In the coming weeks, ASA's Worldwide Press Room will be updated with additional tips on dozens of newsworthy stories and with lay language papers, which are 300- to 500-word summaries of presentations written by scientists for a general audience and accompanied by photos, audio and video. You can visit the site during the meeting at http://acoustics.org/current-meeting/.

PRESS REGISTRATION

We will grant free registration to credentialed journalists and professional freelance journalists. If you are a reporter and would like to attend, contact Emilie Lorditch (elorditc@aip.org, 301-209-3029), who can also help with setting up interviews and obtaining images, sound clips or background information.

LIVE MEDIA WEBCAST

A press briefing featuring a selection of newsworthy research will be webcast live from the conference on Tuesday, May 8, 2018; register at http://aipwebcasting.com/webcast/registration/518asa.php to watch online. Topics and times to be announced.

ABOUT THE ACOUSTICAL SOCIETY OF AMERICA

The Acoustical Society of America (ASA) is the premier international scientific society in acoustics devoted to the science and technology of sound. Its 7,000 members worldwide represent a broad spectrum of the study of acoustics. ASA publications include The Journal of the Acoustical Society of America (the world's leading journal on acoustics), Acoustics Today magazine, books, and standards on acoustics. The society also holds two major scientific meetings each year. For more information about ASA, visit our website at http://www.acousticalsociety.org.

Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.