News Release

SideBySide projection system enables projected interaction between mobile devices

Disney, Carnegie Mellon researchers develop new type of interaction

Peer-Reviewed Publication

Carnegie Mellon University

PITTSBURGH—Researchers at Disney Research, Pittsburgh, and Carnegie Mellon University have devised a system called SideBySide that enables animated images from two separate handheld projectors to interact with each other on the same surface.

The system, suitable for games, education and a variety of other applications, is self-contained in special handheld devices. No external cameras or other sensors are required, which enables people to use the projectors to interact with each other anywhere and at anytime. SideBySide also can be used to exchange contact information, or even share data files. The technology can spur a more participatory and intimate style of interaction than is possible with computers or overhead projectors.

"Smartphones have made it possible for us to communicate, play games and retrieve information from the Web wherever we might be, but our interaction with the devices remains a largely solitary, single user experience," said Karl D.D. Willis, a Ph.D. candidate in computational design at Carnegie Mellon and a lab associate at Disney Research. "Now that handheld projectors have become a reality, we finally have a technology that allows us to create a new way for people to interact in the real world."

The handheld projectors are hybrid devices that emit both visible and infrared light and contain a camera for monitoring the projected images, a ranging sensor and an inertial measurement unit.

The infrared channel plays a key role in enabling interaction. It is used to project markers that help the system recognize when the images are moving or overlapping and to communicate information between the devices.

The researchers have developed a number of applications to demonstrate the capabilities of the technology. Games include Boxing, in which matches are performed without a ring; Cannon, in which players knock a stack of bricks off a platform by firing a cannon ball from one screen to another; and Gorilla, in which one player uses a plane and a net to catch the other player's gorilla. They also have developed a 3D viewer, which allows two users to control and explore a 3D model together, and applications for exchanging contact information and transferring files. A question & answer application can be used to teach basic vocabulary to young children.

A video demonstrating SideBySide can be viewed at http://www.disneyresearch.com/research/projects/hci_sidebyside_drp.htm

Willis will discuss SideBySide on Wednesday, Oct. 19 at the Association for Computing Machinery's Symposium on User Interface Software and Technology (UIST) in Santa Barbara, Calif. Conference organizers already have presented SideBySide with UIST's best paper and best demonstration awards. In addition to Willis, the SideBySide development team included Ivan Poupyrev and Moshe Mahler of Disney Research and Scott Hudson, professor in Carnegie Mellon's Human-Computer Interaction Institute.

###

About Carnegie Mellon University: Carnegie Mellon (www.cmu.edu) is a private, internationally ranked research university with programs in areas ranging from science, technology and business, to public policy, the humanities and the arts. More than 11,000 students in the university's seven schools and colleges benefit from a small student-to-faculty ratio and an education characterized by its focus on creating and implementing solutions for real problems, interdisciplinary collaboration and innovation. A global university, Carnegie Mellon's main campus in the United States is in Pittsburgh, Pa. It has campuses in California's Silicon Valley and Qatar, and programs in Asia, Australia, Europe and Mexico. The university is in the midst of a $1 billion fundraising campaign, titled "Inspire Innovation: The Campaign for Carnegie Mellon University," which aims to build its endowment, support faculty, students and innovative research, and enhance the physical campus with equipment and facility improvements.

Disney Research (www.disneyresearch.com) was launched in 2008 as an informal network of research laboratories that combine the best of academia and industry. The family of labs consists of Disney Research, Pittsburgh (collocated with Carnegie Mellon University); Disney Research, Zurich (collocated with The Swiss Federal Institute of Technology/ETH); Disney Research, Boston; Walt Disney Imagineering Research; Walt Disney Animation Studios Research; and Pixar Research Group. With more than 150 active employees and collaborators, these research labs partner with each of the business units of The Walt Disney Company to work on a broad range of commercially important challenges.. We encourage engagement with the global research community and view publication as a principal mechanism for quality control. We are honoring Walt Disney's legacy of innovation by exploring novel technologies and our research has applications that are experienced by millions of people around the globe. Disney Research is a dba of Walt Disney Imagineering Research & Development, Inc. (WDI R&D).


Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.