ZURICH – Animatronics aims at creating physical robots that move and look like real humans. Many impressive characters have been created in this spirit, like those in the Hall of Presidents attraction at Walt Disney World. Until now, creating animatronic copies of real human individuals is a difficult and labor-intensive process requiring the manual work of skilled animators, material designers and mechanical engineers. Researchers at Disney Research, Zürich, ETH Zürich, and Walt Disney Imagineering R&D have developed a new computational design process for cloning human faces that could greatly simplify the creation of synthetic skin for animatronic characters.
Due to its expressive power, replicating the human face presents huge challenges. To deliver compelling and realistic performances, an animatronic character must produce a vast range of facial expressions, each having different deformations and wrinkles. Manually designing the shape and material properties of a single skin that is able to achieve all of these targets is a formidable task. The Zürich researchers, however, invented a computational method for automatically designing synthetic skin to match real individuals.
The process starts by scanning 3D facial expressions from a human subject. Then, a novel optimization scheme determines the shape of the synthetic skin as well as control parameters for the robotic head that provide the best match to the human subject. This processing increases the realism of the resulting character, resulting in an animatronic face that closely resembles the human subject.
"With our method, we can simply create a robotic clone of a real person," said Dr. Bernd Bickel, researcher at Disney Research, Zürich. "The custom digitally designed skin can be fabricated using injection molding and modern rapid prototyping technology. We 3D print a mold and use elastic silicon with properties similar to human skin as base material". Their findings were presented at ACM SIGGRAPH 2012, the International Conference on Computer Graphics and Interactive Techniques.
"Our research focuses on the creation of the silicone skin," explained Dr. Peter Kaufmann, researcher at Disney Research, Zürich. "We use computation to carefully modify the thickness of the skin across the face, leading to deformations that closely match those of the real human."
Prof. Markus Gross, director of Disney Research, Zürich, applauded the results, stating, "This innovative research builds upon our heritage in 'Audio-Animatronics' pioneered by Walt Disney himself. Physical face cloning enables us to create personalized animatronic figures based on real individuals with a level of fidelity and realism never before possible."
In addition to Dr. Bickel and Dr. Kaufmann, the research team included Melina Skouras and Thabo Beeler, PhD students at ETH Zürich and associate researchers at Disney Research, Dr. Bernhard Thomaszewski and Dr. Derek Bradley, postdoctoral researchers at Disney Research, Zürich, Phil Jackson, Imagineer at Walt Disney Imagineering R&D, Prof. Steve Marschner, associate professor at Cornell University, Prof. Wojciech Matusik, associate professor at MIT, and Prof. Markus Gross, director of Disney Research, Zürich.
For more information, please visit the web site at http://www.disneyresearch.com/research/projects/m_PhysicalFaceCloning_drz.htm
About Disney Research
Disney Research is a network of research laboratories supporting The Walt Disney Company. Its purpose is to pursue scientific and technological innovation to advance the company's broad media and entertainment efforts. Disney Research is managed by an internal Disney Research Council co-chaired by Disney-Pixar's Ed Catmull and Walt Disney Imagineering's Bruce Vaughn, and including the directors of the individual labs. It has facilities in Los Angeles, San Francisco, Pittsburgh, Boston and Zurich. Research topics include computer graphics, video processing, computer vision, robotics, radio and antennas, wireless communications, human-computer interaction, displays, data mining, machine learning and behavioral sciences.