A consortium of European researchers, coordinated by the Computer Vision Centre (CVC) of Universitat Autònoma de Barcelona (UAB), has developed HERMES, a cognitive computational system consisting of video cameras and software able to recognise and predict human behaviour, as well as describe it in natural language. The applications of the Hermes project are numerous and can be used in the fields of intelligent surveillance, protection of accidents, marketing, psychology, etc.
HERMES (Human Expressive Graphic Representation of Motion and their Evaluation in Sequences) analyses human behaviour based on video sequences captured at three different focus levels: the individual as a relatively distant object; the individual's body at medium length so as to be able to analyse body postures; and the individual's face, which allows a detailed study of facial expressions. The information obtained is processed by computer vision and artificial intelligence algorithms, which permits the system to learn and recognise movement patterns.
HERMES offers two important innovations in the field of computer vision. The first is the description of in natural language movement captured by the cameras, through simple and precise phrases which appear on the computer screen in real time, together with the frame number in which the action is taking place. The system uses an avatar to talk and describe this information in different languages. The second innovation is the possibility to analyse and discover potentially unusual behaviour - based on the movements it recognises - and give off warning signals. For example, HERMES sends a signal to the control centre of an underground station after capturing the image of someone trying to cross the tracks, or alerts a medical centre if an elderly person living alone falls.
Seven different sub-projects have been developed by researchers working on the HERMES project:
The application advantages of HERMES are obvious, mainly in the fields of intelligent surveillance and the prevention of accidents or crimes. However, researchers consider that there is much to be gained with the use of this tool in sectors such as marketing or psychology.
The HERMES project was coordinated by Juan José Villanueva, emeritus professor of the Department of Computer Science at UAB and former director of the CVC, a position he held for 14 years.
HERMES, which has received several scientific awards in many of the top specialised conferences, was carried out as part of the 6th European Research Framework Programme. The project, lasting three and a half years and with 2,100,000 euros in funding, included the participation of five of the field's most prominent research groups in Europe and of a firm specialising in information and communication technologies: the Computer Vision Centre at UAB, Spain, which worked as project coordinator; the Institut für Algorithmen und Kognitive Systeme (IAKS) at the University of Karlsruhe, Germany; the Computer Vision and Media Technology Laboratory (CVMT) at the University of Aalborg, Denmark; the Computer Vision Laboratory (BIWI) at the ETH -Eidgenoesssiche Technische Hochschule Zürich, Switzerland; the Active Vision Laboratory (AVL) at Oxford University, United Kingdom; and Answare Technologies, Spain.
AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert! system.