Sergio Escalera
Dept. Matemātica Aplicada i AnālisiUniversitat de Barcelona
Gran Via de les Corts Catalanes 585
08007, Barcelona, Spain
sergio (at) maia (dot) ub (dot) es
Human Pose Recovery and Behavior Analysis
Projects and Research Applications
Sign recognition deals with the problem of detecting hand locations and analyze their structure and movement to determine actions
and gestures.
Hyperactivity disorder analysis: in this project we automatically extract a set of pose and behavior indicators in order to support
diagnostic of hyperactivity desorder.
Physiotherapy and sports corporal analysis: in this project we automatically extract a set of human landmarks and measure corporal
indicators from RGBD data for physiotherapy, rehabilitation, and fitness conditioning.
In this project we monitorize impaired people in order to automatically detect behaviors of patients in hospitals, such as pain or
agitation, and consequently send a report to the psysician.
Conversational indicators related to Social Signal Processing.
Human Action/Gesture recognition is a challenging area of research that deals with the problem of recognizing people in images, detecting
and describing body parts, inferring their spatial configuration, and performing action/gesture recognition from still images or image
sequences, also including multi-modal data. Because of huge space of human configurations, body pose recovery is a difficult problem
that involves dealing with several distortions: illumination changes, partial occlusions, changes in the point of view, rigid and
elastic deformations, or high inter and intra-class variability, just to mention a few. Even with the high difficulty of the problem,
modern Computer Vision techniques and new tendencies deserve further attention, and promising results are expected in the next years.
Moreover, several subareas have been recently defined, such as Affective Computing, Social Signal Processing, Human Behavior Analysis,
or Social Robotics. The effort involved in this area of research will be compensated by its potential applications: TV production,
home entertainment (multimedia content analysis), education purposes, sociology research, surveillance and security, improved quality
live by means of monitoring or automatic artificial assistance, etc.
Smart Environments and Assisted Living from RGBD
HuPBA news and prizes
2007 IBPRIA 2007 Best paper award
2010 First prize at PASCAL VOC Human Layout Analysis 2010, ECCV 2010.
HUPBA from Smart Phones
Multi-modal and multi-view HuPBA
3D HuPBA avatars in Virtual and Augmented Reality
Social networks
Multi-modal Assisted Living
Social robotics
Medical Imaging in 3D PET/CT Human data and GPGPU:
-Linfoma segmentation
-Mental disorder analysis
Google Image 8/5/2013
Human Computer Interacttion and Smart Cities (Living labs and smart environments)
Facial analysis and affective computing
HuPBA partners and collaborators
