Dept. Matemātica Aplicada i Anālisi
Universitat de Barcelona
Gran Via de les Corts Catalanes 585
08007, Barcelona, Spain
sergio (at) maia (dot) ub (dot) es
Human Pose Recovery and Behavior Analysis
Projects and Research Applications
Sign recognition deals with the problem of detecting hand locations and analyze their structure and movement to determine actions and gestures.
Spanish sign language recognition video sample
Hyperactivity disorder analysis: in this project we automatically extract a set of pose and behavior indicators in order to support diagnostic of hyperactivity desorder.
Physiotherapy and sports corporal analysis: in this project we automatically extract a set of human landmarks and measure corporal indicators from RGBD data for physiotherapy, rehabilitation, and fitness conditioning.
In this project we monitorize impaired people in order to automatically detect behaviors of patients in hospitals, such as pain or agitation, and consequently send a report to the psysician.
Agitation detection video sample
Conversational indicators related to Social Signal Processing.
Application in criminal mediation processes video sample
Human Action/Gesture recognition is a challenging area of research that deals with the problem of recognizing people in images, detecting and describing body parts, inferring their spatial configuration, and performing action/gesture recognition from still images or image sequences, also including multi-modal data. Because of huge space of human configurations, body pose recovery is a difficult problem that involves dealing with several distortions: illumination changes, partial occlusions, changes in the point of view, rigid and elastic deformations, or high inter and intra-class variability, just to mention a few. Even with the high difficulty of the problem, modern Computer Vision techniques and new tendencies deserve further attention, and promising results are expected in the next years. Moreover, several subareas have been recently defined, such as Affective Computing, Social Signal Processing, Human Behavior Analysis, or Social Robotics. The effort involved in this area of research will be compensated by its potential applications: TV production, home entertainment (multimedia content analysis), education purposes, sociology research, surveillance and security, improved quality live by means of monitoring or automatic artificial assistance, etc.
ADiBAS project webpage
ADiBAS video sample
Smart Environments and Assisted Living from RGBD
Public data
Pose Recovery Video Sample
Gesture Recognition Video Sample
HuPBA news and prizes
2007 IBPRIA 2007 Best paper award
2010 First prize at PASCAL VOC Human Layout Analysis 2010, ECCV 2010.
2011 Grant from AMIC UAB to Sergio Escalera as best PhD Thesis on informatics
2012 Sergio Escalera research for aging well - Ministry of Health directory  
2012 RECERCAIXA grant for aging well - Video sample of the project 
2012 HuPBA Chalearn demonstrator 2012 3rd Prize. Photo. News
HUPBA from Smart Phones
Video sample
Multi-modal surveillance video sample
Running detectors on iPhone
Automatic photo iPhone application
Multi-modal and multi-view HuPBA
3D HuPBA avatars in Virtual and Augmented Reality
Social networks
Multi-modal Assisted Living
Video sample - Taking a pill
Social robotics
Health and fitness conditioning examples
Video sample
HuPBA Computer Vision Center Webpage
Medical Imaging in 3D PET/CT Human data and GPGPU:
-Linfoma segmentation
-Mental disorder analysis
Google Image 8/5/2013
Human Computer Interacttion and Smart Cities (Living labs and smart environments)
Facial analysis and affective computing
Video sample1
HuPBA partners and collaborators
Video sample2
Video sample
CARE Respite 2015 promotion video
Sample 1
Sample 2
Sample 3
Multi-robot Human Computer Interaction video sample
Medical volumes