S3P 2015 Tutorial 1

Social Signal Processing, Prof. Nicu Sebe, Università degli Studi di Trento (IT)


Social perception is the main channel through which human beings access the social world, very much like vision and hearing are channels through which people access the physical world. For a long time, researchers have addressed the computational implementation of vision and hearing in domains like computer vision and speech recognition, but only early attempts have been made to do the same with social perception. We believe social perception to be one of the missing links in the communication between humans and computers, and so this tutorial will present the state of the art in social signals analysis (e.g., head pose, body gestures and posture, facial expressions, eye gaze). We will concentrate on gesture and behavior modeling and recognition, with an emphasis on sensing and understanding users’ interactive actions and intentions for achieving multimodal human-computer interaction in natural settings, in particular pertaining to human dynamic face and body behavior in context dependent situations (task, mood/affect). Perspectives on multisensory observation will be addressed. 



Nicu Sebe is a professor in the University of Trento, Italy, where he is the dean of the doctoral school in ICT and is leading the research in the areas of multimedia information retrieval and human-computer interaction in computer vision applications. He was involved in the organization of the major conferences and workshops addressing the computer vision and human-centered  aspects of multimedia information retrieval, among which as a General Co-Chair of the IEEE Automatic Face and Gesture Recognition Conference, FG 2008, ACM International Conference on Image and Video Retrieval (CIVR) 2007 and 2010. He was a General Chair of ACM Multimedia 2013 and a Program Chair of ACM Multimedia 2011 and 2007. He will be a Program Chair of ECCV 2016, ICCV 2017, and ICMR 2017.  Currently he is the ACM SIGMM Director of Cenferences. He has been a visiting professor in the Beckman Institute, University of Illinois at Urbana-Champaign and in the Electrical Engineering Department, Darmstadt University of Technology, Germany. He is a co-chair of the IEEE Computer Society Task Force on Human-centered Computing and is an associate editor of IEEE Transactions on Multimedia, Computer Vision and Image Understanding, Machine Vision and Applications, Image and Vision Computing, International Journal of Human-computer Studies and of Journal of Multimedia. He is a fellow of IAPR and a Senior member of ACM and IEEE.