Technical Program

Nominated papers are marked with an asterisk (*).


Sunday, November 13th, 2011
15:30-17:00 Registration
Hotel lobby.


Monday, November 14th, 2011
All sessions will take place in the "Mediterráneo" room.

08:30-09:00 Registration
Hall of "Mediterráneo" room on the first floor.
09:00-09:15 Opening Remarks
Enrique Vidal, ICMI 2011 General Co-Chair
09:15-10:15 Keynote:
Still Looking at People (more info)
David Forsyth, University of Illinois at Urbana Champaign
Session chair: Nicu Sebe
10:15-10:45 Coffee Break
10:45-12:25 Oral Session 1: Affect
Session chair: Andruid Kerne
* Mining Multimodal Sequential Patterns: A Case Study on Affect Detection
Hector P. Martinez, Georgios N. Yannakakis
* Crowdsourced Data Collection of Facial Responses
Daniel McDuff, Rana el Kaliouby, Rosalind Picard
* A Systematic Discussion of Fusion Techniques for Multi-Modal Affect Recognition Tasks
Florian Lingenfelser, Johannes Wagner, Elisabeth Andre
Adaptive Facial Expression Recognition using Inter-Modal Top-Down Context
Ravi Kiran Sarvadevabhatla, Mitchel Benovoy, Victor Ng-Thow-Hing, Sam Musallam
12:25-14:00 Lunch Break
14:00-15:40 Special Session 1: Multimodal Interaction: Brain-Computer Interfacing
Session chairs: Anton Nijholt and Robert Jacob
Brain-Computer Interaction: Can Multimodality Help?
Anton Nijholt, Brendan Allison, Rob Jacob
Modality Switching and Performance in a Thought and Speech Controlled Computer Game
Hayrettin Gurkok, Gido Hakvoort, Mannes Poel
An Approach towards Human-Robot-Human Interaction using a Hybrid Brain-Computer Interface
Hachmeister Nils, Riechmann Hannes, Ritter Helge, Finke Andrea
Towards Multimodal Error Responses: A Passive BCI for the Detection of Auditory Errors
Thorsten Oliver Zander, David Marius Klippel, Reinhold Scherer
Pseudo-Haptics: From the Theoretical Foundations to Practical System Design Guidelines
Andreas Pusch, Anatole Lecuyer
15:40-16:00 Coffee Break
16:00-18:00 Poster Session
6th Senses for Everyone! The Value of Multimodal Feedback in Handheld Navigation Aids
Martin Pielot, Benjamin Poppinga, Wilko Heuten, Susanne Boll
Adding Haptic Feedback to Touch Screens at the Right Time
Yi Yang, Yuru Zhang, Zhu Hou, Betty Lemaire-Semail
Robust User Context Analysis for Multimodal Interfaces
Prasenjit Dey, Muthuselvam Selvaraj, Bowon Lee
The Picture says it all! Multimodal Interactions and Interaction Metadata
Ramadevi Vennelakanti, Prasenjit Dey, Ankit Shekhawat, Phanindra Pisupati
Mudra: A Unified Multimodal Interaction Framework
Lode Hoste, Bruno Dumas, Beat Signer
Humans and Smart Environments: A Novel Multimodal Interaction Approach
Stefano Carrino, Alexandre Peclat, Elena Mugellini, Omar Abou Khaled, Rolf Ingold
Exploiting Petri-Net Structure for Activity Classification and User Instruction within an Industrial Setting
Simon Worgan, Ardhendu Behera, Anthony Cohn, David Hogg
Jerktilts: Using Accelerometers for Eight-Choice Selection on Mobile Devices
Mathias Baglioni, Eric Lecolinet, Yves Guiard
On Multimodal Interactive Machine Translation Using Speech Recognition
Vicent Alabau, Luis Rodriguez-Ruiz, Alberto Sanchis, Pascual Martinez-Gomez, Francisco Casacuberta
Multimodal Segmentation of Object Manipulation Sequences with Product Models
Alexandra Barchunova, Robert Haschke, Mathias Franzius, Helge Ritter
Could a Dialog Save Your Life? - Analyzing the Effects of Speech Interaction Strategies while Driving
Akos Vetek, Saija Lemmela
Decisions about Turns in Multiparty Conversation: From Perception to Action
Dan Bohus, Eric Horvitz
Evaluation of User Gestures in Multi-touch Interaction: a Case Study in Pair-programming
Alessandro Soro, Samuel Aldo Iacolina, Riccardo Scateni, Selene Uras
Towards Multimodal Sentiment Analysis: Harvesting Opinions from the Web
Louis-Philippe Morency, Rada Mihalcea, Payal Doshi
The Impact of Unwanted Multimodal Notifications
David Warnock, Marilyn McGee-Lennon, Stephen Brewster
Freeform Pen-Input as Evidence of Cognitive Load and Expertise
Natalie Ruiz, Ronnie Taib, Fang Chen
Acquisition of Dynamically Revealed Multimodal Targets
Teemu Ahmaniemi
Emotional Responses to Thermal Stimuli
Katri Salminen, Veikko Surakka, Jukka Raisamo, Jani Lylykangas, Kalle Makela, Johannes Pystynen, Roope Raisamo, Teemu Ahmaniemi
An Active Learning Scenario for Interactive Machine Translation
Jesus Gonzalez-Rubio, Daniel Ortiz-Martinez, Francisco Casacuberta
Move, and I Will Tell You Who You Are: Detecting Deceptive Roles in Low-Quality Data
Nimrod Raiman, Hayley Hung, Gwenn Englebienne
Multimodal Person Independent Recognition of Workload Related Biosignal Patterns
Jan-Philip Jarvis, Felix Putze, Tanja Schultz
Study of Different Interactive Editing Operations in an Assisted Transcription System
Veronica Romero, Alejandro H. Toselli, Enrique Vidal
Dynamic Perception-Production Oscillation Model in Human-Machine Communication
Igor Jauk, Ipke Wachsmuth, Petra Wagner
The Effect of Clothing on Thermal Feedback Perception
Martin Halvey, Yolanda Vazquez-Alvarez, Graham Wilson, Stephen Brewster
Comparing Multi-Touch Interaction Techniques for Manipulation of an Abstract Parameter Space
Sashikanth Damaraju, Andruid Kerne
A General Framework for Incremental Processing of Multimodal Inputs
Afshin Ameri E., Batu Akan, Baran Curuklu, Lars Asplund
20:00 Welcome reception: Santa Barbara's Castle
18:45 - Bus departure from hotel


Tuesday, November 15th, 2011
All sessions will take place in the "Mediterráneo" room,
except for the Demonstrations and Exhibits that will be held in Terra Lucis room.

09:15-10:15 Keynote:
Learning in and from humans: Recalibration makes (the) perfect sense (more info)
Marc Ernst, Bielefeld University
Session chair: Louis-Philippe Morency
10:15-10:45 Coffee Break
10:45-12:25 Oral Session 2: Social Interaction
Session chair: Fabio Pianesi
* Detecting F-formations as Dominant Sets
Hayley Hung, Ben Krose
Toward Multimodal Situated Analysis
Chreston Miller, Francis Quek
* Finding Audio-Visual Events in an Informal Social Gathering
Xavier Alameda-Pineda, Radu Horaud, Vasil Khalidov, Florence Forbes
Please, Tell Me About Yourself: Automatic Personality Assessment Using Short Self-Presentations
Ligia Maria Batrinca, Nadia Mana, Bruno Lepri, Fabio Pianesi, Nicu Sebe
12:25-14:00 Lunch Break
14:00-15:40 Oral Session 3: Gesture and Touch
Session chair: Jordi Vitrià
Gesture-Aware Remote Controls: Guidelines and Interaction Techniques
Gilles Bailly, Dong-Bach Vo, Eric Lecolinet, Yves Guiard
The Effect of Sampling Rate on the Performance of Template-based Gesture Recognizers
Radu-Daniel Vatavu
American Sign Language Recognition with the Kinect
Zahoor Zafrulla, Helene Brashear, Thad Starner, Harley Hamilton, Peter Presti
Perceived Physicality in Audio-Enhanced Force Input
Chi-Hsia Lai, Matti Niinimaki, Koray Tahiroglu, Johan Kildal, Teemu Ahmaniemi
15:40-16:00 Coffee Break
16:00-17:00 Demonstrations, Exhibits and Doctoral Spotlight Posters
Demonstrations (Terra Lucis room)
BeeParking: An Ambient Display to Induce Cooperative Parking Behavior
Silvia Gabrielli, Jesús Muñoz, Cristina Costa
Speech Interaction in a Multimodal Tool for Handwritten Text Transcription
Maria Jose Castro-Bleda, Salvador España-Boquera, David Llorens, Andrés Marzal, Federico Prat, Juan Miguel Vilar, Francisco Zamora-Martínez
Digital Pen in Mammography Patient Forms
Daniel Sonntag, Marcus Liwicki, Markus Weber
MozArt: A Multimodal Interface for Conceptual 3D Modeling
Anirudh Sharma, Sriganesh Madhvanath, Ankit Shekhawat, Mark Billinghurst
Query Refinement Suggestion in Multimodal Image Retrieval with Relevance Feedback
Luis A. Leiva, Mauricio Villegas, Roberto Paredes
A Multimodal Music Transcription Prototype
Tomás Pérez, Jose Manuel Iñesta, Pedro Ponce de León, Antonio Pertusa
Socially-assisted Multi-view Video Viewer
Kenji Mase, Kosuke Niwa, Takafumi Marutani
Doctoral Spotlight Posters ("Mediterráneo" room)
Crowdsourced Data Collection of Facial Responses
Daniel McDuff, Rana el Kaliouby, Rosalind Picard
Toward Multimodal Situated Analysis
Chreston Miller, Francis Quek
American Sign Language Recognition with the Kinect
Zahoor Zafrulla, Helene Brashear, Thad Starner, Harley Hamilton, Peter Presti
Finding Audio-Visual Events in an Informal Social Gathering
Xavier Alameda-Pineda, Radu Horaud, Vasil Khalidov, Florence Forbes
Living With A Robot Companion. Empirical Study On The Interaction With An Artificial Health Advisor
Astrid M. von der Putten, Nicole C. Kramer, Sabrina C. Eimler
Perceived Physicality in Audio-Enhanced Force Input
Chi-Hsia Lai, Matti Niinimaki, Koray Tahiroglu, Johan Kildal, Teemu Ahmaniemi
Virtual Worlds and Active Learning for Human Detection
David Vazquez, Antonio M. Lopez, Francisco J. Marin, Daniel Ponsa
Multimodal Mobile Interactions: Usability Studies in Real World Settings
Julie Rico Williamson, Andrew Crossan, Stephen Brewster
Mining Multimodal Sequential Patterns: A Case Study on Affect Detection
Hector P. Martinez, Georgios N. Yannakakis
Please, Tell Me About Yourself: Automatic Personality Assessment Using Short Self-Presentations
Ligia Maria Batrinca, Nadia Mana, Bruno Lepri, Fabio Pianesi, Nicu Sebe
Exhibits (Terra Lucis room)
RadSpeech---A Semantic Speech Dialogue System for the Radiologist
Daniel Sonntag, Christian Reuschling, Christian Husodo Schulz, Michael Sintek, Daniel Porta, Maha Ahmed Baker, Jochen Setz, Milos Kalab, Luis Galárraga, Matthias Hammon, Alexander Cavallaro, Sascha Seifert
SpeeG: Voice and Gesture-based Text Input
Lode Hoste, Bruno Dumas, Beat Signer
Multimodal music information retrieval evaluation campaign
Nicola Orio, David Rizo
17:00-18:30 Special Session 2: Long-term Socially Perceptive and Interactive Robot Companions: Challenges and Future Perspectives
Session chairs: Ginevra Castellano and Bogdan Raducanu
Long-term Socially Perceptive and Interactive Robot Companions: Challenges and Future Perspectives
Ruth Aylett, Ginevra Castellano, Bogdan Raducanu, Ana Paiva, Marc Hanheide
Living With A Robot Companion. Empirical Study On The Interaction With An Artificial Health Advisor
Astrid M. von der Putten, Nicole C. Kramer, Sabrina C. Eimler
Child-Robot Interaction in the Wild: Advice for the Aspiring Experimenter
Raquel Ros Espinoza, Marco Nalin, Rachel Wood, Paul Baxter, Rosemarijn Looije, Yiannis Demiris, Tony Belpaeme, Alessio Giusti, Clara Pozzi
Characterization of Coordination in an Imitation Task: Human Evaluation and Automatically Computable Cues
Emilie Delaherche, Mohamed Chetouani
20:00 Conference Banquet: Aldebarán restaurant (Club de regatas de Alicante)
19:40 - Meeting point at the hotel


Wednesday, November 16th, 2011
All sessions will take place in the "Mediterráneo" room.

09:30-10:30 Keynote:
The Sounds of Social Life: Observing Humans in their Natural Habitat (more info)
Matthias Mehl, University of Arizona
Session chair: Daniel Gatica-Perez
10:30-11:00 Coffee Break
11:00-12:40 Oral Session 4: Ubiquitous Interaction
Session chair: Kenji Mase
Smartphone Usage in the Wild: a Large-Scale Analysis of Applications and Context
Trinh Minh Tri Do, Jan Blom, Daniel Gatica-Perez
Multimodal Mobile Interactions: Usability Studies in Real World Settings
Julie Rico Williamson, Andrew Crossan, Stephen Brewster
Service-Oriented Autonomic Multimodal Interaction in a Pervasive Environment
Pierre-Alain Avouac, Philippe Lalanda, Laurence Nigay
Visual Based Order Picking - Evaluation of Graphical User-Interfaces for Order Picking Using Head-Mounted Displays
Hannes Baumann, Thad Starner, Hendrik Iben, Anna Lewandowski, Patrick Zschaler
12:40-14:00 Lunch Break
14:00-15:40 Oral Session 5: Virtual and Real Worlds
Session chair: Dan Bohus
Modeling and Interpretation of Multithreaded and Multimodal Dialogue
Gregor Mehlmann, Birgit Endrass, Elisabeth Andre
Virtual Worlds and Active Learning for Human Detection
David Vazquez, Antonio M. Lopez, Francisco J. Marin, Daniel Ponsa
Making a Virtual Conversational Agent be Aware of the Addressee of Users' Utterances in Multi-user Conversation from Nonverbal Information
Hung-Hsuan Huang, Naoya Baba, Yukiko Nakano
Temporal Binding of Multimodal Controls for Dynamic Map Displays: A Systems Approach
Ellen Haas, Krishna Pillalamarri, Christopher Stachowiak, MaryAnne Fields
15:40-16:30 Town Hall Meeting


Thursday, November 17th, 2011
Workshops will take place at Sede Ciudad de Alicante
Av. Ramón y Cajal 4, 03001 Alicante, Spain.

 

8:30-9:00 Registration
Meeting room

Workshop:

Inferring Cognitive and Emotional States from Multimodal Measures
Link: http://www.nicta.com.au/workshop_icmi2011
Room: Rafael Altamira
9:00-10:30 Invited speakers
Using Passive Brain-Computer Interfaces for cognitive workload assessment during learning: A novel methodological approach.
Prof. Dr. Peter Gerjets (Knowledge Media Research Center, Tuebingen)
Dr. Thorsten Zander (Max-Planck Institute, Tuebingen)
10:30-11:00 Coffee Break (meeting room)
11:00-13:00 Paper presentations (20min each including Q&A)
Inferring Cognitive States from Multimodal Measures in Information Science
Jacek Gwizdka and Michael J. Cole
Presenter: Jacek Gwizdka
Gesture Dynamics: Features Sensitive to Task Difficulty and Correlated with Physiological Sensors
Lisa Anthony, Patrick Carrington, Peng Chu, Christopher Kidd, Jianwei Lai, Andrew Sears
Presenter: Lisa Anthony
Classification of Cognitive Load from Task Performance & Multichannel Physiology during Affective Changes
Sazzad Hussain, Siyuan Chen, Rafael A. Calvo and Fang Chen
Presenter: Natalie Ruiz
Cognitive Load Measurement with Pen Orientation and Pressure
Kun Yu, Julien Epps and Fang Chen
Presenter: Fang Chen
13:00-14:30 Lunch Traviata restaurant (C/Alemania, 18)
14:30-15.45 Invited papers (15 each including Q&A)
Facial Response to Video Content in Depression
Gordon McIntyre, Roland Goecke, Michael Breakspear and Gordon Parker
Fusing Utterance-Level Classifiers for Robust Intoxication Recognition from Speech
Felix Weninger and Björn Schuller
15:45-16:15 Afternoon break combined with informal discussion:
Grand research challenges for multimodal cognitive and emotional inference
16:15-16:45 Work-In-Progress Papers (10 minutes each x3)
An Immersive View Control Method Using EMG Signals of Users' Eyelid Movements
Masaki Omata, Satoshi Kagoshima, Atsumi Imamiya, Xiaoyang Mao
Presenter: Masaki Omata
Handling Noise in Audio-Visual Emotion Recognition
Ntombikayise Banda and Peter Robinson
Presenter: Ntombikayise Banda
Assessment of the Emotional State by Psycho-physiological and Implicit Measurement
Michael A. Bedek, Ben Cowley, Paul Seitlinger, Martino Fantato, Simone Kopeinik, Dietrich Albert and Niklas Ravaja
Presenter: Michael Bedek
16:45-17:00 Concluding Remarks


Workshop:

Affective Interaction in Natural Environments (AFFINE)
Link: http://www.image.ntua.gr/affine2011/
Room: Miguel Hernández
9:00-9:30 Introduction, overview of the workshop, state of the art
9:30-10:30 Affect sensing (30 minutes each)
A GA-based Similarity Measurement and Feature Selection Method for Spontaneous Facial Expression Recognition
Shangfei Wang, Shan He
Affect Sensing in Multi-threaded Improvisational Dialogue
Li Zhang
10:30-11:00 Coffee Break (meeting room)
11:00-13:00 Body and hand gestures / mimicry (30 minutes each)
Full body expressivity analysis in 3D Natural Interaction: a comparative study
George Caridakis, Kostas Karpouzis
Analysis of Dominance in Small Music Ensemble
Donald Glowinski, Maurizio Mancini, Nadezhda Rukavishnikova
Emotion Communication via Copying Behaviour: A Case Study with the Greta Embodied Agent
Ginevra Castellano, Maurizio Mancini, Christopher Peters
Modeling Hidden Dynamics of Multimodal mimicry Cues for human affect recognition
Xiaofan Sun, Anton Nijholt, Maja Pantic


Friday, November 18th, 2011
Workshops will take place at Sede Ciudad de Alicante
Av. Ramón y Cajal 4, 03001 Alicante, Spain.

Workshop:

Multimodal Corpora for Machine Learning: Taking Stock and Road mapping the Future
Link: http://www.multimodal-corpora.org/mmc11.html
Room: Rafael Altamira
* Each talk should last 20 minutes
9:15-9:30 Welcome
9:30-10:30 Session 1
Automatic detection of motion sequences for motion analysis
Bernhard Bruning, Christian Schnier, Karola Pitsch, Sven Wachsmuth
Multimodal Corpora for an Automatic System Fostering Participants' Engagement in Informal Conversations around a Museum Café Table
Nadia Mana, Alessandro Cappelletti, Oliviero Stock, Massimo Zancanaro
10:30-11:00 Coffee Break (meeting room)
11:00-13:00 Session 2
Communicating vagueness by hands and face
Isabella Poggi, Laura Vincze
An audio visual corpus for emergent leader analysis
Dairazalia Sanchez-Cortes, Oya Aran, Daniel Gatica-Perez
A multilingual corpus for rich audio-visual scene description in a meeting-room environment
Taras Butko, Climent Nadeu, Asuncion Moreno
Turn taking, Utterance Density, and Gaze Patterns as Cues to Conversational Activity
Kristiina Jokinen
13:00-14:30 Lunch Traviata restaurant (C/Alemania, 18)
14:30-16:00 Session 3
Multimodal Annotations and Categorization for Political Debates
Brigitte Bigi, Cristel Portes, Agnes Steuckardt, Marion Tellier
A Study on Cultural Variations of Smile Based on Empirical Recordings of Chinese and Swedish First Encounters
Jia Lu, Jens Allwood, Elisabeth Ahlsen
A multimodal dance corpus for research into real-time interaction between humans in online virtual environments
Slim Essid, Xinyu Lin, Marc Gowing, Georgios Kordelas, Anil Aksay, Philip Kelly, Thomas Fillon, Qianni Zhang, Alfred Dielmann, Vlado Kitanovski, RobinTournemenne, Noel E. O'Connor, Petros Daras and Gaël Richard
16:00-16:30 Coffee Break (meeting room)
16:30-17:30 Session 4
Learning to classify the feedback function of head movements in a Danish Corpus of first encounters
Patrizia Paggio, Costanza Navarretta
The Ravel Data Set
Xavier Alameda-Pineda, Jordi Sanchez-Riera, Johannes Wienke, Vojtech Franc, Jan Cech, Kaustubh Kulkarni, Antoine Deleforge, Radu Horaud




ICMI 2011 International Conference on Multimodal Interaction. 14-18th November 2011, Alicante, Spain. Copyright © 2010-2023   |   Credits   |   Contact