Technical Program

Monday, October 22nd, 2012
2nd International Audio/Visual Emotion Challenge and Workshop - AVEC 2012
Organizers: Björn Schuller, Michel Valstar, Florian Eyben, Roddy Cowie, Maja Pantic
Carousel Ballroom A
Haptic Voice Recognition Grand Challenge
Organizers: Khe Chai SIM, Shengdong Zhao, Kai Yu, Hank Liao
Carousel Ballroom B
BCI Grand Challenge Brain-Computer Interfaces as intelligent sensors for enhancing Human-Computer Interaction
Organizers: Femke Nijboer, Mannes Poel, Anton Nijholt, Egon L. van den Broek, Stephen Fairclough
Carousel Ballroom C
D-META'12 Grand Challenge: Data sets for Multimodal Evaluation of Tasks and Annotations
Organizers: Xavier Alameda-Pineda, Dirk Heylen, Kristiina Jokinen
Marquee I Ballroom
Doctoral Consortium
Organizers: Carlos Busso, Bilge Mutlu
Marquee II Ballroom

Tuesday, October 23rd, 2012
All sessions will take place in the Carousel Ballroom,
except for the Demos that will be in the Marquee Ballroom, and the Posters will be in the Hotel Lobby

08:00 Breakfast
Hotel lobby
09:00 Welcome
Louis-Philippe Morency, Dan Bohus and Hamid Aghajan
09:15 Keynote 1: The Co-Operative, Transformative Organization of Human Action and Knowledge
Charles Goodwin
Session Chair: Julien Epps
10:15 Break
10:45-12:20 Oral Session 1: Nonverbal / Behaviour
Session Chair: Dan Bohus
10:45 Two People Walk Into a Bar: Dynamic Multi-Party Social Interaction with a Robot Agent
Mary Ellen Foster, Andre Gaschler, Manuel Giuliani, Amy Isard, Maria Pateraki, Ronald P.A. Petrick
11:10 Changes in Verbal and Nonverbal Conversational Behavior in Long-Term Interaction
Daniel Schulman, Timothy Bickmore
11:35 I Already Know Your Answer: Using Nonverbal Behaviors to Predict Immediate Outcomes in a Dyadic Negotiation
Sunghyun Park, Jonathan Gratch, Louis-Philippe Morency
11:50 Modeling Dominance Effects on Nonverbal Behaviors using Granger Causality
Kyriaki Kalimeri, Bruno Lepri, Oya Aran, Dinesh Babu Jayagopi, Daniel Gatica-Perez, Fabio Pianesi
12:05 Multimodal Human Behavior Analysis: Learning Correlation and Interaction Across Modalities
Yale Song, Louis-Philippe Morency, Randall Davis
12:20 Lunch (included and sponsored by OpenStream)
Garden Terrace
13:45-15:15 Oral Session 2: Affect
Session Chair: Dirk Heylen
13:45 Consistent but Modest: A Meta-Analysis on Unimodal and Multimodal Affect Detection Accuracies from 30 Studies
Sidney D'Mello, Jacqueline Kory
14:10 Multimodal Recognition of Personality Traits in Human-Computer Collaborative Tasks
Ligia Maria Batrinca, Bruno Lepri, Nadia Mana, Fabio Pianesi
14:35 Automatic Detection of Pain Intensity
Zakia Hammal, Jeffrey F. Cohn
15:00 FaceTube: Predicting Personality from Facial Expressions of Emotion in Online Conversational Video
Joan-Isaac Biel, Lucia Teijeiro-Mosquera, Daniel Gatica-Perez
15:15 Break
15:45-17:15 Demo Session 1
Session Chair: Wolfgang Minker and Ramón López-Cózar Delgado
The Blue One to the Left: Enabling Expressive User Interaction in a Multimodal Interface for Object Selection in Virtual 3D environments
Pulkit Budhiraja, Sriganesh Madhvanath
Pixene: Creating Memories while Sharing Photos
Ramadevi Vennelakanti, Sriganesh Madhvanath, Anbumani Subramanian, Ajith Sowndararajan, Arun David, Prasenjit Dey
Designing Multiuser Multimodal Gestural Interactions for the Living Room
Sriganesh Madhvanath, Ramadevi Vennelakanti, Anbumani Subramanian, Ankit Shekhawat, Prasenjit Dey, Amit Ranjan
Using Explanations for Runtime Dialogue Adaptation
Florian Nothdurft, Frank Honold, Peter Kurzok
NeuroDialog: An EEG-Enabled Spoken Dialog Interface
Seshadri Sridharan, Yun-Nung Chen, Kai-Min Chang, Alexander I. Rudnicky
Companion Technology for Multimodal Interaction
Frank Honold, Felix Schüssel, Florian Nothdurft, Peter Kurzok
Automatic Grammar Induction for Multimodal Dialogue Systems
Elias Iosif, Nikos Malandrakis, Giannis Klasinas, Manolis Perakakis, Alexandros Potamianos, Manolis Tsangaris, Christos Chrysochoidis
15:45-17:15 Poster Session 1
Session Chair: Julien Epps
IrisTK: a Statechart-based Toolkit for Multi-party Face-to-face Interaction
Gabriel Skantze, Samer Al Moubayed
Estimating Conversational Dominance in Multiparty Interaction
Yukiko I. Nakano, Yuki Fukuhara
Learning Relevance from Natural Eye Movements in Pervasive Interfaces
Melih Kandemir, Samuel Kaski
Structural and Temporal Inference Search (STIS): Pattern Identification in Multimodal Data
Chreston Miller, Louis-Philippe Morency, Francis Quek
Integrating Word Acquisition and Referential Grounding towards Physical World Interaction
Rui Fang, Changsong Liu, Joyce Y. Chai
Effects of Modality on Virtual Button Motion and Performance
Adam Faeth, Chris Harding
Modeling Multimodal Integration with Event Logic Charts
Gregor Mehlmann, Elisabeth André
Multimodal Motion Guidance: Techniques for Adaptive and Dynamic Feedback
Christian Schönauer, Kenichiro Fukushi, Alex Olwal
Multimodal Detection of Salient Behaviors of Approach-Avoidance in Dyadic Interactions
Bo Xiao, Panayiotis G. Georgiou, Brian Baucom, Shrikanth S. Narayanan
Multimodal Analysis of the Implicit Affective Channel in Computer-Mediated Textual Communication
Joseph F. Grafsgaard, Robert M. Fulton, Kristy Elizabeth Boyer, Eric N. Wiebe, James C. Lester
Towards Sensing the Influence of  Visual Narratives on Human Affect
Mihai Burzo, Daniel McDuff, Rada Mihalcea, Louis-Philippe Morency
Integrating Video and Accelerometer Signals for Nocturnal Epileptic Seizure Detection
Kris Cuppens, Bart Vanrumste, Chih-Wei Chen, Kevin Bing-Yung Wong, Hamid Aghajan, Tinne Tuytelaars, Anouk Van de Vel, Berten Ceulemans, Lieven Lagae, Sabine Van Huffel
GeoGazemarks: Providing Gaze History for the Orientation on Small Display Maps
Ioannis Giannopoulos, Peter Kiefer, Martin Raubal
Lost in Navigation: Evaluating a Mobile Map App for a Fair
Anders Bouwer, Frank Nack, Abdallah El Ali
An Evaluation of Game Controllers and Tablets as Controllers for Interactive TV Applications
Dale Cox, Justin Wolford, Carlos Jensen, Dedrie Beardsley
Towards Multimodal Deception Detection -- Step 1: Building a Collection of Deceptive Videos
Rada Mihalcea, Mihai Burzo
A Portable Audio/Video Recorder for Longitudinal Study of Child Development
Souroush Vosoughi, Matthew S. Goodwin, Bill Washabaugh, Deb Roy
Integrating PAMOCAT in the Research Cycle: Linking Motion Capturing and Conversation Analysis
Bernhard Brüning, Christian Schnier, Karola Pitsch, Sven Wachsmuth
17:15-18:50 Oral Session 3: Vision
Session Chair: Louis-Philippe Morency
17:15 Motion Retrieval Based on Kinetic Features in Large Motion Database
Tianyu Huang, Haiying Liu, Gangyi Ding
17:40 Vision-Based Handwriting Recognition for Unrestricted Text Input in Mid-Air
Alexander Schick, Daniel Morlock, Christoph Amma, Tanja Schulz, Rainer Stiefelhagen
17:55 Fishing or a Z?: Investigating the Effects of Error on Mimetic and Alphabet Device-based Gesture Interaction
Abdallah El Ali, Johan Kildal, Vuokko Lantz
18:20 Investigating the Midline Effect for Visual Focus of Attention Recognition
Samira Sheikhi, Jean-Marc Odobez
18:35 Let's have Dinner Together: Evaluate the Mediated Co-dining Experience
Jun Wei, Adrian David Cheok, Ryohei Nakatsu

Wednesday, October 24th, 2012
All sessions will take place in the Carousel Ballroom,
except for the Demos that will be in the Marquee Ballroom, and the Doctoral Spotlight Session will be in the Hotel Lobby

08:00 Breakfast
Hotel lobby
9:00 Keynote 2: Infusing the Physical World into User Interfaces
Ivan Pouperev
Session Chair: Anton Nijholt
10:00 Break
10:30-12:35 Oral Session 4: Child-Computer Interaction
Session Chair: Anton Nijholt
10:30 Knowledge Gaps in Hands-on Tangible Interaction Research
Alissa N. Antle
10:55 Evaluating Artefacts with Children: Age and Technology Effects in the Reporting of Expected and Experienced Fun
Janet C. Read
11:20 Measuring Enjoyment of an Interactive Museum Experience
Elisabeth M.A.G. van Dijk, Andreas Lingnau, Hub Kockelkorn
11:45 Bifocal Modeling: A Study on the Learning Outcomes of Comparing Physical and Computational Models Linked in Real Time
Paulo Blikstein
12:10 Connecting Play: Understanding Multimodal Participation in Virtual Worlds
Yasmin B. Kafai, Deborah A. Fields
12:35 Lunch
Lunch not included with registration
14:15-15:20 Oral Session 5: Gesture
Session chairs: Kristiina Jokinen
14:15 Gestures as Point Clouds: A $P Recognizer for User Interface Prototypes
Radu-Daniel Vatavu, Lisa Anthony, Jacob O. Wobbrock
14:40 Influencing Gestural Representation of Eventualities: Insights from Ontology
Magdalena Lis
15:05 Using Self-Context for Multimodal Detection of Head Nods in Face-to-Face Interactions
Laurent Nguyen, Jean-Marc Odobez, Daniel Gatica-Perez
15:20 Break
15:45-17:15 Demo Session 2
Session Chair: Wolfgang Minker and Ramón López-Cózar Delgado
Multimodal Multiparty Social Interaction with the Furhat Head
Samer Al Moubayed, Gabriel Skantze, Jonas Beskow, Kalin Stefanov, Joakim Gustafson
An Avatar-based Help System for a Grid Computing Web Portal
Helmut Lang, Florian Nothdurft
GamEMO: How Physiological Signals Show your Emotions and Enhance your Game Experience.
Guillaume Chanel, Konstantina Kalogianni, Thierry Pun
Multimodal Collaboration for Crime Scene Investigation in Mediated Reality
Dragoş Datcu, Thomas Swart, Stephan Lukosch, Zoltan Rusak
PAMOCAT: linking Motion Capturing and Conversation Analysis
Bernhard Brüning, Christian Schnier
Multimodal Dialogue in Mobile Local Search
Patrick Ehlen, Michael Johston
"Bouncing Star" Smart-Ball Project
Sachiko Kodama, Toshiki Sato, Hideki Koike, Akira Fujimoto/span>
Representing Constraints through Visual and Aural Interactivity Using Pseudo-Haptics
Yasuhiro Yamamoto, Kumiyo Nakakoji, Nobuto Matsubara
15:45-17:15 Doctoral Spotlight Session
Session Chair: Carlos Busso and Bilge Mutlu
Toward an Argumentation-based Dialogue framework for Human-Robot Collaboration
Mohammad Q. Azhar
Timing Multimodal Turn-taking for Human-robot Cooperation
Crystal Chao
My Automated Conversation Helper (MACH): Helping People Improve Social Skills
Mohammed (Ehsan) Hoque
A Touch of Affect: Mediated Social Touch and Affect
Gijs Huisman
Depression Analysis : A Multimodal Approach
Jyoti Joshi
Design Space for Finger Gestures with Hand-held Tablets
Katrin Wolf
Multi-Modal Interfaces for Control of Assistive Robotic Devices
Christopher McMurrough
Space, Speech, and Gesture in Human-Robot Interaction
Ross Mead
Machine Analysis and Recognition of Social Contexts
Maria Francesca O'Connor
Task-Learning Policies for Collaborative Task Solving in Human-Robot Interaction
Hae Won Park
Simulating Real Danger? Validation of Driving Simulator Test and Psychological Factors in Brake Response Time to Danger
Daniele Ruscio
Virtual Patients to Teach Cultural Competency
Raghavi Sakpal
Multimodal Learning Analytics - Enabling the Future of Learning through Multimodal Data Analysis and Interfaces
Marcelo Worsley
A Hierarchical Approach to Continuous Gesture Analysis for Natural Multi-modal Interaction
Ying Yin
17:15-18:00 Grand Challenge Overviews
Session Chairs: Daniel Gatica-Perez and Stefanie Tellex
AVEC 2012 - The Continuous Audio/Visual Emotion Challenge - An Introduction
Björn Schuller, Michel Valstar, Roddie Cowie and Maja Pantic
ICMI'12 Grand Challenge -- Haptic Voice Recognition
Khe Chai Sim, Shengdong Zhao, Kai Yu and Hank Liao
Audio-Visual Robot Command Recognition: D-META'12 Grand Challenge
Jordi Sanchez-Riera, Xavier Alameda-Pineda, Radu Horaud
Brain Computer Interfaces as Intelligent Sensors for Enhancing Human-Computer Interaction
Mannes Poel, Femke Nijboer, Egon L. van den Broek, Stephen Fairclough, Anton Nijholt
18:30 Banquet
Buses will be leaving at 6pm from the DoubleTree Hotel

Thursday, October 25th, 2012
All sessions will take place in the Carousel Ballroom.

08:00 Breakfast
Hotel lobby
09:00 Keynote 3: Using Psychophysical Techniques to Design and Evaluate Multimodal Interfaces
Roberta Klatzky
Session Chair: Stephen Fairclough (Liverpool John Moores University, UK)
10:00 Break
10:30-12:10 Oral Session 6: Touch / Taste
Session Chair: Sidney D'Mello
10:30 Reproducing Materials of Virtual Elements on Touchscreens using Supplemental Thermal Feedback
Hendrik Richter, Doris Hausen, Sven Osterwald, Andreas Butz
10:55 Feeling It: The Roles of Stiffness, Deformation Range and Feedback in the Control of Deformable UI
Johan Kildal, Graham Wilson
11:20 Audible Rendering of Text Documents Controlled by Multi-Touch Interaction
Yasmine N. El-Glaly, Francis Quek, Tonya Smith-Jackson, Gurjot Dhillon
11:45 Taste/IP: The Sensation of Taste for Digital Communication
Nimesha Ranasinghe, Adrian David Cheok, Ryohei Nakatsu
10:00-13:00 Sponsored workshop by OpenStream: "Developing Portable Multimodal Applications Using the W3C MMI Framework"
Pre-registration required
Marquee I Ballroom
12:10 Lunch
Lunch not included with registration
14:00-15:45 Oral Session 7: Multimodal Interaction
Session Chair: Kenji Mase
14:00 Learning Speaker, Addressee and Overlap Detection Models from Multimodal Streams
Oriol Vinyals, Dan Bohus, Rich Caruana
14:25 Analysis of the Correlation between the Regularity of Work Behavior and Stress Indices Based on Longitudinal Behavioral Data
Shogo Okada, Yusaku Sato, Yuki Kamiya, Keiji Yamada, Katsumi Nitta
14:50 Linking Speaking and Looking Behavior Patterns with Group Composition, Perception, and Performance
Dineshbabu Jayagopi, Dairazalia Sanchez-Cortes, Kazuhiro Otsuka, Junji Yamato, Daniel Gatica-Perez
15:15 Semi-Automatic Generation of Multimodal User Interfaces for Dialogue-based Interactive Systems
Dominik Ertl, Hermann Kaindl
15:30 Designing Multimodal Reminders for the Home: Pairing Content with Presentation
Julie R. Williamson, Marilyn McGee-Lennon, S. Brewster
15:50-17:00 Town Hall Meeting

Friday, October 26th, 2012
Workshop overviews
  Workshop on Speech and Gesture Production in Virtually and Physically Embodied Conversational Agents
Ross Mead, Maha Salem
Carousel Ballroom C
  1st International Workshop on Multimodal Learning Analytics
Stefan Scherer, Marcelo Worsley, Louis-Philippe Morency
Marquee I Ballroom
  4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
Yukiko I. Nakano, Kristiina Jokinen, Hung-Hsuan Huang
Carousel Ballroom A
  The 3rd International Workshop on Social Behaviour in Music (SBM2012)
Antonio Camurri, Donald Glowinski, Maurizio Mancini, Giovanna Varni, Gualtiero Volpe
Carousel Ballroom B
  Smart Material Interfaces: "A Material Step to the Future"
Anton Nijholt, Leonardo Giusti, Andrea Minuto, Patrizia Marti
Marquee II Ballroom

ICMI 2012 ACM International Conference on Multimodal Interaction. 22-26th October 2012, Santa Monica, Californica. Copyright © 2010-2023   |