| |
| |
Technical Program
Monday, October 22nd, 2012
|
|
2nd International Audio/Visual Emotion Challenge and Workshop - AVEC 2012
Organizers: Björn Schuller, Michel Valstar, Florian Eyben, Roddy Cowie, Maja Pantic
http://sspnet.eu/avec2012/
Carousel Ballroom A
|
|
|
Haptic Voice Recognition Grand Challenge
Organizers: Khe Chai SIM, Shengdong Zhao, Kai Yu, Hank Liao
http://speech.ddns.comp.nus.edu.sg/HVRGrandChallenge2012/
Carousel Ballroom B
|
|
|
BCI Grand Challenge Brain-Computer Interfaces as intelligent sensors for enhancing Human-Computer Interaction
Organizers: Femke Nijboer, Mannes Poel, Anton Nijholt, Egon L. van den Broek, Stephen Fairclough
http://hmi.ewi.utwente.nl/BCIGrandChallenge2012/
Carousel Ballroom C
|
|
|
D-META'12 Grand Challenge: Data sets for Multimodal Evaluation of Tasks and Annotations
Organizers: Xavier Alameda-Pineda, Dirk Heylen, Kristiina Jokinen
http://d-meta.inrialpes.fr/
Marquee I Ballroom
|
|
|
Doctoral Consortium
Organizers: Carlos Busso, Bilge Mutlu
http://www.acm.org/icmi/2012/index.php?id=students
Marquee II Ballroom
|
Tuesday, October 23rd, 2012
All sessions will take place in the Carousel Ballroom,
except for the Demos that will be in the Marquee Ballroom, and the Posters will be in the Hotel Lobby
|
08:00
|
Breakfast
Hotel lobby
|
|
09:00
|
Welcome
Louis-Philippe Morency, Dan Bohus and Hamid Aghajan
|
|
09:15
|
Keynote 1: The Co-Operative, Transformative Organization of Human Action and Knowledge
Charles Goodwin
Session Chair: Julien Epps
|
|
10:15
|
Break
|
|
10:45-12:20
|
Oral Session 1: Nonverbal / Behaviour
Session Chair: Dan Bohus
|
| 10:45 |
Two People Walk Into a Bar: Dynamic Multi-Party Social Interaction with a Robot Agent
Mary Ellen Foster, Andre Gaschler, Manuel Giuliani, Amy Isard, Maria Pateraki, Ronald P.A. Petrick
|
| 11:10 |
Changes in Verbal and Nonverbal Conversational Behavior in Long-Term Interaction
Daniel Schulman, Timothy Bickmore
|
| 11:35 |
I Already Know Your Answer: Using Nonverbal Behaviors to Predict Immediate Outcomes in a Dyadic Negotiation
Sunghyun Park, Jonathan Gratch, Louis-Philippe Morency
|
| 11:50 |
Modeling Dominance Effects on Nonverbal Behaviors using Granger Causality
Kyriaki Kalimeri, Bruno Lepri, Oya Aran, Dinesh Babu Jayagopi, Daniel Gatica-Perez, Fabio Pianesi
|
| 12:05 |
Multimodal Human Behavior Analysis: Learning Correlation and Interaction Across Modalities
Yale Song, Louis-Philippe Morency, Randall Davis
|
|
12:20
|
Lunch (included and sponsored by OpenStream)
Garden Terrace
|
|
13:45-15:15
|
Oral Session 2: Affect
Session Chair: Dirk Heylen
|
| 13:45 |
Consistent but Modest: A Meta-Analysis on Unimodal and Multimodal Affect Detection Accuracies from 30 Studies
Sidney D'Mello, Jacqueline Kory
|
| 14:10 |
Multimodal Recognition of Personality Traits in Human-Computer Collaborative Tasks
Ligia Maria Batrinca, Bruno Lepri, Nadia Mana, Fabio Pianesi
|
| 14:35 |
Automatic Detection of Pain Intensity
Zakia Hammal, Jeffrey F. Cohn
|
| 15:00 |
FaceTube: Predicting Personality from Facial Expressions of Emotion in Online Conversational Video
Joan-Isaac Biel, Lucia Teijeiro-Mosquera, Daniel Gatica-Perez
|
|
15:15
|
Break
|
|
15:45-17:15
|
Demo Session 1
Session Chair: Wolfgang Minker and Ramón López-Cózar Delgado
|
|
The Blue One to the Left: Enabling Expressive User Interaction in a Multimodal Interface for Object Selection in Virtual 3D environments
Pulkit Budhiraja, Sriganesh Madhvanath
|
|
Pixene: Creating Memories while Sharing Photos
Ramadevi Vennelakanti, Sriganesh Madhvanath, Anbumani Subramanian, Ajith Sowndararajan, Arun David, Prasenjit Dey
|
|
Designing Multiuser Multimodal Gestural Interactions for the Living Room
Sriganesh Madhvanath, Ramadevi Vennelakanti, Anbumani Subramanian, Ankit Shekhawat, Prasenjit Dey, Amit Ranjan
|
|
Using Explanations for Runtime Dialogue Adaptation
Florian Nothdurft, Frank Honold, Peter Kurzok
|
|
NeuroDialog: An EEG-Enabled Spoken Dialog Interface
Seshadri Sridharan, Yun-Nung Chen, Kai-Min Chang, Alexander I. Rudnicky
|
|
Companion Technology for Multimodal Interaction
Frank Honold, Felix Schüssel, Florian Nothdurft, Peter Kurzok
|
|
Automatic Grammar Induction for Multimodal Dialogue Systems
Elias Iosif, Nikos Malandrakis, Giannis Klasinas, Manolis Perakakis, Alexandros Potamianos, Manolis Tsangaris, Christos Chrysochoidis
|
|
15:45-17:15
|
Poster Session 1
Session Chair: Julien Epps
|
|
IrisTK: a Statechart-based Toolkit for Multi-party Face-to-face Interaction
Gabriel Skantze, Samer Al Moubayed |
|
Estimating Conversational Dominance in Multiparty Interaction
Yukiko I. Nakano, Yuki Fukuhara |
|
Learning Relevance from Natural Eye Movements in Pervasive Interfaces
Melih Kandemir, Samuel Kaski |
|
Structural and Temporal Inference Search (STIS): Pattern Identification in Multimodal Data
Chreston Miller, Louis-Philippe Morency, Francis Quek |
|
Integrating Word Acquisition and Referential Grounding towards Physical World Interaction
Rui Fang, Changsong Liu, Joyce Y. Chai |
|
Effects of Modality on Virtual Button Motion and Performance
Adam Faeth, Chris Harding |
|
Modeling Multimodal Integration with Event Logic Charts
Gregor Mehlmann, Elisabeth André |
|
Multimodal Motion Guidance: Techniques for Adaptive and Dynamic Feedback
Christian Schönauer, Kenichiro Fukushi, Alex Olwal |
|
Multimodal Detection of Salient Behaviors of Approach-Avoidance in Dyadic Interactions
Bo Xiao, Panayiotis G. Georgiou, Brian Baucom, Shrikanth S. Narayanan |
|
Multimodal Analysis of the Implicit Affective Channel in Computer-Mediated Textual Communication
Joseph F. Grafsgaard, Robert M. Fulton, Kristy Elizabeth Boyer, Eric N. Wiebe, James C. Lester |
|
Towards Sensing the Influence of Visual Narratives on Human Affect
Mihai Burzo, Daniel McDuff, Rada Mihalcea, Louis-Philippe Morency |
|
Integrating Video and Accelerometer Signals for Nocturnal Epileptic Seizure Detection
Kris Cuppens, Bart Vanrumste, Chih-Wei Chen, Kevin Bing-Yung Wong, Hamid Aghajan, Tinne Tuytelaars, Anouk Van de Vel, Berten Ceulemans, Lieven Lagae, Sabine Van Huffel |
|
GeoGazemarks: Providing Gaze History for the Orientation on Small Display Maps
Ioannis Giannopoulos, Peter Kiefer, Martin Raubal |
|
Lost in Navigation: Evaluating a Mobile Map App for a Fair
Anders Bouwer, Frank Nack, Abdallah El Ali |
|
An Evaluation of Game Controllers and Tablets as Controllers for Interactive TV Applications
Dale Cox, Justin Wolford, Carlos Jensen, Dedrie Beardsley |
|
Towards Multimodal Deception Detection -- Step 1: Building a Collection of Deceptive Videos
Rada Mihalcea, Mihai Burzo |
|
A Portable Audio/Video Recorder for Longitudinal Study of Child Development
Souroush Vosoughi, Matthew S. Goodwin, Bill Washabaugh, Deb Roy |
|
Integrating PAMOCAT in the Research Cycle: Linking Motion Capturing and Conversation Analysis
Bernhard Brüning, Christian Schnier, Karola Pitsch, Sven Wachsmuth |
|
17:15-18:50
|
Oral Session 3: Vision
Session Chair: Louis-Philippe Morency
|
| 17:15 |
Motion Retrieval Based on Kinetic Features in Large Motion Database
Tianyu Huang, Haiying Liu, Gangyi Ding
|
| 17:40 |
Vision-Based Handwriting Recognition for Unrestricted Text Input in Mid-Air
Alexander Schick, Daniel Morlock, Christoph Amma, Tanja Schulz, Rainer Stiefelhagen
|
| 17:55 |
Fishing or a Z?: Investigating the Effects of Error on Mimetic and Alphabet Device-based Gesture Interaction
Abdallah El Ali, Johan Kildal, Vuokko Lantz
|
| 18:20 |
Investigating the Midline Effect for Visual Focus of Attention Recognition
Samira Sheikhi, Jean-Marc Odobez
|
| 18:35 |
Let's have Dinner Together: Evaluate the Mediated Co-dining Experience
Jun Wei, Adrian David Cheok, Ryohei Nakatsu
|
Wednesday, October 24th, 2012
All sessions will take place in the Carousel Ballroom,
except for the Demos that will be in the Marquee Ballroom, and the Doctoral Spotlight Session will be in the Hotel Lobby
|
08:00
|
Breakfast
Hotel lobby
|
|
9:00
|
Keynote 2: Infusing the Physical World into User Interfaces
Ivan Pouperev
Session Chair: Anton Nijholt
|
|
10:00
|
Break
|
|
10:30-12:35
|
Oral Session 4: Child-Computer Interaction
Session Chair: Anton Nijholt
|
| 10:30 |
Knowledge Gaps in Hands-on Tangible Interaction Research
Alissa N. Antle
|
| 10:55 |
Evaluating Artefacts with Children: Age and Technology Effects in the Reporting of Expected and Experienced Fun
Janet C. Read
|
| 11:20 |
Measuring Enjoyment of an Interactive Museum Experience
Elisabeth M.A.G. van Dijk, Andreas Lingnau, Hub Kockelkorn
|
| 11:45 |
Bifocal Modeling: A Study on the Learning Outcomes of Comparing Physical and Computational Models Linked in Real Time
Paulo Blikstein
|
| 12:10 |
Connecting Play: Understanding Multimodal Participation in Virtual Worlds
Yasmin B. Kafai, Deborah A. Fields
|
|
12:35
|
Lunch
Lunch not included with registration
|
|
14:15-15:20
|
Oral Session 5: Gesture
Session chairs: Kristiina Jokinen
|
| 14:15 |
Gestures as Point Clouds: A $P Recognizer for User Interface Prototypes
Radu-Daniel Vatavu, Lisa Anthony, Jacob O. Wobbrock
|
| 14:40 |
Influencing Gestural Representation of Eventualities: Insights from Ontology
Magdalena Lis
|
| 15:05 |
Using Self-Context for Multimodal Detection of Head Nods in Face-to-Face Interactions
Laurent Nguyen, Jean-Marc Odobez, Daniel Gatica-Perez
|
|
15:20
|
Break
|
|
15:45-17:15
|
Demo Session 2
Session Chair: Wolfgang Minker and Ramón López-Cózar Delgado
|
|
Multimodal Multiparty Social Interaction with the Furhat Head
Samer Al Moubayed, Gabriel Skantze, Jonas Beskow, Kalin Stefanov, Joakim Gustafson
|
|
An Avatar-based Help System for a Grid Computing Web Portal
Helmut Lang, Florian Nothdurft
|
|
GamEMO: How Physiological Signals Show your Emotions and Enhance your Game Experience.
Guillaume Chanel, Konstantina Kalogianni, Thierry Pun
|
|
Multimodal Collaboration for Crime Scene Investigation in Mediated Reality
Dragoş Datcu, Thomas Swart, Stephan Lukosch, Zoltan Rusak
|
|
PAMOCAT: linking Motion Capturing and Conversation Analysis
Bernhard Brüning, Christian Schnier
|
|
Multimodal Dialogue in Mobile Local Search
Patrick Ehlen, Michael Johston
|
|
"Bouncing Star" Smart-Ball Project
Sachiko Kodama, Toshiki Sato, Hideki Koike, Akira Fujimoto/span>
|
|
Representing Constraints through Visual and Aural Interactivity Using Pseudo-Haptics
Yasuhiro Yamamoto, Kumiyo Nakakoji, Nobuto Matsubara
|
|
15:45-17:15
|
Doctoral Spotlight Session
Session Chair: Carlos Busso and Bilge Mutlu
|
|
Toward an Argumentation-based Dialogue framework for Human-Robot Collaboration
Mohammad Q. Azhar
|
|
Timing Multimodal Turn-taking for Human-robot Cooperation
Crystal Chao
|
|
My Automated Conversation Helper (MACH): Helping People Improve Social Skills
Mohammed (Ehsan) Hoque
|
|
A Touch of Affect: Mediated Social Touch and Affect
Gijs Huisman
|
|
Depression Analysis : A Multimodal Approach
Jyoti Joshi
|
|
Design Space for Finger Gestures with Hand-held Tablets
Katrin Wolf
|
|
Multi-Modal Interfaces for Control of Assistive Robotic Devices
Christopher McMurrough
|
|
Space, Speech, and Gesture in Human-Robot Interaction
Ross Mead
|
|
Machine Analysis and Recognition of Social Contexts
Maria Francesca O'Connor
|
|
Task-Learning Policies for Collaborative Task Solving in Human-Robot Interaction
Hae Won Park
|
|
Simulating Real Danger? Validation of Driving Simulator Test and Psychological Factors in Brake Response Time to Danger
Daniele Ruscio
|
|
Virtual Patients to Teach Cultural Competency
Raghavi Sakpal
|
|
Multimodal Learning Analytics - Enabling the Future of Learning through Multimodal Data Analysis and Interfaces
Marcelo Worsley
|
|
A Hierarchical Approach to Continuous Gesture Analysis for Natural Multi-modal Interaction
Ying Yin
|
|
17:15-18:00
|
Grand Challenge Overviews
Session Chairs: Daniel Gatica-Perez and Stefanie Tellex
|
|
AVEC 2012 - The Continuous Audio/Visual Emotion Challenge - An Introduction
Björn Schuller, Michel Valstar, Roddie Cowie and Maja Pantic
|
|
ICMI'12 Grand Challenge -- Haptic Voice Recognition
Khe Chai Sim, Shengdong Zhao, Kai Yu and Hank Liao
|
|
Audio-Visual Robot Command Recognition: D-META'12 Grand Challenge
Jordi Sanchez-Riera, Xavier Alameda-Pineda, Radu Horaud
|
|
Brain Computer Interfaces as Intelligent Sensors for Enhancing Human-Computer Interaction
Mannes Poel, Femke Nijboer, Egon L. van den Broek, Stephen Fairclough, Anton Nijholt
|
|
18:30
|
Banquet
Buses will be leaving at 6pm from the DoubleTree Hotel
|
|
Thursday, October 25th, 2012
All sessions will take place in the Carousel Ballroom.
|
08:00
|
Breakfast
Hotel lobby
|
|
09:00
|
Keynote 3: Using Psychophysical Techniques to Design and Evaluate Multimodal Interfaces
Roberta Klatzky
Session Chair: Stephen Fairclough (Liverpool John Moores University, UK)
|
|
10:00
|
Break
|
|
10:30-12:10
|
Oral Session 6: Touch / Taste
Session Chair: Sidney D'Mello
|
| 10:30 |
Reproducing Materials of Virtual Elements on Touchscreens using Supplemental Thermal Feedback
Hendrik Richter, Doris Hausen, Sven Osterwald, Andreas Butz
|
| 10:55 |
Feeling It: The Roles of Stiffness, Deformation Range and Feedback in the Control of Deformable UI
Johan Kildal, Graham Wilson
|
| 11:20 |
Audible Rendering of Text Documents Controlled by Multi-Touch Interaction
Yasmine N. El-Glaly, Francis Quek, Tonya Smith-Jackson, Gurjot Dhillon
|
| 11:45 |
Taste/IP: The Sensation of Taste for Digital Communication
Nimesha Ranasinghe, Adrian David Cheok, Ryohei Nakatsu
|
|
10:00-13:00
|
Sponsored workshop by OpenStream: "Developing Portable Multimodal Applications Using the W3C MMI Framework"
Pre-registration required
Marquee I Ballroom
|
|
12:10
|
Lunch
Lunch not included with registration
|
|
14:00-15:45
|
Oral Session 7: Multimodal Interaction
Session Chair: Kenji Mase
|
| 14:00 |
Learning Speaker, Addressee and Overlap Detection Models from Multimodal Streams
Oriol Vinyals, Dan Bohus, Rich Caruana
|
| 14:25 |
Analysis of the Correlation between the Regularity of Work Behavior and Stress Indices Based on Longitudinal Behavioral Data
Shogo Okada, Yusaku Sato, Yuki Kamiya, Keiji Yamada, Katsumi Nitta
|
| 14:50 |
Linking Speaking and Looking Behavior Patterns with Group Composition, Perception, and Performance
Dineshbabu Jayagopi, Dairazalia Sanchez-Cortes, Kazuhiro Otsuka, Junji Yamato, Daniel Gatica-Perez
|
| 15:15 |
Semi-Automatic Generation of Multimodal User Interfaces for Dialogue-based Interactive Systems
Dominik Ertl, Hermann Kaindl
|
| 15:30 |
Designing Multimodal Reminders for the Home: Pairing Content with Presentation
Julie R. Williamson, Marilyn McGee-Lennon, S. Brewster
|
|
15:50-17:00
|
Town Hall Meeting
|
Friday, October 26th, 2012
|
|
Workshop overviews
|
| |
Workshop on Speech and Gesture Production in Virtually and Physically Embodied Conversational Agents
Ross Mead, Maha Salem
http://robotics.usc.edu/~icmi
Carousel Ballroom C
|
| |
1st International Workshop on Multimodal Learning Analytics
Stefan Scherer, Marcelo Worsley, Louis-Philippe Morency
http://tltl.stanford.edu/mla2012
Marquee I Ballroom |
| |
4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
Yukiko I. Nakano, Kristiina Jokinen, Hung-Hsuan Huang
http://www.ci.seikei.ac.jp/nakano/GAZE_ICMI2012
Carousel Ballroom A
|
| |
The 3rd International Workshop on Social Behaviour in Music (SBM2012)
Antonio Camurri, Donald Glowinski, Maurizio Mancini, Giovanna Varni, Gualtiero Volpe
http://www.infomus.org/Events/SBM2012
Carousel Ballroom B
|
| |
Smart Material Interfaces: "A Material Step to the Future"
Anton Nijholt, Leonardo Giusti, Andrea Minuto, Patrizia Marti
http://smartmaterialinterfaces.wordpress.com
Marquee II Ballroom
|
|
|
|
|
