ICMI 2014 Conference Program

Wednesday, 12 November 2014

All four sessions will be held in parallel. The Doctoral Consortium will be held in the Rectorate Hall. The challenges will be held in Vedat Yerlici Conference Hall. You can find a detailed map of the buildings here.

Coffee breaks are scheduled between 10.00-10.30 and 15.30-16:00, the lunch break is scheduled between 12:00-13:30. 


Doctoral Consortium
Session Chair: Marco Cristani

Program available as pdf here


Third Multimodal Learning Analytics Workshop and Grand Challenges

Chairs: Xavier Ochoa, Marcelo Worsley, Katherine Chiluiza, and Saturnino Luz

Program available as pdf here


The Second Emotion Recognition In The Wild Challenge and Workshop (EmotiW)

Chairs: Abhinav Dhall, Roland Goecke, Jyoti Joshi, Karan Sikka, and Tom Gedeon 

Program available as pdf here


MAPTRAITS'14 - Personality Mapping Challenge and Workshop 2014

Chairs: Hatice Gunes, Björn Schuller, Oya Celiktutam, Evangelos Sariyanidi, and Florian Eyben

 Program available as pdf here

Thursday, 13 November 2014

All sessions will take place in the Albert Long Hall, except for the Demos and the Posters will be in the Vedat Yerlici Conference Hall.

Nominees of Outstanding Paper Award and Outstanding Student Paper Award are marked with a star (*)


Albert Salah


Keynote 1: Bursting our Digital Bubbles: Life Beyond the App

Yvonne Rogers 

Session Chair: Albert Ali Salah




Oral Session 1: Dialogue and Social Interaction
Session Chair: Toyoaki Nishida


* Managing Human-Robot Engagement with Forecasts and ... um ... Hesitations
Dan Bohus and Eric Horvitz


Written Activity, Representations and Fluency as Predictors of Domain Expertise in Mathematics
Sharon Oviatt and Adrienne Cohen


* Analysis of Respiration for Prediction of “Who Will Be Next Speaker and When?" in Multi-Party Meetings
Ryo Ishii, Kazuhiro Otsuka, Shiro Kumano, and Junji Yamato


A Multimodal In-Car Dialogue System That Tracks The Driver's Attention
Spyros Kousidis, Casey Kennington, Timo Baumann, Hendrik Buschmeier, Stefan Kopp, and David Schlangen


Bogaziçi University, South Campus


Oral Session 2: Multimodal Fusion
Session Chair: Björn Schuller


* Deep Multimodal Fusion:  Combining Discrete Events and Continuous Signals
Héctor P. Martínez and Georgios N. Yannakakis


* The Additive Value of Multimodal Features for Predicting Engagement, Frustration, and Learning during Tutoring
Joseph F Grafsgaard, Joseph B Wiggins, Alexandria Katarina Vail, Kristy Elizabeth Boyer, Eric N Wiebe, and James C Lester


Computational Analysis of Persuasiveness in Social Multimedia: A Novel Dataset and Multimodal Prediction Approach
Sunghyun Park, Han Suk Shim, Moitreya Chatterjee, Kenji Sagae, and Louis-Philippe Morency


Deception detection using a multimodal approach
Mohamed Abouelenien, Verónica Pérez-Rosas, Rada Mihalcea and Mihai Burzo




Demo and Exhibit Session  
Session Chairs: Lale Akarun and Kazuhiro Otsuka

Multimodal Interaction for Future Control Centers: An Interactive Demonstrator
Ferdinand Fuhrmann and Rene Kaiser


Emotional Charades

Stefano Piana, Alessandra Staglianò, Francesca Odone, and Antonio Camurri


Glass Shooter: Exploring First-Person Shooter Game Control with Google Glass

Chun-Yen Hsu, Ying-Chao Tung, Silvia Chyou, Han-Yu Wang, Jer-Wei Lin, and Mike Y. Chen


Orchestration for Group Videoconferencing an Interactive Demonstrator

Wolfgang Weiss, Rene Kaiser, and Manolis Falelakis


Integrating Remote PPG in Facial Expression Analysis Framework

H. Emrah Tasli, Amogh Gudi, and Marten den Uyl


Context-Aware Multimodal Robotic Health Assistant

Vidyavisal Mangipudi, and Raj Tumuluri


WebSanyog: A Portable Assistive Web Browser for People with Cerebral Palsy
Tirthankar Dasgupta, and Manjira Sinha


The hybrid Agent MARCO

Nicolas Riesterer, Christian Becker-Asano, Julien Hué, Christian Dornhege, and Bernhard Nebel


Towards Supporting Non-linear Navigation in Educational Videos
Om Deshmukh, Kuldeep Yadav, and Kundan Shrivastava


MotionComposer: A Dance-Music Device for Persons with Disabilities

Robert Wechsler, Andreas Bergsland, and .Ekmel Ertan


Poster Session
Session Chairs: Oya Aran and Louis-Philippe Morency

Detecting Conversing Groups with a Single Worn Accelerometer
Hayley Hung, Gwenn Englebienne, and Laura Cabrera Quiros


Identification of the Driver’s Interest Point using a Head Pose Trajectory for Situated Dialog Systems
Young-Ho Kim and Teruhisa Misu


An Explorative Study on Crossmodal Congruence Between Visual and Tactile Icons Based on Emotional Responses
Taekbeom Yoo, Yongjae Yoo, and Seungmoon Choi

Why We Watch the News: A Dataset for Exploring Sentiment in Broadcast Video News
Joseph G. Ellis, Brendan Jou, and Shih-Fu Chang


Dyadic Behavior Analysis in Depression Severity Assessment Interviews
Stefan Scherer, Zakia Hammal, Ying Yang, Louis-Philippe Morency, and Jeffrey Cohn


Touching the Void - Introducing CoST: Corpus of Social Touch
Merel M. Jung, Ronald Poppe, Mannes Poel, and Dirk K. J. Heylen


Unsupervised Domain Adaptation for Personalized Facial Emotion Recognition
Gloria Zen, Enver Sangineto, Elisa Ricci, and Nicu Sebe


Predicting Influential Statements in Group Discussions using Speech and Head Motion Information
Fumio Nihei, Yukiko I. Nakano, Yuki Hayashi, Hung-Hsuan Hung, and Shogo Okada


The relation of eye gaze and face pose: Potential impact on speech recognition
Malcolm Slaney, Andreas Stolcke and Dilek Hakkani-Tur


Speech-Driven Animation Constrained by Appropriate Discourse Functions
Najmeh Sadoughi, Yang Liu, and Carlos Busso


Many Fingers Make Light Work: Non-Visual Capacitive Surface Exploration
Martin Halvey and Andy Crossan


Multimodal Interaction History and its use in Error Detection and Recovery
Felix Schussel, Frank Honold, Miriam Schmidt, Nikola Bubalo, Michael Weber, and Anke Huckauf


Gesture Heatmaps: Understanding Gesture Performance with Colorful Visualizations
Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock


Personal Aesthetics for Soft Biometrics: a Generative Multi-resolution Approach
Cristina Segalin, Alessandro Perina, and Marco Cristani


Statistical Analysis of Personality and Identity in Chats Using a Keylogging Platform
Giorgio Roffo, Cinzia Giorgetta, Roberta Ferrario, Walter Riviera, and Marco Cristani


Synchronising Physiological and Behavioural Sensors in a Driving Simulator
Ronnie Taib, Benjamin Itzstein, and Kun Yu


Data-Driven Model of Nonverbal Behavior for Socially Assistive Human-Robot Interactions
Henny Admoni and Brian Scassellati


Towards Automated Assessment of Public Speaking Skills Using Multimodal Cues
Lei Chen, Gary Feng, Jilliam Joe, Chee Wee Leong, Christopher Kitchen, and Chong Min Lee


Increasing Customers' Attention using Implicit and Explicit Interaction in Urban Advertisement
Matthias Woelfel and Luigi Bucchino


System for Presenting and Creating Smell Effects to Video
Risa Suzuki, Shutaro Homma, Eri Matsuura, and Ken-ichi Okada


CrossMotion: Fusing Device and Image Motion for User Identification, Tracking and Device Association
Andrew Wilson and Hrvoje Benko


Understanding Users' Perceived Difficulty of Multi-Touch Gesture Articulation
Yosra Rekik, Radu-Daniel Vatavu, and Laurent Grisoni


A Multimodal Context-based Approach for Distress Assessment
Sayan Ghosh, Moitreya Chatterjee, and Louis-Philippe Morency


Exploring a Model of Gaze for Grounding in Multimodal HRI
Gregor Mehlmann, Kathrin Janowski, Tobias Baur, Markus Haring, Elisabeth Andre, and Patrick Gebhard


Predicting Learning and Engagement in Tutorial Dialogue: A Personality-Based Model
Alexandria Katarina Vail, Joseph F. Grafsgaard, Joseph B. Wiggins, James C. Lester, and Kristy Elizabeth Boyer


Eye gaze for spoken language understanding in multi-modal conversational interactions
Dilek Hakkani-Tur, Malcolm Slaney, Asli Celikyilmaz, and Larry Heck


SoundFlex: Designing Audio to Guide Interactions with Shape-Retaining Deformable Interfaces
Koray Tahiroglu, Thomas Svedstrom, Valtteri Wikstrom, Simon Overstall, Johan Kildal, and Teemu Ahmaniemi


Investigating Intrusiveness of Workload Adaptation
Felix Putze and Tanja Schultz


Welcome Reception

Vedat Yerlici Conference Hall

Friday, 14 November 2014

All sessions will take place in the Albert Long Hall


Keynote 2: Smart Multimodal Interaction Through Big Data
Cafer Tosun
Session Chair: Louis-Philippe Morency




Oral Session 3: Affect and Cognitive Modeling
Session Chair: Sharon Oviatt


Natural Communication about Uncertainties in Situated Interaction
Tomislav Pejsa, Dan Bohus, Michael Cohen, Chit Saw, James Mahoney and Eric Horvitz


The SWELL Knowledge Work Dataset for Stress and User Modeling Research
Saskia Koldijk, Maya Sappelli, Suzan Verberne, Mark Neerincx and Wessel Kraaij


Rhythmic body movements of laughter
Radoslaw Niewiadomski, Maurizio Mancini, Yu Ding, Catherine Pelachaud and Gualtiero Volpe


Automatic blinking detection towards stress discovery
Alvaro Marcos-Ramiro, Marta Marron-Romera, Daniel Pizarro-Perez and Daniel Gatica-Perez


Bogaziçi University, South Campus


Oral Session 4: Nonverbal Behaviors 
Session Chair: Bülent Sankur


* Mid-air Authentication Gestures: An Exploration of Authentication based on Palm and Finger Motions
Ilhan Aslan, Andreas Uhl, Alexander Meschtscherjakov and Manfred Tscheligi


* Automatic Detection of Naturalistic Hand-over-Face Gesture Descriptors
Marwa Mahmoud, Tadas Baltrusaitis and Peter Robinson


Capturing Upper Body Motion in Conversation: an Appearance Quasi-Invariant Approach
Alvaro Marcos-Ramiro, Marta Marron-Romera, Daniel Pizarro-Perez and Daniel Gatica-Perez


User independent gaze estimation by exploiting similarity measures in the eye pair appearance eigenspace  
Nanxiang Li and Carlos Busso




Doctoral Spotlight Session 
Session Chair: Marco Cristani

Exploring Multimodality for Translator-Computer Interaction
Julián Zapata

Towards social touch intelligence: developing a robust system for automatic touch recognition
Merel Jung

Facial Expression Analysis for Estimating Pain in Clinical Settings
Karan Sikka

Realizing Robust Human-Robot Interaction under Real Environments with Noises
Takaaki Sugiyama


Speaker- and Corpus-Independent Methods for Affect Classification in Computational Paralinguistics
Heysem Kaya


The Impact of Changing Communication Practices
Ailbhe Finnerty


Multi-Resident Human Behaviour Identification in Ambient Assisted Living Environments
Hande Alemdar


Gaze-Based Proactive User Interface for Pen-Based Systems
Cagla Cig


Appearance Based User-Independent Gaze Estimation
Nanxiang Li


Affective Analysis of Abstract Paintings Using Statistical Analysis and Art Theory
Andreza Sartori


The Secret Language of Our Body - Affect and Personality Recognition Using Physiological Signals
Julia Wache


Perceptions of interpersonal behavior are influenced by gender, facial expression intensity, and head pose
Jeffrey M. Girard


Authoring Communicative Behaviors for Situated, Embodied Characters
Tomislav Pejsa


Multimodal Analysis and Modeling of Nonverbal Behaviors during Tutoring
Joseph Grafsgaard


Grand Challenge Overviews 
Session Chairs: Hatice Gunes and Dirk Heylen

Third Multimodal Learning Analytics Workshop and Grand Challenges
Xavier Ochoa, Marcelo Worsley, Katherine Chiluiza and Saturnino Luz


The Second Emotion Recognition In The Wild Challenge and Workshop (EmotiW) 2014 Challenge
Abhinav Dhall, Roland Goecke, Jyoti Joshi, Karan Sikka and Tom Gedeon


MAPTRAITS'14 - Personality Mapping Challenge and Workshop 2014
Hatice Gunes, Björn Schuller, Oya Celiktutan, Evangelos Sariyanidi and Florian Eyben


ICMI Sustained Accomplishment Awardee's Keynote: Beyond Multimodal Interfaces: Designing Computers that Stimulate Human Thought

Sharon Oviatt
Session Chairs: Daniel Gatica-Perez


Banquet – Portaxe Shine, Baltalimani
Buses will be leaving at 18:30 (tentative) from the South Campus

Saturday, 15 November 2014

All sessions will take place in the Albert Long Hall. 


Keynote 3: Computation of Emotions

Peter Robinson

Session Chair: Oya Aran




Oral Session 5: Mobile and Urban Interaction
Session Chair: Metin Sezgin


Non-Visual Navigation Using Combined Audio Music and Haptic Cues (1647)
Emily Fujimoto and Matthew Turk


Tactile Feedback for Above-Device Gesture Interfaces: Adding Touch to Touchless Interactions (2941)
Euan Freeman, Stephen Brewster and Vuokko Lantz


Once Upon a Crime: Towards Crime Prediction from Demographics and Mobile Data (2031)
Andrey Bogomolov, Bruno Lepri, Jacopo Staiano, Nuria Oliver, Fabio Pianesi and Alex Pentland 


Impact of Coordinate Systems on 3D Manipulations in Mobile Augmented Reality (1118)
Philipp Tiefenbacher, Steven Wichert, Daniel Merget and Gerhard Rigoll


Bogaziçi University, South Campus


Oral Session 6: Healthcare and Assistive Technologies
Session Chair: Dan Bohus


* Digital Reading Support for The Blind by Multimodal Interaction (2458)
Yasmine El-Glaly and Francis Quek


Measuring child visual attention using markerless head tracking from color and depth sensing cameras (1160)
Jonathan Bidwell, Irfan Essa, Agata Rozga and Gregory Abowd


Bi-Modal Detection of Painful Reaching for Chronic Pain Rehabilitation Systems (2347)
Temitayo Olugbade, Hane Aung, Nadia Bianchi-Berthouze, Nicolai Marquardt and Amanda Williams




Keynote 4: A World without Barriers: Connecting the World across Languages, Distances and Media

Alexander Waibel

Session Chair: Jeffrey Cohn


ICMI Town Hall Meeting

Session Chair: Albert Ali Salah

Sunday, 16 November 2014

All workshops will take place in South Campus of Bogazici University. You can find a detailed map of the buildings here.


Int. Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction

Chairs: Mary Ellen Foster, Manuel Giuliani, and Ron Petrick

Invited Speakers: Daniel Gatica-Perez, Ryo Ishii

Program available as pdf here

Place: Albert Long Hall


Int. Workshop on Understanding and Modeling Multiparty, Multimodal Interactions

Chairs: Samer Al Moubayed, Dan Bohus, Anna Esposito, Dirk Heylen, Maria Koutsombogera, Harris Papageorgiou, and Gabriel Skantze

Invited Speaker: Yukiko Nakano

Program available as pdf here

Place: Demir Demirgil Hall


Int. Workshop on Roadmapping the Future of Multimodal Interaction Research including Business

Chairs: Dirk Heylen, and Alessandro Vinciarelli

Program available as pdf here

Place: Rectorate Hall


2nd Int. Workshop on “Emotion representations and modelling in Human Computer Interaction systems” (ERM4HCI 2014)

Chairs: Kim Hartmann, Klaus Scherer, Ronald Böck, and Björn Schuller

Program available as pdf here

Place: Kriton Curi


The 7th Workshop on Eye Gaze in Intelligent Human Machine Interaction: Eye-Gaze and Multimodality

Chairs: Hung-Hsuan Huang, Roman Bednarik, Kristiina Jokinen, and Yukiko Nakano

Invited Speaker: Dan Bohus

Program available as pdf here

Place: Ozger Arnas 


ICMI 2014 ACM International Conference on Multimodal Interaction. 12-16th November 2014, Istanbul, Turkey. Copyright © 2010-2023