{"id":1990,"date":"2024-09-30T21:50:35","date_gmt":"2024-09-30T16:20:35","guid":{"rendered":"https:\/\/icmi.acm.org\/2024\/?page_id=1990"},"modified":"2024-10-25T20:14:45","modified_gmt":"2024-10-25T14:44:45","slug":"sessions","status":"publish","type":"page","link":"https:\/\/icmi.acm.org\/2024\/sessions\/","title":{"rendered":"Sessions"},"content":{"rendered":"

[et_pb_section fb_built=”1″ admin_label=”section” _builder_version=”4.14.4″ background_enable_image=”off” custom_padding=”3px||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” min_height=”1612.7px” custom_margin=”|auto|221px|auto||” custom_padding=”4px|||||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#4f4f4f” text_font_size=”13px” header_4_text_color=”#282562″ header_4_line_height=”2em” header_5_text_color=”#6292C2″ header_5_line_height=”1.6em” custom_margin=”||0px|||” custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Sessions<\/b><\/h4>\n

This is a tentative schedule for the Conference Program, we expect to make a few changes soon.<\/p>\n

 <\/p>\n

[\/et_pb_text][et_pb_text module_id=”AEDC” _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ min_height=”1354.4px” custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]Adjunt Events Day 1 08:00-17:30 Doctoral Consortium<\/strong>
\nSession Chair: Yukiko Nakano<\/em><\/p>\n

09:25<\/strong> Opening and Welcome
\nSpeaker: Micol Spitale<\/span>
\n<\/em><\/p>\n

Session 1: Education<\/strong>
\nChair: Micol Spitale<\/span>
\n<\/em><\/p>\n

09:30<\/strong> Enhancing Collaboration and Performance among EMS Students through Multimodal Learning Analytics<\/span>
\nVasundhara Joshi<\/span><\/em>
\nMentor: Catha Oertel<\/span><\/em><\/p>\n

09:55<\/strong> Video Game Technologies Applied for Teaching Assembly Language Programming<\/span>\u200b
\nErnesto Rivera<\/em>
\nMentor: Heloisa Candello<\/span><\/em><\/p>\n

10:20<\/strong> Coffee Break<\/p>\n

Session 2: Robots and Touch<\/strong>
\nChair: Micol Spitale<\/span>
\n<\/em><\/p>\n

10:40<\/strong> A Musical Robot for People with Dementia<\/span>\u200b
\nPaul Raingeard de la Bletiere<\/span><\/em>
\nMentor: Muneeb Ahmad<\/em><\/p>\n

11:05<\/strong> Real-Time Trust Measurement in Human-Robot Interaction: Insights from Physiological Behaviours<\/span>\u200b
\nAbdullah Alzahrani<\/span><\/em>
\nMentor: Sean Andrist<\/em><\/p>\n

11:30<\/strong> Designing Digital Multisensory Textile Experiences<\/span>\u200b
\nShu Zhong<\/span><\/em>
\nMentor: Heloisa Candello<\/em><\/p>\n

12:00 <\/strong>Lunch and Interaction with Mentors<\/p>\n

Session 3: Social Interaction Modeling<\/strong>
\nChair: Micol Spitale<\/span>
\n<\/em><\/p>\n

13:30<\/strong> Towards Automatic Social Involvement Estimation<\/span>\u200b\u200b
\nZonghuan Li<\/span><\/em>
\nMentor: Alessandro Vinciarelli<\/em><\/p>\n

13:55<\/strong> Investigating Multi-Reservoir Computing for EEG-based Emotion Recognition<\/span>\u200b
\nAnubhav Anubhav<\/span><\/em>
\nMentor: Albert Ali Salah<\/em><\/p>\n

14:15<\/strong> Modelling Social Intentions in Complex Conversational Settings<\/span>\u200b
\nIvan Kondyurin<\/span><\/em>
\nMentor: Alessandro Vinciarelli<\/em><\/p>\n

Session 4: Multimodal and Trustworthy AI<\/strong>
\nChair: Micol Spitale<\/span>
\n<\/em><\/p>\n

14:40<\/strong>A Multimodal Understanding of the Eye-Mind Link<\/span>
\nMegan Caruso<\/span><\/em>
\nMentor: Stacy Marsella<\/em><\/p>\n

15:05<\/strong> Towards Trustworthy and Efficient Diffusion Models<\/span>\u200b
\nJayneel Vora<\/span><\/em>
\nMentor: Albert Ali Salah<\/em><\/p>\n

13:3<\/strong> Coffee Break
\n<\/span><\/p>\n

15:45 Early Career Stories: Mentors share early career stories and advice, students can ask any questions to the mentors from career to work-life balance<\/span><\/strong>
\nChair: Micol Spitale<\/em><\/span><\/strong><\/p>\n

17:00<\/strong> Closing<\/span><\/strong><\/p>\n

<\/span><\/strong><\/p>\n

<\/span><\/strong><\/p>\n

[\/et_pb_text][et_pb_text module_id=”AEGC1″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Adjunt Events Day 1 13:30-17:30 Grand Challenge 1 (ERR)<\/strong>
Session Chair: Maria Teresa Parreira
<\/em><\/p>\n

13:30<\/strong> Introduction to the ERR@HRI challenge and baseline paper presentation<\/span>
Maria Teresa Parreira<\/em><\/p>\n

13:45<\/strong> A Time Series Classification Pipeline for Detecting Interaction Ruptures in HRI Based on User Reactions<\/span>
Peter Tisnikar<\/span><\/i><\/p>\n

14:05<\/strong> PRISCA at ERR@HRI 2024: Multimodal Representation Learning for Detecting Interaction Ruptures in HRI<\/span>
Silvia Rossi<\/span><\/i><\/p>\n

14:25<\/strong> Predicting Errors and Failures in Human-Robot Interaction from Multi-Modal Temporal Data<\/span>
Ruben Janssens<\/span><\/i><\/p>\n

14:45 <\/strong>Coffee Break<\/p>\n

15:00<\/strong> Keynote Speaker: TBD<\/span>
Chair: Maia Stiber
<\/span><\/i><\/p>\n

15:30<\/strong> Final discussion: Future Directions<\/span>
Chair: Maia Stiber<\/span><\/i><\/p>\n

16:00<\/strong> Closing<\/p>\n

[\/et_pb_text][et_pb_text module_id=”OS1″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 1 10:30-12:00 Oral Session 1: Multimodal and cross-modal learning<\/strong>
Session Chair: Yukiko Nakano<\/em><\/p>\n

10:30-10:50<\/strong> Mitigation of gender bias in automatic facial non-verbal behaviors generation for interactive social agents nominated for best paper award<\/strong>
A. Delbosc, M. Ochs, N. Sabouret, B. Ravenet, and S. Ayache<\/em><\/p>\n

10:50-11:10<\/strong> DoubleDistillation: Enhancing LLMs for Informal Text Analysis using Multistage Knowledge Distillation from Speech and Text nominated for best paper award<\/strong>
F. Hasan, Y. Li, J. Foulds, S. Pan, B. Bhattacharjee<\/em><\/p>\n

11:10-11:30<\/strong> Do We Need To Watch It All? Efficient Job Interview Video Processing with Differentiable Masking
H. Le, S. Li, C. O. Mawalim, H. H. Huang, C. W. Leong, and S. Okada<\/em><\/p>\n

11:30-11:50<\/strong> A Model of Factors Contributing to the Success of Dialogical Explanations<\/span>
M. Booshehri, H. Buschmeier, and P. Cimiano<\/span><\/i><\/p>\n

[\/et_pb_text][et_pb_text module_id=”OS2″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 1 13:30-15:00<\/strong> Oral Session 2: Human Communication Dynamics<\/strong>
Session Chair: Hendrik Buschmeier<\/em><\/p>\n

13:30-13:50<\/strong> Online Multimodal End-of-Turn Prediction for Three-party Conversations nominated for best paper award<\/strong>
M. C. Lee and Z. Deng<\/em><\/p>\n

13:50-14:10<\/strong> Decoding Contact: Automatic Estimation of Contact Signatures in Parent-Infant Free Play Interactions nominated for best paper award<\/strong>
M. Doyran, A. A. Salah, and R. Poppe<\/em><\/p>\n

14:10-14:30<\/strong> Leveraging Prosody as an Informative Teaching Signal for Agent Learning: Exploratory Studies and Algorithmic Implications
M. Knierim, S. Jain, M. H. Aydo\u011fan, K. Mitra, K. Desai, A. Saran, and K. Baraka<\/em><\/p>\n

14:30-14:50<\/strong> SEMPI: A Database for Understanding Social Engagement in Video-Mediated Multiparty Interaction
M. Siniukov, Y. Yin, E. Fast, Y. Qi, A. Monga, A. Kim, and M. Soleymani<\/em><\/p>\n

<\/strong><\/p>\n

[\/et_pb_text][et_pb_text module_id=”panel” _builder_version=”4.14.4″ _module_preset=”default” hover_enabled=”0″ global_colors_info=”{}” theme_builder_area=”post_content” sticky_enabled=”0″]<\/p>\n

Day 1 15:30-16:30<\/strong> Panel: Multimodal Research in Latin America<\/strong>
Session Chair: Prof. Daniel Gatica-Perez<\/span>
<\/em><\/p>\n

Prof. Carlos Busso, University of Texas Dallas, USA
Dr. Heloisa Candelo, IBM Brazil
Prof. Monica Perusquia-Hernandez, Nara Institute of Science and Technology, Japan
Prof. Laura Cabrera-Quiros, TEC, Costa Rica<\/p>\n

[\/et_pb_text][et_pb_text module_id=”Poster1″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

<\/strong><\/p>\n

Day 1 16:30-18:00<\/strong> Poster Presentations 1 (including DC posters)
Session Chair: Tariq Iqbal<\/em><\/p>\n

Exploring the Alteration and Masking of Everyday Noise Sounds using Auditory Augmented Reality
I. A. Bustoni, M. McGill, and S. Brewster<\/em><\/p>\n

The Plausibility Paradox on Interactions with Complex Virtual Objects in Virtual Environments
D. Alvarado-Chou and Y. Law<\/em><\/p>\n

First-Person Perspective Induces Stronger Feelings of Awe and Presence Compared to Third-Person Perspective in Virtual Reality
H. Otsubo, A. Marquardt, M. Steininger, M. Lehnort, F. Dollack, Y. Hirao, M. Perusquia-Hernandez, H. Uchiyama, E. Kruijff, B. Riecke, and K. Kiyokawa<\/em><\/p>\n

Poke Typing: Effects of Hand-Tracking Input and Key Representation on Mid-Air Text Entry Performance in Virtual Reality
M. Akhoroz and C. Yildirim<\/em><\/p>\n

Is Distance a Modality? Multi-Label Learning for Speech-Based Joint Prediction of Attributed Traits and Perceived Distances in 3D Audio Immersive Environments
E. Fringi, N. Alareef, L. Picinali, S. Brewster, T. Guha, and A. Vinciarelli<\/em><\/p>\n

Feeling Textiles through AI: An exploration into Multimodal Language Models and Human Perception Alignment
S. Zhong, E. Gatti, Y. Cho, and M. Obrist<\/em><\/p>\n

SemanticTap: A Haptic Toolkit for Vibration Semantic Design of Smartphone
R. Zhang, Y. Li, and Y. Jiao<\/em><\/p>\n

QuietSync: Integrating Multimodal Signals for Accurate Silent Speech Interaction with Head-Worn Devices
T. Srivastava, R. M. Winters, T. Gable, Y. T. Wang, T. LaScala, and I. Tashev<\/em><\/p>\n

NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC Array
Q. Cao, J. Zhang, S. Fan, J. Rong, M. Qi, Z. Duan, P. Zhao, L. Liu, Z. Zhou, and W. Chen<\/em><\/p>\n

ScentHaptics: Augmenting the Haptic Experiences of Digital Mid-Air Textiles with Scent
C. Dawes, J. Xue, G. Brianza, P. Cornelio, R. Montano Murillo, E. Maggioni, and M. Obrist<\/em><\/p>\n

LLM-powered Multimodal Insight Summarization for UX Testing
K. Turbeville, J. Muengtaweepongsa, S. Stevens, J. Moss, A. Pon, K. Lee, C. Mehra, J. Gutierrez Villalobos, and R. Kumar<\/em><\/p>\n

Generalization Boost in Bimodal Classification via Data Fusion Trained on Sparse Datasets
W. Yu, D. Kolossa, and R. Nickel<\/em><\/p>\n

A multimodal analysis of environmental stress experienced by older adults during outdoor walking trips: Implications for designing new intelligent technologies to enhance walkability in low-income Latino communities
R. Yupanqui, J. Sohn, Y. Kim, R. Flores, H. Lee, J. Kim, S. Lee, Y. Ham, C. Lee, and T. Chaspari<\/em><\/p>\n

\n

[\/et_pb_text][et_pb_text module_id=”DC” _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 1 16:30-18:00<\/strong> Doctoral Consortium Papers Poster Session
Session Chair: Micol Spitale<\/em><\/p>\n

Towards Trustworthy and Efficient Diffusion Models
Jayneel Vora<\/em><\/p>\n

Video Game Technologies Applied for Teaching Assembly Language Programming
Ernesto Rivera<\/em><\/p>\n

Towards Automatic Social Involvement Estimation
Zonghuan Li<\/em><\/p>\n

A Musical Robot for People with Dementia
Paul Raingeard de la Bletiere<\/em><\/p>\n

Investigating Multi-Reservoir Computing for EEG-based Emotion Recognition
Anubhav Anubhav<\/em><\/p>\n

A Multimodal Understanding of the Eye-Mind Link
Megan Caruso<\/em><\/p>\n

Real-Time Trust Measurement in Human-Robot Interaction: Insights from Physiological Behaviours
Abdullah Alzahrani<\/em><\/p>\n

Designing Digital Multisensory Textile Experiences
Shu Zhong<\/em><\/p>\n

Modelling Social Intentions in Complex Conversational Settings
Ivan Kondyurin<\/em><\/p>\n

Enhancing Collaboration and Performance among EMS Students through Multimodal Learning Analytics
Vasundhara Joshi<\/em><\/p>\n

[\/et_pb_text][et_pb_text module_id=”OS3″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 2 10:30-12:00<\/strong> Oral Session 3: Affective Computing<\/strong>
Session Chair: Carlos Busso<\/em><\/p>\n

10:30-10:50<\/strong> Relating Students Cognitive Processes and Learner-Centered Emotions: An Advanced Deep Learning Approach
A. T S and G. Biswas<\/em><\/p>\n

10:50-11:10<\/strong> On Multimodal Emotion Recognition for Human-Chatbot Interaction in the Wild
N. Kovacevic, C. Holz, M. Gross, and R. Wampfler<\/em><\/p>\n

11:10-11:30<\/strong> Towards Automated Annotation of Infant-Caregiver Engagement Phases with Multimodal Foundation Models
D. Withanage Don, D. Schiller, T. Hallmen, S. Mertes, T. Baur, F. Lingenfelser, M. M\u00fcller, L. Kaubisch, C. Reck, and E. Andr\u00e9<\/em><\/p>\n

11:30-11:50<\/strong> Emotion Recognition for Multimodal Recognition of Attachment in School-Age Children
A. Buker and A. Vinciarelli<\/em><\/p>\n

[\/et_pb_text][et_pb_text module_id=”OS4″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 2 13:30-14:30<\/strong> Oral Session 4: Special session on Personalization of Robot\u2019s Multimodal Behavior<\/strong>
Session Chair: Silvia Rossi<\/em><\/p>\n

13:30-13:50<\/strong> Multimodal User Enjoyment Detection in Human-Robot Conversation: The Power of Large Language Models
A. Pereira, L. Marcinek, J. Miniotaite, S. Thunberg, E. Lagerstedt, J. Gustafson, G. Skantze, and B. Irfan<\/em><\/p>\n

13:50-14:10<\/strong> Predicting Human Intent to Interact with a Public Robot: The People Approaching Robots Database<\/em> (PAR-D
S. Thompson, A. Lew, Y. Li, E. Stanish, A. Huang, R. Phanse, and M. V\u00e1zquez<\/em><\/p>\n

14:10-14:30<\/strong> M2RL: A Multimodal Multi-Interface Dataset for Robot Learning from Human Demonstrations
S. Hasan, M. Yasar, T. Iqbal<\/em><\/p>\n

[\/et_pb_text][et_pb_text module_id=”Poster2″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 2 15:00-17:00<\/strong> Poster Presentations 2 & Demo Session
Session Chair: Monica Perusquia<\/em><\/p>\n

Perceived Text Relevance Estimation Using Scanpaths and GNNs
A. Mohamed Selim, O. S. Bhatti, M. Barz, and D. Sonntag<\/em><\/p>\n

Juicy Text: Onomatopoeia and Semantic Text Effects for Juicy Player Experiences
E. Fabre, K. Seaborn, A. Verhulst, Y. Itoh, and J. Rekimoto<\/em><\/p>\n

Learning Co-Speech Gesture Representations in Dialogue through Contrastive Learning: An Intrinsic Evaluation
E. Ghaleb, B. Khaertdinov, W. Pouw, M. Rasenberg, J. Holler, A, Ozyurek, R. Fernandez<\/em><\/p>\n

Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagement
M. Funk, S. Okada, and E. Andr\u00e9<\/em><\/p>\n

Exploring Interlocutor Gaze Interactions in Conversations based on Functional Spectrum Analysis
A. Tashiro, M. Imamura, S. Kumano, and K. Otsuka<\/em><\/p>\n

Predictability of Understanding in Explanatory Interactions Based on Multimodal Cues
O. Turk, S. Lazarov, Y. Wang, H. Buschmeier, A. Grimminger, and P. Wagner<\/em><\/p>\n

Can Text-to-image Model Assist Multi-modal Learning for Visual Recognition with Visual Modality Missing?
T. Feng, D. Yang, D. Bose, and S. Narayanan<\/em><\/p>\n

Automatic mild cognitive impairment estimation from the group conversation of coimagination method
S. Li, K. Kumagai, M. Otake-Matsuura, and S. Okada<\/em><\/p>\n

Lip Abnormality Detection for Patients with Repaired Cleft Lip and Palate: A Lip Normalization Approach
K. Rosero, A. Salman, R. R. Hallac, and C. Busso<\/em><\/p>\n

“Uh, This One?”: Leveraging Behavioral Signals for Detecting Confusion during Physical Tasks
M. Stiber, D. Bohus, and S. Andrist<\/em><\/p>\n

Understanding Non-Verbal Irony Markers: Machine Learning Insights Versus Human Judgment
M. Spitale, F. Catania, and F. Panzeri<\/em><\/p>\n

\n

[\/et_pb_text][et_pb_text module_id=”Demo” _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 2 15:00-17:00<\/strong> Demo Session
Session Chair: Raj Tumuluri<\/em><\/p>\n

An Adaptive GPT-4-powered Socially Interactive Agent for Conversing about Health
J. Molto, U. Visser, J. Fields, and C. Lisetti<\/em><\/p>\n

An AI-Powered Interactive Interface to Enhance Accessibility of Interview Training for Military Veterans
R. C. Yarlagadda, P. Aggarwal, V. Jamadagni, G. Mahajani, P. Malasani, E. H. Nirjhar, and T. Chaspari<\/em><\/p>\n

Combining Generative and Discriminative AI for High-Stakes Interview Practice
C. W. Leong, N. Jawahar, V. Basheerabad, T. W\u00f6rtwein, A. Emerson, and G. Sivan<\/em><\/p>\n

Enhancing Biodiversity Monitoring: An Interactive Tool for Efficient Identification of Species in Large Bioacoustics Datasets
H. Kath, I. Troshani, B. L\u00fcers, T. S. Gouv\u00eaa, and D. Sonntag<\/em><\/p>\n

ARCADE: An Augmented Reality Display Environment for Multimodal Interaction with Conversational Agents
C. Schindler, D. Mayumi, Y. Matsuda, N. Rach, K. Yasumoto, and W. Minker<\/em><\/p>\n

Let’s Dance Together! AI Dancers Can Dance to Your Favorite Music and Style
R. Ishii, S. Eitoku, S. Matsuo, M. Makiguchi, A. Hoshi, and L. P. Morency<\/em><\/p>\n

Human Contact Annotator: Annotating Physical Contact in Dyadic Interactions
M. Doyran, A. A. Salah, and R. Poppe<\/em><\/p>\n

Bespoke: Using LLM agents to generate just-in-time interfaces by reasoning about user intent
P. Nandy, S. O. Adalgeirsson, A. K. Sinha, T. Kraljic, M. Cleron, L. Shi, A. Singh, A. Chaudhary, A. Ganti, C. A. Melancon, S. Zhang, D. Robishaw, H. Ciurdar, J. Secor, K. A. Robertsen, K. Climer, M. Le, M. Venkatesan, P. Chi, P. Li, P. F. McDermott, R. Shim, S. Onsan, S. Vaishnav, and S. Guam\u00e1n<\/em><\/p>\n

 <\/p>\n

[\/et_pb_text][et_pb_text module_id=”OS5″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 3 10:30-12:00<\/strong> Oral Session 5: Biomedical Data Processing<\/strong>
Session Chair: Ali Etemad<\/em><\/p>\n

Putting the \u201cBrain\u201d Back in the Eye-Mind Link: Aligning Eye Movements and Brain Activations During Naturalistic Reading
M. Caruso, R. Southwell, L. Hirshfield, and S. D’Mello<\/em><\/p>\n

Distinguishing Target and Non-Target Fixations with EEG and Eye Tracking in Realistic Visual Scenes
M. Sharma, C. Mart\u00ednez, B. Wirth, A. Kr\u00fcger, and P. M\u00fcller<\/em><\/p>\n

Detecting Deception in Natural Environments Using Incremental Transfer Learning
M. Ahmad, A. Alzahrani, and S. Ahmad<\/em><\/p>\n

Stressor Type Matters! — Exploring Factors Influencing Cross-Dataset Generalizability of Physiological Stress Detection
P. Prajod, B. Mahesh, and E. Andr\u00e9<\/em><\/p>\n

[\/et_pb_text][et_pb_text module_id=”Challenge” _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 3 <\/strong>14:30-15:00<\/strong> Challenge Overview
Session Chair: Ronald B\u00f6ck<\/em><\/p>\n

Introduction to Grand Challenges 2024
Ronald B\u00f6ck<\/em><\/p>\n

Empathic Virtual Agent Challenge: Appraisal-based Recognition of Affective States
Safaa Azzakhnini<\/em><\/p>\n

ERR@HRI 2024 Challenge: Multimodal Detection of Errors and Failures in Human-Robot Interactions
Micol Spitale<\/em><\/p>\n

\n

[\/et_pb_text][et_pb_text module_id=”BlueSky” _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 3 15:30-16:30<\/strong> Blue Sky Papers
Session Chair: Ali Etemad<\/em><\/p>\n

15:30-15:50<\/strong> AI as Modality in Human Augmentation: Toward New Forms of Multimodal Interaction with AI-Embodied Modalities
R.-D. Vatavu<\/em><\/p>\n

15:50-16:10<\/strong> RealSeal: Revolutionizing Media Authentication with Real-Time Realism Scoring
B. Radharapu and H. Krishna<\/em><\/p>\n

16:10-16:30<\/strong> Everything We Hear: Towards Tackling Misinformation in Podcasts
S. P. Cherumanal, U. Gadiraju and D. Spina<\/em><\/p>\n

[\/et_pb_text][et_pb_text module_id=”Poster3″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 3 <\/strong>16:30-18:00<\/strong> Poster Presentations 3 & Late Breaking Results
Session Chair: Radoslaw Niewiadomski<\/em><\/p>\n

Generating Facial Expression Sequences of Complex Emotions with Generative Adversarial Networks
Z. Belmekki, D. G\u00f3mez J\u00e1uregui, P. Reuter, J. Li, J. C. Martin, K. Jenkins, and N. Couture<\/em><\/p>\n

Envisioning Futures: How the Modality of AI Recommendations Impacts Conversation Flow in AR-enhanced Dialogue
S. Villa, Y. Weiss, M. Y. Lu, M. Ziarko, A. Schmidt, and J. Niess<\/em><\/p>\n

Across Trials vs Subjects vs Contexts: A Multi-Reservoir Computing Approach for EEG Variations in Emotion Recognition
A. Anubhav and K. Fujiwara<\/em><\/p>\n

Detecting Aware and Unaware Mind Wandering During Lecture Viewing: A Multimodal Machine Learning Approach Using Eye Tracking, Facial Videos and Physiological Data
B. B\u00fchler, E. Bozkir, H. Deininger, P. Goldberg, P. Gerjets, U. Trautwein, and E. Kasneci<\/em><\/p>\n

MR-Driven Near-Future Realities: Previewing Everyday Life Real-World Experiences Using Mixed Reality
F. Mathis, B. Myers, B. Lafreniere, M. Glueck, and D. Porpino Sobreira Marques<\/em><\/p>\n

Integrating Multimodal Affective Signals for Stress Detection from Audio-Visual Data
D. Ghose, O. Gitelson, and B. Scassellati<\/em><\/p>\n

Anonymous-Corpus: A Multimodal Database for Understanding Video-Learning Experience
A. Salman, N. Wang, L. Martinez-Lucas, A. Vidal, and C. Busso<\/em><\/p>\n

NapTune: Prompt-tuning for Mood Classification with Wearable Time-series along with Previous Night’s Sleep-related Measures
D. Shome, N. Montazeri Ghahjaverestan, and A. Etemad<\/em><\/p>\n

Improving Usability of Data Charts in Multimodal Documents for Low Vision Users
Y. Prakash, A. Kolgar, Nayak, S. Alyaan, P. A. Khan, H. N. Lee, and V. Ashok<\/em><\/p>\n

Participation Role-Driven Engagement Estimation of ASD Individuals in Neurodiverse Group Discussions
K. Stefanov, Y. Nakano, C. Kobayashi, I. Hoshina, T. Sakato, F. Nihei, C. Takayama, R. Ishii, and M. Tsujii<\/em><\/p>\n

Detecting Autism from Head Movements using Kinesics
M. Gokmen, E. Sariyanidi, L. Yankowitz, C. J. Zampella, R. T. Schultz, and B. Tunc<\/em><\/p>\n

Perception of Stress: A Comparative Multimodal Analysis of Time-Continuous Stress Ratings from Self and Observers
E. H. Nirjhar, W. Arthur Jr., and T. Chaspari<\/em><\/p>\n

[\/et_pb_text][et_pb_text module_id=”LBR” _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Day 3 16:30-18:00 <\/strong>Late Breaking Results
<\/strong>Session Chair: Ronald B\u00f6ck<\/em><\/p>\n

User-Defined Interaction for Very Low-Cost Head-Mounted Displays
Y. C. Law, H. Mendieta-D\u00e1vila, D. Garc\u00eda-Fallas, R. G. Quiros, and M. Chac\u00f3n-Rivas<\/em><\/p>\n

Effects of Incoherence in Multimodal Explanations of Robot Failures
P. Pramanick, N. Federico, L. Raggioli, A. Rossi, and S. Rossi<\/em><\/p>\n

Design and Preliminary Evaluation of a Stress Reflection System for High-Stress Training Environments
S. Akiri, V. Joshi, S. Taherzadeh, G. Williams, H. M. Mentis, and A. Kleinsmith<\/em><\/p>\n

Haptic Feedback to Reduce Individual Differences in Corrective Actions for Skill Learning
S. Ono, N. Ninomiya, and H. Kanai<\/em><\/p>\n

Towards Multimodality: Comparing Quantifications of Movement Coordination
C. Fan, V. Romero, A. Paxton, and T. Chowdhury<\/em><\/p>\n

Unlocking the Potential of Multimodal Compositionality for Enhanced Recommendations through Sentiment Analysis
S. Nazir and M. Sadrzadeh<\/em><\/p>\n

Enhancing Autism Spectrum Disorder Screening: Implementation and Pilot Testing of a Robot-Assisted Digital Tool
A. Di Nuovo and A. Kay<\/em><\/p>\n

Understanding LLMs Ability to Aid Malware Analysts in Bypassing Evasion Techniques
M. Y. Wong, K. Valakuzhy, M. Ahamad, D. Blough, and F. Monrose<\/em><\/p>\n

“Is This It?”: Towards Ecologically Valid Benchmarks for Situated Collaboration
D. Bohus, S. Andrist, Y. Bao, E. Horvitz, and A. Paradiso<\/em><\/p>\n

An Audiotactile System for Accessible Graphs on a Coordinate Plane
C. Yang and P. Taele<\/em><\/p>\n

Levels of Multimodal Interaction
A. K. Sinha, A. Olwal, and C. Kulkarni<\/em><\/p>\n

Comparing Subjective Measures of Workload in Video Game Play: Evaluating the Test-Retest Reliability of the VGDS and NASA-TLX
E. Pretty, R. L. Martins Guarese, H. Fayek, and F. Zambetta<\/em><\/p>\n

Towards Investigating Biases in Spoken Conversational Search
S. P. Cherumanal, J. R. Trippas, and D. Spina<\/em><\/p>\n

Crossmodal Correspondences between Piquancy\/Spiciness and Visual Shape
Y. Wang, M. Ohno, T. Narumi, and Y. ah Seong<\/em>\u00a0<\/strong><\/p>\n

\n

<\/em><\/p>\n

<\/em><\/p>\n

[\/et_pb_text][et_pb_text module_id=”AEGC2″ _builder_version=”4.14.4″ _module_preset=”default” header_text_color=”#282562″ header_4_text_color=”#672B83″ custom_padding=”||0px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Adjunct Events Day 2 09:00-12:00<\/strong> Grand Challenge 2 (EVAC)
Session Chair: Safaa Azzakhnini<\/span><\/em><\/p>\n

09:00<\/strong> EVAC\u20192024 Opening & Challenge Introduction<\/span><\/p>\n

09:40<\/strong> EVAC\u20192024 Contribution – Johns Hopkins Center for Language and Speech Processing<\/p>\n

10:30<\/strong> EVAC\u20192024 Challenge Results<\/p>\n

10:40<\/strong> EVAC\u20192024 Panel Discussion<\/p>\n

11:30<\/strong> Closing<\/p>\n

[\/et_pb_text][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n

Papers not presented in the conference (Included in the main proceedings)<\/strong><\/p>\n

SMURF: Statistical Modality Uniqueness and Redundancy Factorization <\/span>nominated for best paper award<\/b>
W\u00f6rtwein, N. Allen, J. Cohn, L. P. Morency<\/span><\/i><\/p>\n

The impact of auditory warning types and emergency obstacle avoidance takeover scenarios on takeover behavior
X. Li and Z. Xu<\/em><\/p>\n

Low-Rank Adaptation of Time Series Foundational Models for Out-of-Domain Modality Forecasting
D. Gupta, A. Bhatti, S. Parmar, C. Dan, Y. Liu, B. Shen, and S. Lee<\/em><\/p>\n

Nonverbal Dynamics in Dyadic Videoconferencing Interaction: The Role of Video Resolution and Conversational Quality
C. Diao, S. Arevalo Arboleda, and A. Raake<\/em><\/p>\n

[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"

Sessions This is a tentative schedule for the Conference Program, we expect to make a few changes soon.  Adjunt Events Day 1 08:00-17:30 Doctoral Consortium Session Chair: Yukiko Nakano 09:25 Opening and Welcome Speaker: Micol Spitale Session 1: Education Chair: Micol Spitale 09:30 Enhancing Collaboration and Performance among EMS Students through Multimodal Learning Analytics Vasundhara […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"\n

This is an example page. It's different from a blog post because it will stay in one place and will show up in your site navigation (in most themes). Most people start with an About page that introduces them to potential site visitors. It might say something like this:<\/p>\n\n\n\n

Hi there! I'm a bike messenger by day, aspiring actor by night, and this is my website. I live in Los Angeles, have a great dog named Jack, and I like pi\u00f1a coladas. (And gettin' caught in the rain.)<\/p><\/blockquote>\n\n\n\n

...or something like this:<\/p>\n\n\n\n

The XYZ Doohickey Company was founded in 1971, and has been providing quality doohickeys to the public ever since. Located in Gotham City, XYZ employs over 2,000 people and does all kinds of awesome things for the Gotham community.<\/p><\/blockquote>\n\n\n\n

As a new WordPress user, you should go to your dashboard<\/a> to delete this page and create new pages for your content. Have fun!<\/p>\n","_et_gb_content_width":"","inline_featured_image":false,"footnotes":""},"class_list":["post-1990","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/icmi.acm.org\/2024\/wp-json\/wp\/v2\/pages\/1990","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icmi.acm.org\/2024\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/icmi.acm.org\/2024\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/icmi.acm.org\/2024\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/icmi.acm.org\/2024\/wp-json\/wp\/v2\/comments?post=1990"}],"version-history":[{"count":38,"href":"https:\/\/icmi.acm.org\/2024\/wp-json\/wp\/v2\/pages\/1990\/revisions"}],"predecessor-version":[{"id":2099,"href":"https:\/\/icmi.acm.org\/2024\/wp-json\/wp\/v2\/pages\/1990\/revisions\/2099"}],"wp:attachment":[{"href":"https:\/\/icmi.acm.org\/2024\/wp-json\/wp\/v2\/media?parent=1990"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}