[et_pb_section fb_built=”1″ admin_label=”section” _builder_version=”4.14.4″ background_enable_image=”off” custom_padding=”3px||5px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” custom_margin=”|auto|-2px|auto||” custom_padding=”4px||6px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#000000″ text_font_size=”13px” header_4_text_color=”#072f93″ header_5_text_color=”#085593″ text_orientation=”justified” custom_margin=”||-2px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n
[\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” custom_margin=”|auto|-2px|auto||” custom_padding=”27px||6px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#000000″ text_font_size=”13px” header_4_text_color=”#072f93″ header_5_text_color=”#085593″ text_orientation=”justified” custom_margin=”||-2px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n
[\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row column_structure=”1_3,2_3″ use_custom_gutter=”on” _builder_version=”4.14.4″ _module_preset=”default” width=”90%” custom_padding=”9px||10px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”1_3″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_image src=”\/\/i0.wp.com\/icmi.acm.org\/2022\/wp-content\/uploads\/2022\/03\/LP-cropped.jpg” title_text=”LP-cropped” _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_image][\/et_pb_column][et_pb_column type=”2_3″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_line_height=”1.4em” header_5_line_height=”0.4em” text_orientation=”justified” custom_margin=”49px|||||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n
Associate Professor in the Language Technology Institute
Carnegie Mellon University<\/p>\n
[\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” custom_margin=”|auto|-2px|auto||” custom_padding=”4px||6px|||” border_width_bottom=”1px” border_color_bottom=”#a8a8a8″ global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#000000″ text_font_size=”13px” header_4_text_color=”#072f93″ header_5_text_color=”#085593″ text_orientation=”justified” custom_margin=”||16px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n
Abstract: <\/strong>Our experience of the world is multimodal – we see objects, hear sounds, feel texture, smell odors, and taste flavors. In recent years, a broad and impactful body of research emerged in artificial intelligence under the umbrella of multimodal, characterized by multiple modalities. As we formalize a long-term research vision for multimodal research, it is important to reflect on its foundational principles and core technical challenges. What is multimodal? Answering this question is complicated by the multi-disciplinary nature of the problem, spread across many domains and research fields. This talk is based on a recent review<\/span> of 700+ research papers, to study computational and theoretical foundations for multimodal research, with a focus on multimodal machine learning. Two key principles have driven many multimodal innovations: heterogeneity and interconnections from multiple modalities. Historical and recent progress will be synthesized in a research-oriented taxonomy, centered around 6 core technical challenges: representation, alignment, reasoning, generation, transference, and quantification. The talk will conclude with open questions and unsolved challenges essential for a long-term research vision in multimodal research.<\/p>\n Bio: <\/strong>Louis-Philippe Morency is Associate Professor in the Language Technology Institute at Carnegie Mellon University where he leads the Multimodal Communication and Machine Learning Laboratory (MultiComp Lab). He was formerly research faculty in the Computer Sciences Department at University of Southern California and received his Ph.D. degree from MIT Computer Science and Artificial Intelligence Laboratory. His research focuses on building the computational foundations to enable computers with the abilities to analyze, recognize and predict subtle human communicative behaviors during social interactions. He received diverse awards including AI\u2019s 10 to Watch by IEEE Intelligent Systems, NetExplo Award in partnership with UNESCO and 10 best paper awards at IEEE and ACM conferences. His research was covered by media outlets such as Wall Street Journal, The Economist and NPR.<\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” custom_margin=”|auto|-2px|auto||” custom_padding=”27px||6px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#000000″ text_font_size=”13px” header_4_text_color=”#072f93″ header_5_text_color=”#085593″ text_orientation=”justified” custom_margin=”||-2px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row column_structure=”1_3,2_3″ use_custom_gutter=”on” _builder_version=”4.14.4″ _module_preset=”default” width=”90%” custom_padding=”9px||10px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”1_3″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_image src=”\/\/i3.wp.com\/icmi.acm.org\/2022\/wp-content\/uploads\/2022\/04\/Cassell-HeadShot-Makers.png” title_text=”Cassell HeadShot Makers” _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_image][\/et_pb_column][et_pb_column type=”2_3″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_line_height=”1.4em” header_5_line_height=”0.4em” text_orientation=”justified” custom_margin=”84px|||||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n Dean\u2019s Chair in Language Technologies, Carnegie Mellon University and Senior Research, Inria Paris<\/span><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” custom_margin=”|auto|-2px|auto||” custom_padding=”4px||6px|||” border_width_bottom=”1px” border_color_bottom=”#bcbcbc” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#000000″ text_font_size=”13px” header_4_text_color=”#072f93″ header_5_text_color=”#085593″ text_orientation=”justified” custom_margin=”||-2px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n Abstract<\/b>: <\/span><\/strong>Even in the most hectic or time-conscious workplace, employees gather in person to chat. And even in the most networked workplace, employees still make time for face-to-face collaboration.\u00a0 This isn’t surprising if we consider that the ability and desire to engage in face-to-face communication (using eye gaze to manage turn-taking, head nods to indicate listening, and smiles to indicate attention) starts soon after birth – well before infants even learn to talk. We might say that we are built to communicate face-to-face! But what role will embodied interaction play in the future workplace, when we will be interacting with autonomous robots, engaging with other people through presence robots, and working in a virtual world where we and our colleagues are represented by avatars? In this talk I will describe some of the ways that embodied interaction is likely to change in the future, and some of the ways that we need to take those future scenarios into account as we design and implement multimodal interfaces.<\/p>\n Bio: <\/strong>Justine Cassell holds the Dean’s Chair in Language Technologies at <\/span>Carnegie Mellon University, and is also a Senior Researcher at Inria <\/span>Paris, where she holds a PRAIRIE chair in Artificial Intelligence. <\/span>Cassell was named a member of the French governmental council the CNNUM, <\/span>on the future of digital technology, in 2021, was honored with the Henry <\/span>and Bryna David award by the National Academies of Science in 2018, <\/span>received the AAMAS “Influential Paper” award in 2017, and is a fellow of <\/span>the AAAS, RSE, and ACM.<\/span>\u00a0She received tenure as a faculty member at MIT. She has been carrying out research on the multimodal nature of conversation, and multimodal technologies, for a very long time.<\/span><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” custom_margin=”|auto|-2px|auto||” custom_padding=”27px||6px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#000000″ text_font_size=”13px” header_4_text_color=”#072f93″ header_5_text_color=”#085593″ text_orientation=”justified” custom_margin=”||-2px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row column_structure=”1_3,2_3″ use_custom_gutter=”on” _builder_version=”4.14.4″ _module_preset=”default” width=”90%” custom_padding=”9px||10px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”1_3″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_image src=”\/\/i3.wp.com\/icmi.acm.org\/2022\/wp-content\/uploads\/2022\/08\/12110-aspect-ratio-448-448.jpeg” title_text=”12110-aspect-ratio-448-448″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_image][\/et_pb_column][et_pb_column type=”2_3″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_line_height=”1.4em” header_5_line_height=”0.4em” text_orientation=”justified” custom_margin=”84px|||||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” custom_margin=”|auto|-2px|auto||” custom_padding=”4px||6px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#000000″ text_font_size=”13px” header_4_text_color=”#072f93″ header_5_text_color=”#085593″ text_orientation=”justified” custom_margin=”||21px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n Abstract:<\/strong> In an era of rising toxic polarization, political intolerance, and plummeting social trust, the need to listen to one another could not be greater. For all the promise of social media to give everyone a voice, in reality it is the loudest and most polarizing voices that tend to dominate. Our research and development teams at the MIT Center for Constructive Communication and Cortico are developing tools and methods designed to foster authentic conversation and scalable deep listening by merging age-old human practices of facilitated dialogue with modern methods of digital design, speech and language processing, and AI-powered data science. We have partnered with field organizations \u2013 ranging from small community organizations to municipalities to global nonprofits \u2013 to make sense of the conversations they collect, amplify typically underheard voices, inform public understanding, drive better policy and decisions, and enable unforeseen connections across the ideological spectrum. In this talk I will provide an overview of the approach, highlight some case studies, and sketch open research questions motivated by the work.<\/p>\n Bio: <\/strong>Deb Roy is Professor of Media Arts and Sciences at MIT where he directs the <\/span>MIT Center for Constructive Communication<\/span><\/a> (CCC). He is also co-founder and CEO of <\/span>Cortico<\/span><\/a>, a nonprofit social technology company and deployment partner of CCC. In collaboration with colleagues at CCC, Cortico, and a growing network of collaborators, Roy designs human-machine systems for understanding and navigating social media media ecosystems, and for creating new communication spaces for stronger democracy.\u00a0<\/span><\/p>\n Previously Roy was a Visiting Professor at <\/span>Harvard Law School<\/span><\/a> in 2021-22, Executive Director of the <\/span>MIT Media Lab<\/span><\/a> from 2019-21, Twitter\u2019s Chief Media Scientist from 2013-17, and co-founder & CEO of <\/span>Bluefin Labs<\/span><\/a>, a media analytics company that became Twitter\u2019s largest acquisition to date in 2013. He is the author of over 175 academic <\/span>papers<\/span><\/a> including a <\/span>study<\/span><\/a> of the spread of false news that was the cover of Science magazine in 2018 and one of the <\/span>most influential academic publications of the year<\/span><\/a>. Roy\u2019s widely-viewed TED talk <\/span>Birth of a Word<\/span><\/a> presents his research on his son\u2019s language development that led to new ideas in media analytics, while his 2021 <\/span>Chautauqua lecture<\/span><\/a> envisions a new kind of social communication platform for a stronger democracy.<\/span><\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row admin_label=”row” _builder_version=”4.14.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” width=”90%” custom_margin=”|auto|-2px|auto||” custom_padding=”27px||6px|||” border_width_top=”1px” border_color_top=”#969696″ global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” global_colors_info=”{}” custom_padding__hover=”|||” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_text_color=”#000000″ text_font_size=”13px” header_4_text_color=”#072f93″ header_5_text_color=”#085593″ text_orientation=”justified” custom_margin=”||-2px|||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row column_structure=”1_3,2_3″ use_custom_gutter=”on” _builder_version=”4.14.4″ _module_preset=”default” width=”90%” custom_padding=”9px||10px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”1_3″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_image src=”\/\/i3.wp.com\/icmi.acm.org\/2022\/wp-content\/uploads\/2022\/09\/dgp.png” title_text=”dgp” _builder_version=”4.14.4″ _module_preset=”default” max_width=”86%” global_colors_info=”{}” theme_builder_area=”post_content”][\/et_pb_image][\/et_pb_column][et_pb_column type=”2_3″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_font=”||||||||” text_line_height=”1.4em” header_5_line_height=”0.4em” text_orientation=”justified” custom_margin=”123px|||||” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][et_pb_row use_custom_gutter=”on” _builder_version=”4.14.4″ _module_preset=”default” width=”90%” custom_padding=”9px||10px|||” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_column type=”4_4″ _builder_version=”4.14.4″ _module_preset=”default” global_colors_info=”{}” theme_builder_area=”post_content”][et_pb_text _builder_version=”4.14.4″ _module_preset=”default” text_text_color=”#000000″ text_font_size=”13px” global_colors_info=”{}” theme_builder_area=”post_content”]<\/p>\n Abstract:<\/strong> A substantial body of research in multimodal interaction has studied how people naturally interact \u2013 face-to-face and through machines – and developed technology to analyze, support, and extend such forms of interaction. The talk will share personal experiences and views on how audio-visual and ubiquitous research on social interaction has evolved over the past two decades. Five recurrent questions, then and now, include how to study interaction in everyday life; how to learn from and collaborate with the humanities and social sciences; how to think about data; how to address the challenges brought by automation; and how to engage and empower individuals and communities to take part in research projects. Today, the limitations of technology-centric solutions are more evident than ever. Future research with a people-first focus will continue to call for reflection, commitment, and action for a long-term alignment with societal needs and nature\u2019s limits.<\/p>\n Bio: <\/b>Daniel Gatica-Perez directs the Social Computing Group at Idiap, and is adjunct professor with EPFL School of Engineering and College of Humanities.\u00a0His research uses methods from ubiquitous computing, social media, and machine learning to study how people and technology interface in everyday life. He has been a member of the ICMI community in the last two decades, serving in the past as Chair of the Conference Steering Board among other roles. He serves on the Editorial Board of the Proceedings of the ACM on Interactive, Mobile, Wearable, and Ubiquitous Technologies (IMWUT). He also works with cities and organizations on social innovation projects.<\/p>\n [\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":" Keynote SpeakersWhat is Multimodal?Louis-Philippe Morency Associate Professor in the Language Technology InstituteCarnegie Mellon UniversityAbstract: Our experience of the world is multimodal – we see objects, hear sounds, feel texture, smell odors, and taste flavors. In recent years, a broad and impactful body of research emerged in artificial intelligence under the umbrella of multimodal, characterized by […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"open","template":"","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"\n This is an example page. It's different from a blog post because it will stay in one place and will show up in your site navigation (in most themes). Most people start with an About page that introduces them to potential site visitors. It might say something like this:<\/p>\n\n\n\n Hi there! I'm a bike messenger by day, aspiring actor by night, and this is my website. I live in Los Angeles, have a great dog named Jack, and I like pi\u00f1a coladas. (And gettin' caught in the rain.)<\/p><\/blockquote>\n\n\n\n ...or something like this:<\/p>\n\n\n\n The XYZ Doohickey Company was founded in 1971, and has been providing quality doohickeys to the public ever since. Located in Gotham City, XYZ employs over 2,000 people and does all kinds of awesome things for the Gotham community.<\/p><\/blockquote>\n\n\n\nThe Future of the Body in Tomorrow’s Workplace<\/strong><\/h5>\n
Justine Cassell\u00a0<\/strong><\/h5>\n
Real Talk, Real Listening, Real Change<\/strong><\/h5>\n
Deb Roy\u00a0<\/strong><\/h5>\n
Focus on People: Five Questions from Human-Centered Computing<\/strong><\/h5>\n
Daniel Gatica-Perez<\/span> <\/strong><\/h5>\n