You were the MS\/PhD advisor of one of the authors, or the MS\/PhD advisee of one of the authors. This represents a lifetime conflict of interest.<\/span><\/li>\n<\/ul>\nInstructions for Reviewing Blue Sky Papers<\/b><\/h5>\n
The Blue Sky paper track, introduced in 2021, solicits papers relevant to ICMI content that go beyond the usual research paper to present new visions that stimulate the community to pursue innovative new research directions. They may challenge existing assumptions and methodologies, or propose new applications or theories. The papers are encouraged to present high-risk controversial ideas, preferably ones that are potentially high-impact contributions. Submitted papers are expected to represent deep reflection, to argue rigorously, and to present ideas from a high-level synthetic viewpoint (e.g., multidisciplinary, based on multiple methodologies). Submissions are 4 pages, independent of references.<\/span><\/p>\nThose who compose the invited review panel for these papers will emphasize judgment based on criteria like: breadth of knowledge in the field or relevant multidisciplinary fields, creativity or novelty of ideas, provocativeness of ideas that may run counter to existing assumptions, methods, theory and\/or research beliefs, depth of reflection in considering the topic and its implications, soundness of arguments and critiques, visionary quality of ideas, written presentation quality, and guidance in pursuing important future research directions. No submission in this track will be criticized for presenting too unconventional or \u201cwacky\u201d an idea, for presenting an idea that conflicts with existing research beliefs, or for its political implications per se. High-risk papers presenting entirely novel ideas or critiques are highly encouraged.<\/span><\/p>\nReviewers must maintain an open mind in considering the potential contributions of submissions in this track. As a reminder, unimodal as well as multimodal papers are both entirely acceptable at ICMI, as are papers spanning different methodologies from human behavior studies, to user interaction studies, to system development papers, to machine learning analyses and evaluation, and so forth. A wide range of research content, methodologies, and style are entirely within the scope of ICMI. In fact, since Blue Sky papers may introduce entirely new research challenges for the ICMI community, they will not be judged on whether they are within the scope of ICMI per se. In summary, the quality of Blue Sky papers will be discussed and debated by the invited panel who compose the Blue Sky track selection committee.<\/span><\/p>\nAppendix A<\/b><\/h4>\nAward quality review: Anonymized example<\/b><\/h5>\n
The manuscript <\/span>\u201c(anonymized)\u201d<\/b> is a very clearly written summary of a subset of perceptual phenomena resulting from audio-visual integration in humans. The paper also describes computational models accounting for these phenomena, and their strengths and weaknesses. The aim of the article is to promote a deeper understanding of the psychology of human audio-visual integration, its complexity (including interaction effects), and implications for designing artificial cognitive systems in areas like speech perception, visual perception, object and person tracking, speaker localization and identification, multimodal biometrics, video annotation, and so forth.<\/span><\/p>\nAs such, the article addresses an important but under-acknowledged problem in the design of new A.I. systems based on information fusion. The authors properly frame the problem as one of optimizing performance in a noisy world, and of humans continuously learning and adapting their multimodal integration weightings based on accumulation of evidence as they navigate and interact with the world.<\/span><\/p>\nWhen the discussion turns to implications for designing cognitive systems, however, the paper falls short with respect to being adequately informative. The authors do discuss very generic multimodal system differences in types of fusion\u2014for example, feature versus decision level approaches, and what general impact they may have on temporally-demanding processing or responsivity.<\/span><\/p>\nHowever, the authors do not provide what could be a valuable and provocative discussion on the specific implications of human multimodal integration processes for AI system design. Ideally, this would include (1) an informed discussion of existing multimodal integration architectures, and their main design characteristics; (2) the performance accuracy of these systems in different scenarios (e.g., noisy real-world cases); (3) specific characteristics of human integration processes that differ from those deployed in systems, and what advantages they may have over system architectures; (4) a walk-through example of a multimodal system architecture and how processing occurs (for example, in the case of audio-visual speech perception), pointing out suggestions for integrating human multimodal processing capabilities and testing them in the future, and so forth. That is, this paper would be far more interesting and impactful if it extracted specific implications for experimenting with future system design to potentially improve it.<\/span><\/p>\nA second issue with the manuscript\u2019s current discussion is a focus on the concept that \u201cillusory percepts\u201d result in an \u201cimperfect representation of reality\u201d and could have \u201ccosts\u201d when designing artificial cognitive systems. This emphasis implies that there is a canonically correct or optimal multimodal representation, which is problematic. The evaluation of optimal performance, whether by a human or a system, must be determined from the perspective of achieving a particular goal or goals, and this will entail tradeoffs.<\/span><\/p>\nFrom a system design viewpoint, this paper could begin by discussing the general classes of AI system being built today\u2014for example, autonomous systems without human assistance (e.g., self-driving cars) that may emphasize certain goals, versus AI systems with synergistic human-system interfaces in which the AI component is a tool in service of achieving human goals. A fully autonomous self-driving car may emphasize conservatism in avoiding all collisions, whereas a partially-automated car driven by a person may emphasize collision avoidance with animate objects (e.g., pedestrians) over inanimate objects (e.g., litter blowing in the wind). In this example, the automated system may fail to prioritize collision avoidance with the pedestrian over litter if faced with both simultaneously. Clearly, system design in this case could benefit from better integration of prior knowledge, including human goals and values, rather than simply construction of multimodal representations that aim to avoid \u201cillusions.\u201d One implication here is that future AI systems could be more valuable if they were designed to be continuous learning systems, and not just learning based on A-V perceptual phenomena in association with successfully avoiding all collisions\u2014but also explicit learning of human goals and values.<\/span><\/p>\nRelated to point #4 above, it could be useful to take an example like rapid and accurate identification of a moving piece of litter by an autonomous vehicle, what types of A-V perceptual illusion could potentially occur, and what the implications could be for designing an autonomous vehicle that avoids \u201cillusions\u201d that risk misidentifying the object (e.g., as animate) such that it swerves at high speed on a highway to avoid colliding with it.<\/span><\/p>\nIn other words, your topic is a very important and compelling one for future system design\u2014but to connect with readers and have impact, you should think through concrete examples of implications for system design. I would also suggest broadening your discussion of implications somewhat beyond the risk posed by \u201cillusions.\u201d One issue is that the implication of your concern is that all AI cognitive systems should model human multisensory fusion processes, which is na\u00efve. They are likely to selectively model some human sensory fusion processes, while in other cases pursuing new integration models that supersede human abilities. For example, if I was to design a mobile AI cognitive system for distinguishing edible from poisonous mushrooms, an extremely difficult task for humans, I would add a sensor for chemical analysis and also weight this more heavily than the visual and contextual processing humans normally apply. This paper\u2019s discussion should acknowledge that there are information sources that advanced systems can and will deploy (e.g., lidar) that surpass human sensory abilities\u2014so any fusion involving such data sources will not model human multisensory perception. Some of these distinctions really need to be made when you discuss implications for future AI system design, in order to be credible to your readers.<\/span><\/p>\nIn the above respects, the present consideration of detecting and mitigating illusions in artificial cognitive systems makes unstated assumptions, does not offer sufficiently concrete implications to be useful, and treats the topic related to future system design too narrowly. In addition to the above issues, the discussion of what it means to deploy a \u201cflexible cognitive control mechanism\u201d is presently far too vague to be useful. This paper also could benefit by describing more clearly what is meant by \u201creward,\u201d and why it should have an impact on human multisensory integration and performance. This topic is not treated in enough depth in the present draft. Additional minor point: Figure 7 and Table 1 should be enlarged.<\/span><\/p>\nIn summary, this paper raises an important topic, but it needs to work on developing more specific and credible implications for AI cognitive system design. In doing so, background needs to be provided on the state of AI systems and their design today, including providing concrete examples. More extensive information also needs to be provided on current systems\u2019 information fusion processes, how they differ from human multisensory fusion, and how and why system design could benefit by modeling aspects of human fusion-based processing. Readers also will want to know if there are documented examples of system failure due to fusion-based processing that produces \u201cillusions\u201d (which would be interesting)\u2014or whether this article\u2019s discussion is entirely hypothetical.<\/span><\/p>\nReview: 3 (possibly accept) Recommend the authors revise their paper to strengthen it in accord with the comments provided.<\/span><\/p>\nWhy\u00a0 review is award winning:<\/b> This review is award winning because it fairly summarizes the paper and its contents, and thoughtfully critiques both strengths and weaknesses of the paper. It provides an extended and constructive explanation of four areas in which the paper could be improved, and how it could be improved including specific advice and concrete examples. It then clearly summarizes the main review comments. It also provides a substantial 2-page review.<\/span><\/p>\nConsequences of outstanding reviews:<\/b> The conference committee notices, appreciates, and discusses the best reviews. They have more influence on paper reviewing outcomes, because they provide a clear rationale that is more likely to sway other reviewers. People who consistently provide outstanding reviews are candidates for being invited to join future conference committees, for example as Senior Program Committee members. They may also be recognized formally at the conference with an award for their excellent service.<\/span><\/p>\nInadequate review: Anonymized example:<\/b> \u201cThis submission has major technical flaws, so it should be rejected. It also is an inappropriate paper for ICMI because it only studies vision (not other modalities) and it has no machine learning work.\u201d Review: 1 (definitely reject)<\/span><\/p>\nWhy review is inadequate:<\/b> This is an inadequate review because (1) it fails to provide evidence for the \u201cmajor technical flaws.\u201d In addition, it (2) provides unacceptable reasons for claiming the submission is out of scope for the conference. The length of this review (2 sentences) further confirms its inadequacy.<\/span><\/p>\nConsequences of inadequate reviews::<\/b> Inadequate reviews are highly likely to be discarded and not considered during the review process. Reviewers who submit inadequate reviews also risk being removed from the reviewer database.<\/span><\/p>\n[1] With thanks to the CVPR and CHI conferences, whose guidelines were used as a model.<\/span><\/p>\n[2] See list of conflict-of-interest conditions at the end of this document for reference.<\/span><\/p>\n[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"
Call for Reviewers Attention all experts in multimodal interaction, human-computer interaction, and AI-driven interaction technologies! ICMI 2025 is seeking dedicated reviewers to uphold the conference\u2019s high standards. If you have published as a first author in reputed venues related to multimodal interaction, speech and language processing, computer vision, or related fields, we strongly encourage you […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"\n
This is an example page. It's different from a blog post because it will stay in one place and will show up in your site navigation (in most themes). Most people start with an About page that introduces them to potential site visitors. It might say something like this:<\/p>\n\n\n\n
Hi there! I'm a bike messenger by day, aspiring actor by night, and this is my website. I live in Los Angeles, have a great dog named Jack, and I like pi\u00f1a coladas. (And gettin' caught in the rain.)<\/p><\/blockquote>\n\n\n\n
...or something like this:<\/p>\n\n\n\n
The XYZ Doohickey Company was founded in 1971, and has been providing quality doohickeys to the public ever since. Located in Gotham City, XYZ employs over 2,000 people and does all kinds of awesome things for the Gotham community.<\/p><\/blockquote>\n\n\n\n
As a new WordPress user, you should go to your dashboard<\/a> to delete this page and create new pages for your content. Have fun!<\/p>\n","_et_gb_content_width":"","inline_featured_image":false,"footnotes":""},"class_list":["post-1561","page","type-page","status-publish","hentry"],"yoast_head":"\nReviewer Guidelines - ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Reviewer Guidelines - ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction\" \/>\n<meta property=\"og:description\" content=\"Call for Reviewers Attention all experts in multimodal interaction, human-computer interaction, and AI-driven interaction technologies! ICMI 2025 is seeking dedicated reviewers to uphold the conference\u2019s high standards. If you have published as a first author in reputed venues related to multimodal interaction, speech and language processing, computer vision, or related fields, we strongly encourage you […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/\" \/>\n<meta property=\"og:site_name\" content=\"ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction\" \/>\n<meta property=\"article:modified_time\" content=\"2025-03-12T22:56:01+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"19 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/\",\"url\":\"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/\",\"name\":\"Reviewer Guidelines - ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction\",\"isPartOf\":{\"@id\":\"https:\/\/icmi.acm.org\/2025\/#website\"},\"datePublished\":\"2024-03-27T02:23:19+00:00\",\"dateModified\":\"2025-03-12T22:56:01+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/icmi.acm.org\/2025\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Reviewer Guidelines\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/icmi.acm.org\/2025\/#website\",\"url\":\"https:\/\/icmi.acm.org\/2025\/\",\"name\":\"ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction\",\"description\":\"Australia\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/icmi.acm.org\/2025\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Reviewer Guidelines - ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/","og_locale":"en_US","og_type":"article","og_title":"Reviewer Guidelines - ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction","og_description":"Call for Reviewers Attention all experts in multimodal interaction, human-computer interaction, and AI-driven interaction technologies! ICMI 2025 is seeking dedicated reviewers to uphold the conference\u2019s high standards. If you have published as a first author in reputed venues related to multimodal interaction, speech and language processing, computer vision, or related fields, we strongly encourage you […]","og_url":"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/","og_site_name":"ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction","article_modified_time":"2025-03-12T22:56:01+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"19 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/","url":"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/","name":"Reviewer Guidelines - ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction","isPartOf":{"@id":"https:\/\/icmi.acm.org\/2025\/#website"},"datePublished":"2024-03-27T02:23:19+00:00","dateModified":"2025-03-12T22:56:01+00:00","breadcrumb":{"@id":"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/icmi.acm.org\/2025\/reviewer-guidelines\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/icmi.acm.org\/2025\/"},{"@type":"ListItem","position":2,"name":"Reviewer Guidelines"}]},{"@type":"WebSite","@id":"https:\/\/icmi.acm.org\/2025\/#website","url":"https:\/\/icmi.acm.org\/2025\/","name":"ICMI 2025 :: 27th ACM International Conference on Multimodal Interaction","description":"Australia","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/icmi.acm.org\/2025\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/icmi.acm.org\/2025\/wp-json\/wp\/v2\/pages\/1561","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icmi.acm.org\/2025\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/icmi.acm.org\/2025\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/icmi.acm.org\/2025\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/icmi.acm.org\/2025\/wp-json\/wp\/v2\/comments?post=1561"}],"version-history":[{"count":6,"href":"https:\/\/icmi.acm.org\/2025\/wp-json\/wp\/v2\/pages\/1561\/revisions"}],"predecessor-version":[{"id":2299,"href":"https:\/\/icmi.acm.org\/2025\/wp-json\/wp\/v2\/pages\/1561\/revisions\/2299"}],"wp:attachment":[{"href":"https:\/\/icmi.acm.org\/2025\/wp-json\/wp\/v2\/media?parent=1561"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}