October 28 – November 2 , 2001, Dagstuhl Seminar 01441

Coordination and Fusion in Multimodal Interaction


Harry Bunt (Tilburg University, NL)
Mark Maybury (MITRE – Bedford, US)
Wolfgang Wahlster (DFKI – Saarbrücken, DE)

For support, please contact

Dagstuhl Service Team


List of Participants
Dagstuhl's Impact: Documents available


More effective, efficient, and natural interfaces to support access to information, applications, and people are increasingly relevant in our information society which is plagued by information overload from corporate, national, and global information webs, increasing system complexity, and shrinking task time lines. Multimodal interfaces combine speech, gesture, and mimics input and output. They include a number of new facilities that promise to mitigate these modern challenges including:

  1. Understanding of possibly imprecise, ambiguous, or partial multimodal input
  2. Generation of coordinated, cohesive, and coherent multimodal presentations
  3. Management of the interaction (e.g., task completion, tailoring interaction styles, adapting the interface) by representing, reasoning, and exploiting models of the user, domain, task, context and the media (e.g., text, audio, video) itself
  4. Assistance in the design and development of multimodal user interfaces that decreases the time, expense, and level of expertise necessary to construct successful user interfaces

The purpose of this seminar is to bring together the global research leadership of this area in a focused setting to assess current advances, identify fundamental research challenges, and chart the course of collaborative research in this strategic area. As multimodal interaction is by its nature multidisciplinary, an added objective will be to enhance the awareness by the leadership of subcommunities (e.g. in speech and language processing, image processing, interface design, human factors) of each other's research and methods.


In the series Dagstuhl Reports each Dagstuhl Seminar and Dagstuhl Perspectives Workshop is documented. The seminar organizers, in cooperation with the collector, prepare a report that includes contributions from the participants' talks together with a summary of the seminar.


Download overview leaflet (PDF).

Dagstuhl's Impact

Please inform us when a publication was published as a result from your seminar. These publications are listed in the category Dagstuhl's Impact and are presented on a special shelf on the ground floor of the library.


Furthermore, a comprehensive peer-reviewed collection of research papers can be published in the series Dagstuhl Follow-Ups.