Dagstuhl Seminar 20382
Interactive Visualization for Fostering Trust in AI
( Sep 13 – Sep 16, 2020 )
- Polo Chau (Georgia Institute of Technology - Atlanta, US)
- Alex Endert (Georgia Institute of Technology - Atlanta, US)
- Daniel A. Keim (Universität Konstanz, DE)
- Daniela Oelke (Hochschule Offenburg, DE)
- Shida Kunz (for scientific matters)
- Susanne Bach-Bernhard (for administrative matters)
- The Role of Interactive Visualization in Fostering Trust in AI : article - Beauxis-Aussalet, Emma; Behrisch, Michael (Utrecht); Collins, Christopher; El-Assady, Mennatallah; Riveiro, Maria; Wijk, Jarke J. van; Strobelt, Hendrik; Schreck, Tobias; Peltonen, Jaakko; Oelke, Daniela; Kohlhammer, Jörn; Keim, Daniel A.; Endert, Alex; Ebert, David S.; Borgo, Rita - Los Alamitos : IEEE, 2021. - pp. 7-12 - (IEEE computer graphics and applications ; 41. 2021, 6).
Artificial intelligence, and in particular machine learning algorithms, are of increasing importance in many application areas. However, interpretability, understandability, responsibility, accountability, and fairness of the algorithms' results - all crucial for increasing humans' trust into the systems - are still largely missing. All major industrial players, including Google, Microsoft, Apple, and SAP, have become aware of this gap and recently published some form of Guidelines for the Use of AI. Interactive visualization is one of the technologies that has strong potential to increase trust into AI systems.
In our seminar, we want to discuss the requirements for trustworthy AI systems as well as the technological possibilities provided by interactive visualizations to increase human trust in AI. As a first step, we will identify the factors that help to increase the trust of users in AI systems. This involves a discussion of their understandability (interpretable, explainable, intelligible, etc.) as well as their responsibility (accountable, transparent, fair, unbiased, etc.) since these factors drive the design and development of interactive interfaces and AI models to ensure trust. Next, the role that visualizations play in increasing trust in AI system will be illuminated. This includes questions such as: Which mechanisms exist to make AI systems trustworthy? How can interactive visualizations contribute? Under which circumstances are interactive visualizations the decisive factor for enabling responsible AI? And what are the research challenges that still have to be solved – in the area of machine learning or interactive visualization – to leverage this potential in real world applications?
The planned outcome of this seminar is a better understanding of how interactive visualizations can help to foster trust in artificial intelligence systems by making them more understandable and responsible. This should encourage innovative research and help to start joint research projects tackling the issue. Concrete outcomes may be a position paper describing the research challenges identified in the seminar or a special issue featuring interactive visualizations for fostering trust in AI.
Artificial Intelligence (AI) and other computational processes continue to influence decisions across a wide range of applications including healthcare decisions, vehicle navigation, data science, and others. This Dagstuhl seminar reflected on some of the challenges inherent in the goal of increasing the interpretability of these systems, and when applicable, increase the trust people put into them to make decisions. The seminar participants discussed the complexity of trust itself, and how the concept is multi-faceted, and likely outside of researchers in technology and computer science to fully define. We discussed an inter-disciplinary research agenda, as well as a manifesto that should help frame this direction going forward.
- Michael Behrisch (Utrecht University, NL) [dblp]
- Rita Borgo (King's College London, GB) [dblp]
- Mennatallah El-Assady (Universität Konstanz, DE) [dblp]
- Daniel A. Keim (Universität Konstanz, DE) [dblp]
- Jörn Kohlhammer (Fraunhofer IGD - Darmstadt, DE) [dblp]
- Daniela Oelke (Hochschule Offenburg, DE) [dblp]
- Maria Riveiro (Jönköping University, SE) [dblp]
- Tobias Schreck (TU Graz, AT) [dblp]
- Jarke J. van Wijk (TU Eindhoven, NL) [dblp]
- Dagstuhl Seminar 22351: Interactive Visualization for Fostering Trust in ML (2022-08-28 - 2022-09-02) (Details)
- Human-Computer Interaction
- Machine Learning
- Interactive visualization
- machine learning