https://www.dagstuhl.de/22442

30. Oktober – 04. November 2022, Dagstuhl-Seminar 22442

Toward Scientific Evidence Standards in Empirical Computer Science

Organisatoren

Brett A. Becker (University College Dublin, IE)
Christopher D. Hundhausen (Washington State University – Pullman, US)
Ciera Jaspan (Google – Mountain View, US)
Andreas Stefik (University of Nevada – Las Vegas, US)
Thomas Zimmermann (Microsoft Corporation – Redmond, US)

Auskunft zu diesem Dagstuhl-Seminar erteilen

Simone Schilke zu administrativen Fragen

Michael Gerke zu wissenschaftlichen Fragen

Dokumente

Programm des Dagstuhl-Seminars (Hochladen)

(Zum Einloggen bitte persönliche DOOR-Zugangsdaten verwenden)

Motivation

Many scientific fields of study use formally established evidence standards during the peer review and evaluation process, such as CONSORT (http://www.consort-statement.org) in medicine, the What Works Clearinghouse (https://ies.ed.gov/ncee/wwc/) in education, or the APA Journal Article Reporting Standards (JARS) in psychology (https://apastyle.apa.org/jars). The basis for these standards is community agreement on what to report in empirical studies. Such standards achieve two key goals. First, they make it easier to compare studies, facilitating replications which can provide confidence that multiple research teams can obtain the same results. Second, they establish community agreement on how to report on and evaluate studies using different methodologies.

The discipline of computer science does not have formalized evidence standards, even for major conferences or journals. This Dagstuhl Seminar has three primary objectives:

  1. To establish a process for creating or adopting an existing evidence standard for empirical research in computer science.
  2. To build a community of scholars that can discuss what a general standard should include.
  3. To kickstart the discussion with scholars from software engineering, human computer interaction, and computer science education.

In order to better discuss and understand the implications of such standards across several empirical subfields of computer science and to facilitate adoption, our plan for the seminar includes having representatives from prominent journals in attendance.

Motivation text license
  Creative Commons BY 4.0
  Brett A. Becker, Christopher D. Hundhausen, Ciera Jaspan, Andreas Stefik, and Thomas Zimmermann

Classification

  • Computers And Society
  • Human-Computer Interaction
  • Software Engineering

Keywords

  • Community Evidence Standards
  • Human Factors

Dokumentation

In der Reihe Dagstuhl Reports werden alle Dagstuhl-Seminare und Dagstuhl-Perspektiven-Workshops dokumentiert. Die Organisatoren stellen zusammen mit dem Collector des Seminars einen Bericht zusammen, der die Beiträge der Autoren zusammenfasst und um eine Zusammenfassung ergänzt.

 

Download Übersichtsflyer (PDF).

Dagstuhl's Impact

Bitte informieren Sie uns, wenn eine Veröffentlichung ausgehend von Ihrem Seminar entsteht. Derartige Veröffentlichungen werden von uns in der Rubrik Dagstuhl's Impact separat aufgelistet  und im Erdgeschoss der Bibliothek präsentiert.

Publikationen

Es besteht weiterhin die Möglichkeit, eine umfassende Kollektion begutachteter Arbeiten in der Reihe Dagstuhl Follow-Ups zu publizieren.