Dagstuhl Seminar 24211
Evaluation Perspectives of Recommender Systems: Driving Research and Education
( May 20 – May 24, 2024 )
Permalink
Please use the following short url to reference this page:
https://www.dagstuhl.de/24211
Organizers
- Christine Bauer (Paris Lodron Universität Salzburg, AT)
- Alan Said (University of Gothenburg, SE)
- Eva Zangerle (Universität Innsbruck, AT)
Contact
- Marsha Kleinbauer (for scientific matters)
- Simone Schilke (for administrative matters)
Dagstuhl Seminar Wiki
- Dagstuhl Seminar Wiki (Use personal credentials as created in DOOR to log in)
Shared Documents
- Dagstuhl Materials Page (Use personal credentials as created in DOOR to log in)
Schedule
- Upload (Use personal credentials as created in DOOR to log in)
Evaluation is an important cornerstone in the process of researching, developing, and deploying recommender systems. This Dagstuhl Seminar aims to shed light on the different and potentially diverging or contradictory perspectives on the evaluation of recommender systems. Building on the discussions and outcomes of the PERSPECTIVES workshop series held at ACM RecSys 2021-2023, the seminar will bring together academia and industry to critically reflect on the state of the evaluation of recommender systems and create a setting for development and growth.
While recommender systems is largely an applied field, their evaluation builds on and intersects theories from information retrieval, machine learning, and human-computer interaction. Historically, the theories and evaluation approaches in these fields are very different. Thoroughly evaluating recommender systems requires integrating all perspectives. Hence, this seminar will bring together experts from these fields and serve as a vehicle for discussing and developing the state-of-the-art and practice of evaluating recommender systems. The seminar will set the ground for developing recommender systems evaluation metrics, methods, and practices through collaborations and discussions between participants from diverse backgrounds, e.g., academic and industry researchers, industry practitioners, senior and junior. We emphasize the importance of getting and keeping the big picture of a recommender system’s performance in its context of use, for which it is ultimate to incorporate the technical and the human element.
We will set the basis for the next generation of researchers, apt to evaluate and advance recommender systems thoroughly
Creative Commons BY 4.0
Christine Bauer, Alan Said, and Eva Zangerle
- Gediminas Adomavicius (University of Minnesota - Minneapolis, US) [dblp]
- Vito Walter Anelli (Politecnico di Bari, IT)
- Andrea Barraza-Urbina (Grubhub - New York, US)
- Christine Bauer (Paris Lodron Universität Salzburg, AT)
- Joeran Beel (Universität Siegen, DE)
- Alejandro Bellogín (Autonomous University of Madrid, ES)
- Toine Bogers (IT University of Copenhagen, DK) [dblp]
- Peter Brusilovsky (University of Pittsburgh, US) [dblp]
- Robin Burke (University of Colorado - Boulder, US)
- Wanling Cai (Lero, the Science Foundation Ireland - Limerick, IE & Trinity College - Dublin, IE)
- Tommaso Di Noia (Politecnico di Bari, IT)
- Michael D. Ekstrand (Drexel University - Philadelphia, US) [dblp]
- Kim Falk (Copenhagen, DK)
- Andres Ferraro (Pandora, US)
- Bart Goethals (University of Antwerp, BE)
- Neil Hurley (University College Dublin, IE)
- Dietmar Jannach (Alpen-Adria-Universität Klagenfurt, AT) [dblp]
- Olivier Jeunen (ShareChat - London, GB)
- Joseph Konstan (University of Minnesota - Minneapolis, US) [dblp]
- Dominik Kowald (Know Center - Graz, AT & TU Graz, AT) [dblp]
- Maria Maistro (University of Copenhagen, DK) [dblp]
- Lien Michiels (University of Antwerp, BE)
- Julia Neidhardt (TU Wien, AT)
- Özlem Özgöbek (NTNU - Trondheim, NO)
- Sole Pera (TU Delft, NL)
- Lorenzo Porcaro (EC Joint Research Centre - Ispra, IT)
- Alan Said (University of Gothenburg, SE) [dblp]
- Rodrygo Santos (Federal University of Minas Gerais-Belo Horizonte, BR)
- Guy Shani (Ben Gurion University - Beer Sheva, IL) [dblp]
- Manel Slokom (TU Delft, NL)
- Annelien Smets (VU - Brussels, BE)
- Barry Smyth (University College Dublin, IE) [dblp]
- Nava Tintarev (Maastricht University, NL) [dblp]
- Marko Tkalcic (University of Primorska, SI)
- Alexander Tuzhilin (New York University, US) [dblp]
- Tobias Vente (Universität Siegen, DE)
- Robin Verachtert (DPG Media - Antwerpen, BE)
- Lukas Wegmeth (Universität Siegen, DE)
- Martijn Willemsen (TU Eindhoven, NL) [dblp]
- Min Zhang (Tsinghua University - Beijing, CN)
- Jürgen Ziegler (Universität Duisburg-Essen, DE) [dblp]
Classification
- Human-Computer Interaction
- Information Retrieval
- Machine Learning
Keywords
- Recommender Systems
- Evaluation
- Information Retrieval
- User Interaction
- Intelligent Systems
