Dagstuhl Seminar 23332
Synergizing Theory and Practice of Automated Algorithm Design for Optimization
( Aug 13 – Aug 18, 2023 )
Permalink
Organizers
- Martin S. Krejca (Ecole Polytechnique - Palaiseau, FR)
- Marius Lindauer (Leibniz Universität Hannover, DE)
- Manuel López-Ibáñez (University of Manchester, GB)
- Katherine M. Malan (UNISA - Pretoria, ZA)
Contact
- Andreas Dolzmann (for scientific matters)
- Simone Schilke (for administrative matters)
Shared Documents
- Dagstuhl Materials Page (Use personal credentials as created in DOOR to log in)
The design of optimization algorithms for tackling real-world problems often requires making tens to hundreds of design decisions that are reflected in the choice of algorithmic components and their hyperparameter values. Due to being a complex, tedious, error-prone, and time-consuming task, there has been major research efforts in the last decade towards developing automatic methods for algorithm design, including algorithm configuration, algorithm selection, and automated machine learning. The general problem of automated algorithm design (AAD) can be formulated as a meta-optimization problem that is mixed-variable, black-box, and stochastic, which requires the use of meta-heuristics.
Despite its relevance, AAD is not sufficiently well understood from a mathematical and theoretical point of view. However, in recent years, theoretical analyses, especially runtime guarantees, have made major contributions to relevant AAD subproblems. The next step is to advance this initial research to the more general problem of AAD. To this end, it has proven useful in the past to support theoretical analyses by empirical research, for example, by searching for optimal parameter values that are unproven yet, or by providing evidence for conjectures regarding the relationship between parameters, problem features, and algorithm performance. So far, this effort has led to a handful of publications that aim to bridge the gap between theory and practice, even including a PhD thesis and one paper winning a best-paper award at GECCO 2022. Still, the potential of such collaborations is exploited quite rarely.
This Dagstuhl Seminar aims at gaining more fundamental insights into AAD by combining theoretical and empirical research and at initiating collaborations between these two areas. To this end, we want to bring together researchers working on the theory of meta-heuristics or on empirical methods and applications of AAD, providing them with the opportunity to improve the mutual understanding between the two fields and to develop ideas about how theory and practice can help each other derive mutually useful results. The participants will work together to tackle various problems in the intersection of both domains, such as: What are the key differences between AAD and other optimization scenarios? What properties of current AAD approaches should come with mathematical guarantees? What characteristics of empirical benchmarks should carry over to benchmarks used for theoretical analysis? How can the empirical toolbox be made more appealing for theoretical research such that it can help uncover unproven, yet interesting hypotheses? How can a unified and consistent language between researchers focusing on theory or empirical results be established? We envision a dynamic seminar where questions and insights arise organically from dynamic discussion groups. This seminar will give participants the chance to meet new people and start new collaborations as well as to shape the future direction of the intersection of theory and practice for AAD.

- Thomas Bäck (Leiden University, NL) [dblp]
- Bernd Bischl (LMU München, DE) [dblp]
- Chris Cameron (University of British Columbia - Vancouver, CA) [dblp]
- Nguyen Dang (University of St Andrews, GB) [dblp]
- Benjamin Doerr (Ecole Polytechnique - Palaiseau, FR) [dblp]
- Carola Doerr (Sorbonne University - Paris, FR) [dblp]
- Tome Eftimov (Jozef Stefan Institute - Ljubljana, SI) [dblp]
- Marcus Gallagher (The University of Queensland - Brisbane, AU) [dblp]
- Nikolaus Hansen (INRIA Saclay - Palaiseau, FR) [dblp]
- Pascal Kerschke (TU Dresden, DE) [dblp]
- Lars Kotthoff (University of Wyoming - Laramie, US) [dblp]
- Martin S. Krejca (Ecole Polytechnique - Palaiseau, FR) [dblp]
- Johannes Lengler (ETH Zürich, CH) [dblp]
- Kevin Leyton-Brown (University of British Columbia - Vancouver, CA) [dblp]
- Marius Lindauer (Leibniz Universität Hannover, DE) [dblp]
- Shengcai Liu (A*STAR - Singapore, SG)
- Manuel López-Ibáñez (University of Manchester, GB) [dblp]
- Katherine M. Malan (UNISA - Pretoria, ZA) [dblp]
- Mario Andrés Muñoz (The University of Melbourne, AU) [dblp]
- Nelishia Pillay (University of Pretoria, ZA) [dblp]
- Shinichi Shirakawa (Yokohama National University, JP) [dblp]
- Thomas Stützle (Free University of Brussels, BE) [dblp]
- Niki van Stein (Leiden University, NL) [dblp]
- Diederick Vermetten (Leiden University, NL) [dblp]
- Marcel Wever (LMU München, DE) [dblp]
- Carsten Witt (Technical University of Denmark - Lyngby, DK) [dblp]
Classification
- Machine Learning
- Neural and Evolutionary Computing
Keywords
- automated algorithm design
- hyper-parameter tuning
- parameter control
- heuristic optimization
- black-box optimization