https://www.dagstuhl.de/21061

February 7 – 12 , 2021, Dagstuhl Seminar 21061

CANCELLED Differential Equations and Continuous-Time Deep Learning

Due to the Covid-19 pandemic, this seminar was cancelled. A related Dagstuhl Seminar was scheduled to August 15 – 19 , 2022 – Seminar 22332.

Organizers

David Duvenaud (University of Toronto, CA)
Markus O. Heinonen (Aalto University, FI)
Michael Schober (Bosch Center for AI – Renningen, DE)
Max Welling (University of Amsterdam, NL)

For support, please contact

Dagstuhl Service Team

Motivation

Deep models have revolutionised machine learning due to their remarkable ability to iteratively construct more and more refined representations of data over the layers. Perhaps unsurprisingly very deep learning architectures have recently been shown to converge to differential equation models, which are ubiquitous in sciences but so far overlooked in machine learning. This striking connection opens new avenues of theory and practise of continuous-time machine learning inspired by physical sciences. Simultaneously neural networks have started to emerge as powerful alternatives to cumbersome mechanistic dynamical systems. Finally, deep learning models in conjecture with stochastic gradient optimization has been used to numerically solve high-dimensional partial differential equations. Thus, we have entered a new era of continuous-time modelling in machine learning.

This change in perspective is currently gaining interest rapidly across domains and provides an excellent and topical opportunity to bring together experts in dynamical systems, computational science, machine learning and the relevant scientific domains to lay solid foundations of these efforts. On the other hand, as the scientific communities, events and outlets are significantly disjoint, it is key to organize an interdisciplinary event and establish novel communication channels to ensure the distribution of relevant knowledge.

Over the course of this Dagstuhl Seminar, we want to establish strong contacts, communication and collaboration of the different research communities. Let’s have an exchange of each community’s best practices, known pitfalls and tricks-of-the-trade. We will try to identify the most important open questions and avenues forward to foster interdisciplinary research. To this end, this seminar will feature not only individual contributed talks, but also general discussions and “collaboration bazaars”, for which participants will have the possibility to pitch ideas for break-out project sessions to each other. In the break-out sessions, participants may discuss open problems, joint research obstacles, or community building work.

Motivation text license
  Creative Commons BY 3.0 DE
  David Duvenaud, Markus O. Heinonen, Michael Schober, and Max Welling

Related Dagstuhl Seminar

Classification

  • Machine Learning
  • Numerical Analysis

Keywords

  • Deep learning
  • Differential equations
  • Numerics
  • Statistics
  • Dynamical systems

Documentation

In the series Dagstuhl Reports each Dagstuhl Seminar and Dagstuhl Perspectives Workshop is documented. The seminar organizers, in cooperation with the collector, prepare a report that includes contributions from the participants' talks together with a summary of the seminar.

 

Download overview leaflet (PDF).

Publications

Furthermore, a comprehensive peer-reviewed collection of research papers can be published in the series Dagstuhl Follow-Ups.

Dagstuhl's Impact

Please inform us when a publication was published as a result from your seminar. These publications are listed in the category Dagstuhl's Impact and are presented on a special shelf on the ground floor of the library.