http://www.dagstuhl.de/17202

14. – 19. Mai 2017, Dagstuhl Seminar 17202

Challenges and Opportunities of User-Level File Systems for HPC

Organisatoren

André Brinkmann (Universität Mainz, DE)
Kathryn Mohror (LLNL – Livermore, US)
Weikuan Yu (Florida State University – Tallahassee, US)


1 / 4 >

Auskunft zu diesem Dagstuhl Seminar erteilen

Susanne Bach-Bernhard zu administrativen Fragen

Roswitha Bardohl zu wissenschaftlichen Fragen

Dagstuhl Reports

Wir bitten die Teilnehmer uns bei der notwendigen Dokumentation zu unterstützen und Abstracts zu ihrem Vortrag, Ergebnisse aus Arbeitsgruppen, etc. zur Veröffentlichung in unserer Serie Dagstuhl Reports einzureichen über unser
Dagstuhl Reports Submission System.

Dokumente

Teilnehmerliste
Gemeinsame Dokumente
Dagstuhl Seminar Wiki

(Zum Einloggen bitte Seminarnummer und Zugangscode verwenden)

Motivation

Although the benefits of hierarchical storage have been adequately demonstrated to the point that the newest leadership class HPC systems will employ burst buffers, critical questions remain for supporting hierarchical storage systems, including: How should we present hierarchical storage systems to user applications, such that they are easy to use and that application code is portable across systems? How should we manage data movement through a storage hierarchy for best performance and resilience of data? How do the particular I/O use cases mandate the way we manage data? There have been many efforts to explore this space in the form of file systems, with increasingly more implemented at the user level. This is because it is relatively easy to swap in new, specialized user-level file systems for use by applications on a case-by-case basis, as opposed to the current mainstream approach of using general-purpose, system-level file systems which may not be optimized for HPC workloads and must be installed by administrators. In contrast, file systems at the user level can be tailored for specific HPC workloads for high performance and can be used by applications without administrator intervention.

Many such user-level file system developers have found themselves “having to reinvent the wheel” to implement various optimizations in their file systems. Thus, it would benefit the larger community if we could develop a common framework for HPC file system development. The framework we envision would be based on solid software engineering practices and would enable “plug and play” interchange of basic file system components. Having this framework would facilitate both the operation needs of current production systems and the research efforts for novel features in future systems. On the production side, the framework would provide a trusted backbone upon which users and developers could rely for basic services. For research, the backbone of the framework would enable rapid prototyping of file system components so that students and other researchers did not have to implement the entire framework simply to experiment with a specific optimization.

The goal of this Dagstuhl Seminar is to bring together experts in I/O performance, file systems, and storage, and collectively explore the space of current and future problems and solutions for I/O on hierarchical storage systems in order to begin a community effort in designing a user-level file system framework for HPC systems. We expect a lively week of learning about each other’s approaches as well as unique I/O use cases that can influence the design of a community-driven file system framework. Our hope is that the effort initiated during this seminar will result in a long-term collaboration that will benefit the HPC community as a whole.

License
  Creative Commons BY 3.0 DE
  André Brinkmann and Kathryn Mohror and Weikuan Yu

Classification

  • Operating Systems

Keywords

  • I/O performance
  • File systems
  • High performance computing workflows

Buchausstellung

Bücher der Teilnehmer 

Buchausstellung im Erdgeschoss der Bibliothek

(nur in der Veranstaltungswoche).

Dokumentation

In der Reihe Dagstuhl Reports werden alle Dagstuhl-Seminare und Dagstuhl-Perspektiven-Workshops dokumentiert. Die Organisatoren stellen zusammen mit dem Collector des Seminars einen Bericht zusammen, der die Beiträge der Autoren zusammenfasst und um eine Zusammenfassung ergänzt.

 

Download Übersichtsflyer (PDF).

Publikationen

Es besteht weiterhin die Möglichkeit, eine umfassende Kollektion begutachteter Arbeiten in der Reihe Dagstuhl Follow-Ups zu publizieren.

Dagstuhl's Impact

Bitte informieren Sie uns, wenn eine Veröffentlichung ausgehend von
Ihrem Seminar entsteht. Derartige Veröffentlichungen werden von uns in der Rubrik Dagstuhl's Impact separat aufgelistet  und im Erdgeschoss der Bibliothek präsentiert.