THCR001

Journals of Accelerator Conferences Website (JACoW)

JACoW is a publisher in Geneva, Switzerland that publishes the proceedings of accelerator conferences held around the world by an international collaboration of editors.

URL	https://doi.org/10.18429/JACoW-ICALEPCS2025-THCR001
Title	Data management infrastructure for European XFEL
Authors	J. Malka, D. Boukhelef, G. Previtali, J. Szuba, K. Filippakopoulos, K. Wrona, L. Maia, S. Aplin, T. Piszczek European X-Ray Free-Electron Laser C. Voss, F. Schluenzen, J. Hannappel, K. Hoyos, K. Ohrenberg, K. Schwarz, M. Sahakyan, M. Gasthuber, M. Karimi, P. Suchowski, R. Lueken, S. Dietrich, S. Sternberger, T. Mkrtchyan, Y. Kemp Deutsches Elektronen-Synchrotron DESY
Abstract	Effective data management is crucial for accessible and usable research data. This presentation will describe the data infrastructure at the European XFEL, built on a four-layer storage architecture designed for high-throughput handling. The first layer, Online storage, acts as a high-speed cache for data rates up to 15 GB/s. The second layer, High-Performance Storage, supports real-time processing and analysis, both connected via a 1 Tb/s InfiniBand link spanning 4.4 km to the DESY computing center. The third layer, Mass Storage, enables mid-term access for in-depth analysis, while the Tape Archive ensures secure long-term storage beyond 10 years. Integrated with computing clusters, the system supports both near-online and offline analysis, or data export. Capable of processing up to 2 PB of data per day, the infrastructure demonstrates exceptional performance and reliability.
Paper	download: THCR001.pdf
Cite	BibTeX, LaTeX, Text/Word, RIS, EndNote
Conference	20th Int. Conf. Accel. Large Exp. Phys. Control Syst. (ICALEPCS'25)
Series
Location	Chicago, IL, USA
Date	20-26 Sep 2025
Publisher	JACoW Publishing, Geneva, Switzerland
Editorial Board	Kent Wootton (ANL), Jeffery Biss (FNAL), Gustavo Bruno (ANL), Jeff Kirchman (ANL), Kelly Jaje (ANL), Denise Skiadopoulos (ANL), SuYin Grass Wang (ANL)
Online ISBN	978-3-95450-255-4
Online ISSN	2226-0358
Received	05 September 2025
Revised	25 September 2025
Accepted	29 October 2025
Issued	25 November 2025
DOI	10.18429/JACoW-ICALEPCS2025-THCR001
Pages	1432-1438
Copyright	Published by JACoW Publishing under the terms of the Creative Commons Attribution 4.0 license. Any further distribution of this work must maintain attribution to the author(s), the published article's title, publisher, and DOI.