Journals of Accelerator Conferences Website (JACoW)
JACoW
is a publisher in Geneva, Switzerland that publishes the
proceedings of accelerator conferences held around the world
by an international collaboration of editors.
| URL | https://doi.org/10.18429/JACoW-ICALEPCS2025-TUPD109 |
|---|---|
| Title | From terabytes to petabyte: scaling of the archiving system for FAIR |
| Authors |
|
| Abstract | With the recent rise of AI and various machine learning models, the importance of storing and managing data generated by control systems is greater than ever before. In 2016, GSI began developing an archiving system to collect, store, and retrieve data from the diverse accelerator devices managed by the GSI control infrastructure. The system was successfully deployed in production in 2021. To evaluate its capabilities and suitability for operational needs, the system was initially launched with a limited storage capacity of 50 TB and reduced computing power. With a current data volume of over 100 GB per day, the archiving system quickly exceeded its initial limits. However, the experience gained in day-to-day operations thus far has allowed us to better understand our use-cases and identify areas for further improvement. In preparation for the anticipated start of FAIR operations in 2027, the system will require significant scaling to meet future demands. Therefore, this is an opportune moment to review and refine the system’s architecture based on the experience gained so far. This paper outlines the challenges encountered with the current implementation and presents the solutions that will be incorporated into the system for FAIR operations. |
| Paper | download: TUPD109.pdf |
| Cite | BibTeX, LaTeX, Text/Word, RIS, EndNote |
| Conference | 20th Int. Conf. Accel. Large Exp. Phys. Control Syst. (ICALEPCS'25) |
| Series | |
| Location | Chicago, IL, USA |
| Date | 20-26 Sep 2025 |
| Publisher | JACoW Publishing, Geneva, Switzerland |
| Editorial Board | Kent Wootton (ANL), Jeffery Biss (FNAL), Gustavo Bruno (ANL), Jeff Kirchman (ANL), Kelly Jaje (ANL), Denise Skiadopoulos (ANL), SuYin Grass Wang (ANL) |
| Online ISBN | 978-3-95450-255-4 |
| Online ISSN | 2226-0358 |
| Received | 05 September 2025 |
| Revised | 24 September 2025 |
| Accepted | 16 October 2025 |
| Issued | 25 November 2025 |
| DOI | 10.18429/JACoW-ICALEPCS2025-TUPD109 |
| Pages | 747-751 |
| Copyright | Published by JACoW Publishing under the terms of the Creative Commons Attribution 4.0 license. Any further distribution of this work must maintain attribution to the author(s), the published article's title, publisher, and DOI. |