Journals of Accelerator Conferences Website (JACoW)

JACoW is a publisher in Geneva, Switzerland that publishes the proceedings of accelerator conferences held around the world by an international collaboration of editors.

URLhttps://doi.org/10.18429/JACoW-IPAC2025-THYD1
TitleReinforcement learning in particle accelerators
Authors
  • A. Santamaria Garcia
    University of Liverpool
  • A. Eichler, J. Kaiser
    Deutsches Elektronen-Synchrotron DESY
  • C. Xu
    Karlsruhe Institute of Technology
  • S. Hirlaender
    University of Salzburg
AbstractReinforcement learning (RL) is a unique learning paradigm inspired by the behaviour of animals and humans to learn to solve tasks autonomously. Learning occurs through interactions with an environment, exploring, and evaluating strategies under various conditions. RL excels in complex environments, can handle delayed consequences, and is able to learn solely from experience without access to an explicit model of the system. This makes RL particularly promising for particle accelerators, where the dynamic conditions of particle beams and accelerator systems require continuous adaptation, and modelling is challenging. Although RL applications are emerging in accelerator physics and showing promising results, their widespread introduction faces critical challenges. Among the main obstacles are the effective formulation of control problems, training, and the deployment of solutions in real systems. This paper provides an overview of the potential of RL in accelerator applications, highlighting current challenges and future research directions.
Paperdownload: THYD1.pdf
CiteBibTeX, LaTeX, Text/Word, RIS, EndNote
Conference16th International Particle Accelerator Conference
Series
LocationTaipei, Taiwan
Date01-06 Jun 2025
PublisherJACoW Publishing, Geneva, Switzerland
Editorial Board* Ming-Chyuan Lin - National Synchrotron Radiation Research Center * Yoichi Sato - KEK * Jui-Che Huang - National Synchrotron Radiation Research Center * David Button - Australian Nuclear Science and Technology Organisation * Ping-Shun Chuang - National Synchrotron Radiation Research Center
Online ISBN978-3-95450-248-6
Online ISSN2673-5490
Received27 May 2025
Revised30 May 2025
Accepted05 June 2025
Issued05 November 2025
DOI10.18429/JACoW-IPAC2025-THYD1
Pages2481-2486