TY - CONF AU - Meyer, J.M. AU - De Nolf, W. AU - Debionne, S. AU - Fisher, S. AU - Guijarro, M. AU - Guillou, P. AU - Götz, A. AU - Homs Puron, A. AU - Valls, V. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - Facing the Challenges of Experiment Control and Data Management at ESRF-EBS J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - In 2020 the new ESRF-EBS (Extremely Brilliant Source) took-up operation. With the much higher photon flux, experiments are faster and produce more data. To meet the challenges, a complete revision of data acquisition, management and analysis tools was undertaken. The result is a suite of advanced software tools, deployed today on more than 30 beamlines. The main packages are BLISS for experiment control and data acquisition, LIMA2 for high-speed detector control, EWOKS for data reduction and analysis workflows, and Daiquiri the web GUI framework. BLISS is programmed in Python, to allow easy sequence programming for scientists and easy integration of scientific software. BLISS offers: Configuration of hardware and experimental set-ups, a generic scanning engine for step-based and continuous data acquisition, live data display, frameworks to handle 1D and 2D detectors, spectrometers, monochromators, diffractometers (HKL) and regulation loops. For detectors producing very high data rates, data reduction at the source is important. LIMA2 allows parallel data processing to add the necessary computing power (CPU and GPU) for online data reduction in a flexible way. The EWOKS workflow system can use online or offline data to automate data reduction or analysis. Workflows can run locally or on a compute cluster, using CPUs or GPUs. Results are saved or fed back to the control system for display or to adapt the next data acquisition. PB - JACoW Publishing CP - Geneva, Switzerland SP - 66 EP - 70 KW - experiment KW - data-acquisition KW - SRF KW - GUI KW - framework DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-MO2AO01 UR - https://jacow.org/icalepcs2023/papers/mo2ao01.pdf ER - TY - CONF AU - Liuzzo, S.M. AU - Agapov, I.V. AU - Böse, M. AU - Carmignani, N. AU - Carver, L.R. AU - Edelen, A.L. AU - Hellert, T. AU - Hoummi, L. AU - Keil, J. AU - Lacoste, D. AU - Le Meillour, A. AU - Malina, L. AU - Musa, E.S.H. AU - Perron, T.P. AU - Raimondi, P. AU - Roussel, R.J. AU - Veglia, B. AU - White, S.M. AU - Zhang, Z. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - Optimisation of the Touschek Lifetime in Synchrotron Light Sources Using Badger J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - Badger is a software designed to easily access several optimizers (simplex, RCDS, bayesian optimization, etc.) to solve a given multidimensional minimization/maximization task. The Badger software is very flexible and easy to adapt to different facilities. In the framework of the EURIZON European project Badger was used for the EBS and PETRAIII storage rings interfacing with the Tango and TINE control system. Among other tests, the optimisations of Touschek lifetime was performed and compared with the results obtained with existing tools during machine dedicated times. PB - JACoW Publishing CP - Geneva, Switzerland SP - 108 EP - 115 KW - sextupole KW - injection KW - storage-ring KW - operation KW - quadrupole DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-MO3AO01 UR - https://jacow.org/icalepcs2023/papers/mo3ao01.pdf ER - TY - CONF AU - Goryl, P.P. AU - Götz, A. AU - Hardion, V. AU - Hauf, S. AU - Soroka, W. AU - White, K.S. AU - Żytniak, Ł. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - Towards the Zero Code Waste to Increase the Impact of Science J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - Accelerators and other big science facilities rely heavily on internally developed technologies, including control system software. Much of it can and is shared between labs, like the Tango Controls and EPICS. Then, some of it finds broad application outside science, like the famous World Wide Web. However, there are still a lot of duplicating efforts in the labs, and a lot of software has the potential to be applied in other areas. Increasing collaboration and involving private companies can help avoid redundant work. It can decrease the overall costs of laboratory development and operation. Having private industry involved in technology development also increases the chances of new applications. This can positively impact society, which means effective spending of public funds. The talk will be based on the results of a survey looking at how much scientific institutes and companies focus on collaboration and dissemination in the field of software technologies. It will also include remarks based on the authors’ experiences in building an innovative ecosystem. PB - JACoW Publishing CP - Geneva, Switzerland SP - 456 EP - 461 KW - software KW - controls KW - TANGO KW - FEL KW - survey DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-TUMBCMO38 UR - https://jacow.org/icalepcs2023/papers/tumbcmo38.pdf ER - TY - CONF AU - Götz, A. AU - AlMohammad, M. AU - Austin, P. AU - Bodin, M. AU - Bozhinov, V. AU - Cabezas Quirós, R. AU - Davies, L.E. AU - De Maria Antolinos, A. AU - Gaonach, M. AU - Gonzalez Beltran, A. AU - Krahl, R. AU - Matalgah, S.A. AU - Phipps, K.S. AU - Pinto, A. AU - Syder, K. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - Extending the ICAT Metadata Catalogue to New Scientific Use Cases J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - The ICAT metadata catalogue is a flexible solution for managing scientific metadata and data from a wide variety of domains following the FAIR data principles. This paper will present an update of recent developments of the ICAT metadata catalogue and the latest status of the ICAT collaboration. ICAT was originally developed by UK Science and Technology Facilities Council (STFC) to manage the scientific data of ISIS Neutron and Muon Source and Diamond Light Source. They have since been joined by a number of other institutes including ESRF, HZB, SESAME, and ALBA who together now form the ICAT Collaboration. ICAT has been used to manage petabytes of scientific data for ISIS, DLS, ESRF, HZB, and in the future SESAME and ALBA and make these data FAIR. The latest version of the ICAT core as well as the new user interfaces, DataGateway and DataHub, and extensions to ICAT for implementing free text searching, a common search interface across Photon and Neutron catalogues, a protocol-based interface that allows making the metadata available for findability, electronic logbooks, sample tracking, and web-based data and domain specific viewers developed by the community will be presented. Finally recent developments to use ICAT to develop applications for processed data with rich metadata in the fields of small angle scattering, macromolecular crystallography and cryo-electron microscopy will be described. https://icatproject.org PB - JACoW Publishing CP - Geneva, Switzerland SP - 1033 EP - 1040 KW - experiment KW - SRF KW - site KW - synchrotron KW - interface DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-WE3BCO07 UR - https://jacow.org/icalepcs2023/papers/we3bco07.pdf ER - TY - CONF AU - Juerges, T. AU - Abeillé, G. AU - Auger-Williams, R.J. AU - Bertrand, B. AU - Bourtembourg, R. AU - Braun, T. AU - Cuní, G. AU - Götz, A. AU - Hardion, V. AU - Joubert, A.F. AU - Lacoste, D. AU - Leclercq, N. AU - Matveev, Yu. AU - Nabywaniec, M. AU - Noga, T.R. AU - Pascual-Izarra, C. AU - Pivetta, L. AU - Rubio-Manrique, S. AU - Żytniak, Ł. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - The Tango Controls Collaboration Status in 2023 J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - Since 2021 the Tango Controls collaboration has improved and optimised its efforts in many areas. Not only have Special Interest Group meetings (SIGs) been introduced to speed up the adoption of new technologies or improvements, the kernel has switched to a fixed six-month release cycle for quicker adoption of stable kernel versions by the community. CI/CD provides now early feedback on test failures and compatibility issues. Major code refactoring allowed for a much more efficient use of developer resources. Relevant bug fixes, improvements and new features are now adopted at a much higher rate than ever before. The community participation has also noticeably improved. The kernel switched to C++14 and the logging system is undergoing a major refactoring. Among many new features and tools is jupyTango, Jupyter Notebooks on Tango Controls steroids. PyTango is now easy to install via binary wheels, old Python versions are no longer supported, the build-system is switching to CMake, and releases are now made much closer to stable cppTango releases. PB - JACoW Publishing CP - Geneva, Switzerland SP - 1100 EP - 1107 KW - TANGO KW - controls KW - Windows KW - device-server KW - software DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-TH1BCO03 UR - https://jacow.org/icalepcs2023/papers/th1bco03.pdf ER - TY - CONF AU - Lacoste, D. AU - Bourtembourg, R. AU - Forsberg, J. AU - Juerges, T. AU - Mol, J.J.D. AU - Pivetta, L. AU - Rubio-Manrique, S. AU - Scalamera, G. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - New Developements on HDB++, the High-performance Data Archiving for Tango Controls J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - The Tango HDB++ project is a high performance event-driven archiving system which stores data with micro-second resolution timestamps. HDB++ supports many different backends, including MySQL/MariaDB, TimeScaleDB (a time-series PostgreSQL extension), and soon SQLite. Building on its flexible design, latest developments made supporting new backends even easier. HDB++ keeps improving with new features such as batch insertion and by becoming easier to install or setup in a testing environment, using ready to use docker images and striving to simplify all the steps of deployment. The HDB++ project is not only a data storage installation, but a full ecosystem to manage data, query it, and get the information needed. In this effort a lot of tools were developed to put a powerful backend to its proper use and be able to get the best out of the stored data. In this paper we will present as well the latest developments in data extraction, from low level libraries to web viewer integration such as grafana. Pointing out strategies in use in terms of data decimation, compression and others to help deliver data as fast as possible. PB - JACoW Publishing CP - Geneva, Switzerland SP - 1190 EP - 1194 KW - TANGO KW - database KW - controls KW - interface KW - extraction DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-THMBCMO01 UR - https://jacow.org/icalepcs2023/papers/thmbcmo01.pdf ER - TY - CONF AU - Avila-Abellan, J.A. AU - Cobb, T.M. AU - Hino, R. AU - Seeck, O.H. AU - Serra-Gallifa, X. AU - Zhang, S. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - Towards Defining a Synchronization Standard Between Beamline Components and Synchrotron Accelerators J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - Standardization is a magic word in the electronics engineering jargon. Under its umbrella, it is generated the utopia of transparent integration with the rest of the parts with minimal extra effort for the software integration. But the experimental setup in a synchrotron beamline presents multiple challenges: it is highly dynamic and diverse. In the frame of LEAPS-INNOV project (*), the Task 3 of Work Package 5 aims to define a standard for synchronization in the beamline sample environment. Their partners (ALBA, DESY, DLS, ESRF and SOLEIL) have already reached a common vision of synchronization requirements. This paper first details the participants’ actual synchronization needs on their facilities. Next, the requirements foreseen for the future are outlined in terms of interfaces, time constraints and compatibility with timing systems. To conclude, we summarize the current state of the project: the hardware interfaces and the hardware platform definition. They both have been decided considering long-term availability, use of standard sub-components, and keeping the compromise between cost, development time, maintenance, reliability, flexibility and performance. This hardware architecture proposal meets the identified requirements. In the future, under the scope of LEAPS-INNOV, a demonstrator will be built, and we will work with the industry for its future commercialization. PB - JACoW Publishing CP - Geneva, Switzerland SP - 1242 EP - 1246 KW - experiment KW - interface KW - hardware KW - FPGA KW - synchrotron DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-THMBCMO22 UR - https://jacow.org/icalepcs2023/papers/thmbcmo22.pdf ER - TY - CONF AU - Debionne, S. AU - Claustre, L. AU - Fajardo, P. AU - Götz, A. AU - Homs Puron, A. AU - Kieffer, J. AU - Ponsard, R. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - LImA2: Edge Distributed Acquisition and Processing Framework for High Performance 2D Detectors J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - LImA is a framework born at the ESRF for 2D Data Acquisition (DAQ), basic Online Data Analysis (ODA) and processing with high-throughput detectors. While in production for 15 years in several synchrotron facilities, the ever-increasing detector frame rates make more and more difficult performing DAQ & ODA tasks on a single computer. LImA2 is designed to scale horizontally, using multiple hosts for DAQ & ODA. This enables more advanced strategies for data feature extraction while keeping a low latency. LImA2 separates three functional blocks: detector control, image acquisition, and data processing. A control process configures the detector, while one or more receiver processes perform the DAQ and ODA, like the generation of fast feedback signals. The detectors currently supported in LImA2 are the PSI/Jungfrau, the ESRF/Smartpix and the Dectris/Eiger2. The former performs pixel assembly and intensity correction in GPU; the second exploits RoCE capabilities; and the latter features dual threshold, multi-band images. Raw data rates up to 8 GByte/s can be handled by a single computer, scalable if necessary. In addition to a classic processing, advanced pipelines are also implemented. A Serial-MX/pyFAI pipeline extracts diffraction peaks in GPU in order to filter low quality data. NVIDIA GPUDirect is used by a third pipeline providing 2D processing with remarkable low latency. IBM Power9 optimizations like the NX GZIP compression and the PCI-e multi-host extension are exploited. PB - JACoW Publishing CP - Geneva, Switzerland SP - 1269 EP - 1274 KW - detector KW - controls KW - SRF KW - GPU KW - experiment DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-THMBCMO31 UR - https://jacow.org/icalepcs2023/papers/thmbcmo31.pdf ER - TY - CONF AU - Liuzzo, S.M. AU - Carmignani, N. AU - Carver, L.R. AU - Hoummi, L. AU - Leclercq, N. AU - Perron, T.P. AU - Pons, J.L. AU - White, S.M. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - Update on the EBS Storage Ring Beam Dynamics Digital Twin J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - The EBS storage ring control system is presently paired with an electron beam dynamics digital twin (the EBS control system simulator, EBSS*). The EBSS reproduces many of the beam dynamics related quantities relevant for machine operation. This digital twin is used for the preparation and debug of software to deploy for operation. The EBSS is presently working only for the main storage ring and it is not directly connected to the machine operation but works in parallel and on demand. We present here the steps taken towards an on-line continuous use of the EBSS to monitor the evolution of not directly observable parameters such as beam optics. PB - JACoW Publishing CP - Geneva, Switzerland SP - 1306 EP - 1311 KW - controls KW - optics KW - storage-ring KW - TANGO KW - SRF DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-THPDP010 UR - https://jacow.org/icalepcs2023/papers/thpdp010.pdf ER - TY - CONF AU - Malina, L. AU - Agapov, I.V. AU - Carmignani, N. AU - Carver, L.R. AU - Hellert, T. AU - Hoummi, L. AU - Keil, J. AU - Liuzzo, S.M. AU - Musa, E.S.H. AU - Perron, T.P. AU - Veglia, B. AU - White, S.M. ED - Schaa, Volker RW ED - Götz, Andy ED - Venter, Johan ED - White, Karen ED - Robichon, Marie ED - Rowland, Vivienne TI - Python Library for Simulated Commissioning of Storage-Ring Accelerators J2 - Proc. of ICALEPCS2023, Cape Town, South Africa, 09-13 October 2023 CY - Cape Town, South Africa T2 - International Conference on Accelerator and Large Experimental Physics Control Systems T3 - 19 LA - english AB - Simulations of the commissioning procedure became vital to the storage-ring lattice design process. The achievable tolerances on lattice imperfections, such as equipment misalignments or magnet gradient errors, would, without correction, prohibit reaching the design parameters. We present a Python library which includes an extensive set of error sources in the accelerator lattice and provides a variety of correction algorithms to commission a storage ring. The underlying beam dynamics simulations are performed with pyAT. This project builds upon previous works and expands them in the direction of realistic control room experience and software maintainability. The performance is demonstrated using example commissioning studies, and further development plans are discussed. PB - JACoW Publishing CP - Geneva, Switzerland SP - 1637 EP - 1642 KW - MMI KW - lattice KW - simulation KW - storage-ring KW - closed-orbit DA - 2024/02 PY - 2024 SN - 2226-0358 SN - 978-3-95450-238-7 DO - doi:10.18429/JACoW-ICALEPCS2023-FR2AO05 UR - https://jacow.org/icalepcs2023/papers/fr2ao05.pdf ER -