Journals of Accelerator Conferences Website (JACoW)
JACoW
is a publisher in Geneva, Switzerland that publishes the
proceedings of accelator conferences held around the world
by an international collaboration of editors.
| URL | https://doi.org/10.18429/JACoW-IBIC2024-WEP50 |
|---|---|
| Title | Research on visualization and indexing of data based on the ELK stack |
| Authors |
|
| Abstract | This paper presents a comprehensive solution for the real-time collection and analysis of BPM telemetry data using Kafka and the ELK stack. It includes the transmission of PV variables from BPM electronic devices to the Kafka message queue, thus realizing a powerful and scalable data streaming process. By retrieving JSON formatted data from Kafka using the ELK stack, efficient data indexing and visualization in Kibana are achieved. The paper details the architectural design, implementation details, and the advantages of using Kafka as a BPM data dissemination center. This integration not only enhances the performance and reliability of the data processing pipeline but also provides physicists and engineers with powerful tools for the real-time visualization and monitoring of BPM data. Our approach has shown significant improvements in data accessibility, searchability, and real-time analytics, offering profound implications for future research and development in the instrumentation and diagnostics of particle accelerators. |
| Paper | download: WEP50.pdf |
| Cite | BibTeX, LaTeX, Text/Word, RIS, EndNote |
| Conference | Proc. 13th International Beam Instrumentation Conference |
| Series | |
| Location | Beijing |
| Date | 09-13 Sep 2024 |
| Publisher | JACoW Publishing, Geneva, Switzerland |
| Editorial Board | Jianshe Cao (IHEP), Junhui Yue (IHEP), Lin Bian (IHEP), Ivan Andrian (Elettra-Sincrotrone Trieste S.C.p.A.), Volker RW Schaa (GSI), Zhichu Chen (SARI) |
| Online ISBN | 978-3-95450-249-3 |
| Online ISSN | 2673-5350 |
| Received | 05 September 2024 |
| Revised | 06 September 2024 |
| Accepted | 06 September 2024 |
| Issued | 11 December 2024 |
| DOI | 10.18429/JACoW-IBIC2024-WEP50 |
| Pages | 386-389 |
| Copyright | Published by JACoW Publishing under the terms of the Creative Commons Attribution 4.0 license. Any further distribution of this work must maintain attribution to the author(s), the published article's title, publisher, and DOI. |