Journals of Accelerator Conferences Website (JACoW)
JACoW
is a publisher in Geneva, Switzerland that publishes the
proceedings of accelerator conferences held around the world
by an international collaboration of editors.
| URL | https://doi.org/10.18429/JACoW-ICALEPCS2025-TUMR004 |
|---|---|
| Title | HDB++, a retrospective on 5+ years using TimescaleDB |
| Authors |
|
| Abstract | The Tango HDB++ project is a high-performance, event-driven archiving system that stores data with microsecond resolution timestamps. HDB++ supports various backend databases to accommodate any infrastructure choice, with Timescale as the default option. Timescale, an extension of PostgreSQL, is selected for its exceptional performance, reliability, and open-source license. After more than five years of using the system in production at major facilities such as the ESRF, MAX IV and SKAO, this paper presents the insights gained from operating HDB++ with Timescale in a large research facility. Results are presented considering various perspectives. From a performance standpoint, the paper examines how the scalability features have maintained low query response times despite the continuous growth in data volume over the years. From the system administration perspective, findings show that standardized and proven technologies have consistently supported high-quality service delivery. Lastly, from the user perspective, we analyze how users can query data stored from the inception of the project up to last week within seconds, either from the python API or from clients like grafana. This capability is also enabled by the successful migration and integration of archived data from older or different systems into the database in full compliance with HDB++ standards. |
| Paper | download: TUMR004.pdf |
| Cite | BibTeX, LaTeX, Text/Word, RIS, EndNote |
| Conference | 20th Int. Conf. Accel. Large Exp. Phys. Control Syst. (ICALEPCS'25) |
| Series | |
| Location | Chicago, IL, USA |
| Date | 20-26 Sep 2025 |
| Publisher | JACoW Publishing, Geneva, Switzerland |
| Editorial Board | Kent Wootton (ANL), Jeffery Biss (FNAL), Gustavo Bruno (ANL), Jeff Kirchman (ANL), Kelly Jaje (ANL), Denise Skiadopoulos (ANL), SuYin Grass Wang (ANL) |
| Online ISBN | 978-3-95450-255-4 |
| Online ISSN | 2226-0358 |
| Received | 04 September 2025 |
| Revised | 22 September 2025 |
| Accepted | 27 October 2025 |
| Issued | 25 November 2025 |
| DOI | 10.18429/JACoW-ICALEPCS2025-TUMR004 |
| Pages | 429-433 |
| Copyright | Published by JACoW Publishing under the terms of the Creative Commons Attribution 4.0 license. Any further distribution of this work must maintain attribution to the author(s), the published article's title, publisher, and DOI. |