| Title |
Development of the J-PARC Time-Series Data Archiver using a Distributed Database System, II |
| Authors |
- N. Kikuzawa, A. Yoshii
JAEA/J-PARC, Tokai-Mura, Naka-Gun, Ibaraki-Ken, Japan
- H. Ikeda, Y. Kato
JAEA, Ibaraki-ken, Japan
|
| Abstract |
The linac and the RCS in J-PARC (Japan Proton Accelerator Research Complex) have over 64000 EPICS records, providing enormous data to control much equipment. The data has been collected into PostgreSQL, while we are planning to replace it with HBase and Hadoop, a well-known distributed database and a distributed file system that HBase depends on. In the previous conference it was reported that we had constructed an archive system with a new version of HBase and Hadoop that cover a single point of failure, although we realized there were some issues to make progress into a practical phase. In order to revise the system with resolving the issues, we have been reconstructing the system with replacing master nodes with reinforced hardware machines, creating a kickstart file and scripts to automatically set up a node, introducing a monitoring tool to early detect flaws without fail, etc. In this paper these methods are reported, and the performance tests for the new system with accordingly fixing some parameters in HBase and Hadoop, are also examined and reported.
|
| Paper |
download WEPGF052.PDF [0.297 MB / 4 pages] |
| Conference |
ICALEPCS2015, Melbourne, Australia |
| Series |
International Conference on Accelerator and Large Experimental Physics Control Systems (15th) |
| Proceedings |
Link to full ICALEPCS2015 Proccedings |
| Session |
Poster session |
| Date |
21-Oct-15 17:15–18:15 |
| Main Classification |
Data Management, Analytics & Visualisation |
| Keywords |
distributed, database, EPICS, hardware, status |
| Publisher |
JACoW, Geneva, Switzerland |
| Editors |
Lou Corvetti (AS, Clayton, Australia); Kathleen Riches (SLSA, Clayton, Australia); Volker RW Schaa (GSI, Darmstadt, Germany) |
| ISBN |
978-3-95450-148-9 |
| Published |
December 2015 |
| Copyright |
|
