| Title |
The Study of Big Data Tools Usages in Synchrotrons |
| Authors |
- S. Alizada, A. Khaleghipresenter
ILSF, Tehran, Iran
- A. Khaleghipresenter
IKIU, Qazvin, Iran
|
| Abstract |
In today's world, there is plenty of data being generated from various sources in different areas across economics, engineering and science. For instance, accelerators are able to generate 3 PB data just in one experiment. Synchrotrons industry is an example of the volume and velocity of data which data is too big to be analyzed at once. While some light sources can deal with 11 PB, they confront with data problems. The explosion of data become an important and serious issue in today's synchrotrons world. Totally, these data problems pose in different fields like storage, analytics, visualisation, monitoring and controlling. To override these problems, they prefer HDF5, grid computing, cloud computing and Hadoop/Hbase and NoSQL. Recently, big data takes a lot of attention from academic and industry places. We are looking for an appropriate and feasible solution for data issues in ILSF basically. Contemplating on Hadoop and other up-to-date tools and components is not out of mind as a stable solution. In this paper, we are evaluating big data tools and tested techniques in various light source around the world for data in beamlines studying the storage and analytics aspects.
|
| Paper |
download THPHA034.PDF [0.799 MB / 4 pages] |
| Poster |
download THPHA034_POSTER.PDF [1.345 MB] |
| Export |
download ※ BibTeX
※ LaTeX
※ Text/Word
※ RIS
※ EndNote |
| Conference |
ICALEPCS2017, Barcelona, Spain |
| Series |
International Conference on Accelerator and Large Experimental Control Systems (16th) |
| Proceedings |
Link to full ICALEPCS2017 Proccedings |
| Session |
Poster Session |
| Date |
12-Oct-17 16:45–19:00 |
| Main Classification |
Data Analytics |
| Keywords |
ion, synchrotron, experiment, controls, HOM |
| Publisher |
JACoW, Geneva, Switzerland |
| Editors |
Volker RW Schaa (GSI, Darmstadt, Germany); Isidre Costa (ALBA-CELLS, Cerdanyola del Vallès, Spain); David Fernández (ALBA-CELLS, Cerdanyola del Vallès, Spain); Ãscar Matilla (ALBA-CELLS, Cerdanyola del Vallès, Spain) |
| ISBN |
978-3-95450-193-9 |
| Published |
January 2018 |
| Copyright |
|
