Scientific data exchange: A schema for HDF5-based storage of raw and analyzed data

Francesco De Carlo; Doa Gürsoy; Federica Marone; Mark Rivers; Dilworth Y. Parkinson; Faisal Khan; Nicholas Schwarz; David J. Vine; Stefan Vogt; Sophie Charlotte Gleber; Suresh Narayanan; Matt Newville; Tony Lanzirotti; Yue Sun; Young Pyo Hong; Chris Jacobsen

doi:10.1107/S160057751401604X

Scientific data exchange: A schema for HDF5-based storage of raw and analyzed data

Francesco De Carlo^*, Doa Gürsoy, Federica Marone, Mark Rivers, Dilworth Y. Parkinson, Faisal Khan, Nicholas Schwarz, David J. Vine, Stefan Vogt, Sophie Charlotte Gleber, Suresh Narayanan, Matt Newville, Tony Lanzirotti, Yue Sun, Young Pyo Hong, Chris Jacobsen

^*Corresponding author for this work

Physics and Astronomy

Research output: Contribution to journal › Article › peer-review

76 Scopus citations

Abstract

Data Exchange is a simple data model designed to interface, or 'exchange', data among different instruments, and to enable sharing of data analysis tools. Data Exchange focuses on technique rather than instrument descriptions, and on provenance tracking of analysis steps and results. In this paper the successful application of the Data Exchange model to a variety of X-ray techniques, including tomography, fluorescence spectroscopy, fluorescence tomography and photon correlation spectroscopy, is described.

Original language	English (US)
Pages (from-to)	1224-1230
Number of pages	7
Journal	Journal of Synchrotron Radiation
Volume	21
Issue number	6
DOIs	https://doi.org/10.1107/S160057751401604X
State	Published - Nov 1 2014

Keywords

HDF5
data storage
provenance

ASJC Scopus subject areas

Radiation
Nuclear and High Energy Physics
Instrumentation

Access to Document

10.1107/S160057751401604X

Cite this

De Carlo, F., Gürsoy, D., Marone, F., Rivers, M., Parkinson, D. Y., Khan, F., Schwarz, N., Vine, D. J., Vogt, S., Gleber, S. C., Narayanan, S., Newville, M., Lanzirotti, T., Sun, Y., Hong, Y. P., & Jacobsen, C. (2014). Scientific data exchange: A schema for HDF5-based storage of raw and analyzed data. Journal of Synchrotron Radiation, 21(6), 1224-1230. https://doi.org/10.1107/S160057751401604X

@article{93b3fe51ae7b4d7590adf1af3aeb0080,

title = "Scientific data exchange: A schema for HDF5-based storage of raw and analyzed data",

abstract = "Data Exchange is a simple data model designed to interface, or 'exchange', data among different instruments, and to enable sharing of data analysis tools. Data Exchange focuses on technique rather than instrument descriptions, and on provenance tracking of analysis steps and results. In this paper the successful application of the Data Exchange model to a variety of X-ray techniques, including tomography, fluorescence spectroscopy, fluorescence tomography and photon correlation spectroscopy, is described.",

keywords = "HDF5, data storage, provenance",

author = "{De Carlo}, Francesco and Doa G{\"u}rsoy and Federica Marone and Mark Rivers and Parkinson, {Dilworth Y.} and Faisal Khan and Nicholas Schwarz and Vine, {David J.} and Stefan Vogt and Gleber, {Sophie Charlotte} and Suresh Narayanan and Matt Newville and Tony Lanzirotti and Yue Sun and Hong, {Young Pyo} and Chris Jacobsen",

note = "Publisher Copyright: {\textcopyright} 2014 International Union of Crystallography.",

year = "2014",

month = nov,

day = "1",

doi = "10.1107/S160057751401604X",

language = "English (US)",

volume = "21",

pages = "1224--1230",

journal = "Journal of Synchrotron Radiation",

issn = "0909-0495",

publisher = "International Union of Crystallography",

number = "6",

}

De Carlo, F, Gürsoy, D, Marone, F, Rivers, M, Parkinson, DY, Khan, F, Schwarz, N, Vine, DJ, Vogt, S, Gleber, SC, Narayanan, S, Newville, M, Lanzirotti, T, Sun, Y, Hong, YP & Jacobsen, C 2014, 'Scientific data exchange: A schema for HDF5-based storage of raw and analyzed data', Journal of Synchrotron Radiation, vol. 21, no. 6, pp. 1224-1230. https://doi.org/10.1107/S160057751401604X

TY - JOUR

T1 - Scientific data exchange

T2 - A schema for HDF5-based storage of raw and analyzed data

AU - De Carlo, Francesco

AU - Gürsoy, Doa

AU - Marone, Federica

AU - Rivers, Mark

AU - Parkinson, Dilworth Y.

AU - Khan, Faisal

AU - Schwarz, Nicholas

AU - Vine, David J.

AU - Vogt, Stefan

AU - Gleber, Sophie Charlotte

AU - Narayanan, Suresh

AU - Newville, Matt

AU - Lanzirotti, Tony

AU - Sun, Yue

AU - Hong, Young Pyo

AU - Jacobsen, Chris

PY - 2014/11/1

Y1 - 2014/11/1

N2 - Data Exchange is a simple data model designed to interface, or 'exchange', data among different instruments, and to enable sharing of data analysis tools. Data Exchange focuses on technique rather than instrument descriptions, and on provenance tracking of analysis steps and results. In this paper the successful application of the Data Exchange model to a variety of X-ray techniques, including tomography, fluorescence spectroscopy, fluorescence tomography and photon correlation spectroscopy, is described.

AB - Data Exchange is a simple data model designed to interface, or 'exchange', data among different instruments, and to enable sharing of data analysis tools. Data Exchange focuses on technique rather than instrument descriptions, and on provenance tracking of analysis steps and results. In this paper the successful application of the Data Exchange model to a variety of X-ray techniques, including tomography, fluorescence spectroscopy, fluorescence tomography and photon correlation spectroscopy, is described.

KW - HDF5

KW - data storage

KW - provenance

UR - http://www.scopus.com/inward/record.url?scp=84923054241&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84923054241&partnerID=8YFLogxK

U2 - 10.1107/S160057751401604X

DO - 10.1107/S160057751401604X

M3 - Article

C2 - 25343788

AN - SCOPUS:84923054241

SN - 0909-0495

VL - 21

SP - 1224

EP - 1230

JO - Journal of Synchrotron Radiation

JF - Journal of Synchrotron Radiation

IS - 6

ER -

Scientific data exchange: A schema for HDF5-based storage of raw and analyzed data

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this