TY - JOUR
T1 - An algorithm for the automatic deglitching of X-ray absorption spectroscopy data
AU - Wallace, Samuel M.
AU - Alsina, Marco A.
AU - Gaillard, Jean Francois
N1 - Funding Information:
Partial funding for this research was provided by the Strategic Environmental Research and Development Program (grant No. ER18-1428 to Jean-Franc¸ois Gaillard); Northwestern University, Institute of Sustainability and Engineering at Northwestern (scholarship to Samuel Wallace).
Funding Information:
We thank Dr Qing Ma for his technical assistance while performing XAS experiments at the Advanced Photon Source (APS). Portions of this work were performed at the DuPont– Northwestern–Dow Collaborative Access Team (DND-CAT) located at Sector 5 of the APS. DND-CAT is supported by Northwestern University, The Dow Chemical Company, and DuPont de Nemours, Inc. This research used resources of the Advanced Photon Source, a US Department of Energy (DOE) Office of Science User Facility operated for the DOE Office of Science by Argonne National Laboratory under Contract No. DE-AC02-06CH11357.
Publisher Copyright:
© 2021 International Union of Crystallography. All rights reserved.
PY - 2021/7/1
Y1 - 2021/7/1
N2 - Analysis of X-ray absorption spectroscopy data often involves the removal of artifacts or glitches from the acquired signal, a process commonly known as deglitching. Glitches result either from specific orientations of monochromator crystals or from scattering by crystallites in the sample itself. Since the precise energy - or wavelength - location and the intensity of glitches in a spectrum cannot always be predicted, deglitching is often performed on a per spectrum basis by the analyst. Some routines have been proposed, but they are prone to arbitrary selection of spectral artifacts and are often inadequate for processing large data sets. Here, a statistically robust algorithm, implemented as a Python program, for the automatic detection and removal of glitches that can be applied to a large number of spectra, is presented. It uses a Savitzky-Golay filter to smooth spectra and the generalized extreme Studentized deviate test to identify outliers. Robust, repeatable, and selective removal of glitches is achieved using this algorithm.
AB - Analysis of X-ray absorption spectroscopy data often involves the removal of artifacts or glitches from the acquired signal, a process commonly known as deglitching. Glitches result either from specific orientations of monochromator crystals or from scattering by crystallites in the sample itself. Since the precise energy - or wavelength - location and the intensity of glitches in a spectrum cannot always be predicted, deglitching is often performed on a per spectrum basis by the analyst. Some routines have been proposed, but they are prone to arbitrary selection of spectral artifacts and are often inadequate for processing large data sets. Here, a statistically robust algorithm, implemented as a Python program, for the automatic detection and removal of glitches that can be applied to a large number of spectra, is presented. It uses a Savitzky-Golay filter to smooth spectra and the generalized extreme Studentized deviate test to identify outliers. Robust, repeatable, and selective removal of glitches is achieved using this algorithm.
KW - Deglitching
KW - Glitches
KW - X-ray absorption spectroscopy
UR - http://www.scopus.com/inward/record.url?scp=85110276978&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85110276978&partnerID=8YFLogxK
U2 - 10.1107/S1600577521003611
DO - 10.1107/S1600577521003611
M3 - Article
C2 - 34212882
AN - SCOPUS:85110276978
SN - 0909-0495
VL - 28
SP - 1178
EP - 1183
JO - Journal of Synchrotron Radiation
JF - Journal of Synchrotron Radiation
ER -