TY - JOUR
T1 - Inter-Rater agreement in the assessment of video recordings of eye drop instillation by glaucoma patients
AU - Park, Meghan S.
AU - Patel, Marguerite M.
AU - Sarezky, Daniel
AU - Rojas, Carin
AU - Choo, Clara
AU - Choi, Michael
AU - Liu, Dachao
AU - Rademaker, Alfred W.
AU - Tanna, Angelo P.
N1 - Publisher Copyright:
© 2016 Park et al.This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
PY - 2016/1/5
Y1 - 2016/1/5
N2 - Purpose To create a standardized method for evaluating the video recordings of patients self-instilling eye drops and to determine the level of agreement of eye drop instillation efficacy, safety and efficiency ratings by three masked graders. Design Prospective cross-sectional study. Participants 78 patients with open-Angle glaucoma or ocular hypertension who had at least 6 months of experience with the use of eye drop medications. Methods Participants were video recorded while self-instilling artificial tears sequentially to both eyes. Three masked observers graded these video recordings on three criteria: efficacy (the determination of whether an eye drop was instilled on the ocular surface), safety (assessment of whether the tip of the medication bottle made contact with the ocular surface or eyelids), and efficiency (the number of eye drops expressed from the bottle). Main Outcome Measures After grading the video recordings based on efficacy, safety, and efficiency, kappa statistics were used to estimate inter-rater agreement. Results The mean kappa level of agreement for efficacy, safety, and efficiency was 0.64 (95% confidence interval (CI), 0.42-0.87), 0.73 (95% CI, 0.58-0.88), and 0.62 (95% CI, 0.42-0.81), respectively. Conclusions We demonstrated good inter-rater reproducibility of the masked analysis of video recordings of patients self-instilling eye drops based on three criteria: efficiency, safety, and efficacy.
AB - Purpose To create a standardized method for evaluating the video recordings of patients self-instilling eye drops and to determine the level of agreement of eye drop instillation efficacy, safety and efficiency ratings by three masked graders. Design Prospective cross-sectional study. Participants 78 patients with open-Angle glaucoma or ocular hypertension who had at least 6 months of experience with the use of eye drop medications. Methods Participants were video recorded while self-instilling artificial tears sequentially to both eyes. Three masked observers graded these video recordings on three criteria: efficacy (the determination of whether an eye drop was instilled on the ocular surface), safety (assessment of whether the tip of the medication bottle made contact with the ocular surface or eyelids), and efficiency (the number of eye drops expressed from the bottle). Main Outcome Measures After grading the video recordings based on efficacy, safety, and efficiency, kappa statistics were used to estimate inter-rater agreement. Results The mean kappa level of agreement for efficacy, safety, and efficiency was 0.64 (95% confidence interval (CI), 0.42-0.87), 0.73 (95% CI, 0.58-0.88), and 0.62 (95% CI, 0.42-0.81), respectively. Conclusions We demonstrated good inter-rater reproducibility of the masked analysis of video recordings of patients self-instilling eye drops based on three criteria: efficiency, safety, and efficacy.
UR - http://www.scopus.com/inward/record.url?scp=84953791703&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84953791703&partnerID=8YFLogxK
U2 - 10.1371/journal.pone.0145764
DO - 10.1371/journal.pone.0145764
M3 - Article
C2 - 26730605
AN - SCOPUS:84953791703
SN - 1932-6203
VL - 11
JO - PloS one
JF - PloS one
IS - 1
M1 - e0145764
ER -