TY - JOUR
T1 - Structural Validity, Internal Consistency, and Rater Reliability of the Modified Barium Swallow Impairment Profile
T2 - Breaking Ground on a 52,726-Patient, Clinical Data Set
AU - Clain, Alex E.
AU - Alkhuwaiter, Munirah
AU - Davidson, Kate
AU - Martin-Harris, Bonnie
N1 - Funding Information:
Correspondence to Alex E. Clain: alexanderclain2022@u.northwestern. edu. Disclosure: Bonnie Martin-Harris and Kate Davidson report grants from National Institutes of Health/National Institute on Deafness and Other Communication Disorders, during the conduct of the study, and royalties from Northern Speech Services through the Medical University of South Carolina Foundation for Research Development, outside the submitted work. In addition, Bonnie Martin-Harris has a patent US 62/ 710,324 issued. The other authors have declared that no other competing financial or nonfinancial interests existed at the time of publication.
Funding Information:
The authors thank the speech-language pathologist raters for their participation and dedication throughout this project. They are (in alphabetical order) Priscilla Brown, Melissa Cooke, Abigail Nellis, and Elizabeth Platt. The authors also wish to acknowledge that this study was supported by the National Institute on Deafness and Other Communication Disorders at the National Institutes of Health (NIH/NIDCD 2K24DC012801-0).
Publisher Copyright:
© 2022 American Speech-Language-Hearing Association.
PY - 2022/5
Y1 - 2022/5
N2 - Purpose: The purpose of this study was to extend the assessment of the psychometric properties of the Modified Barium Swallow Impairment Profile (MBSImP). Here, we re-examined structural validity and internal consistency using a large clinical-registry data set and formally examined rater reliability in a smaller data set. Method: This study consists of a retrospective structural validity and internal consistency analysis of MBSImP using a large data set (N = 52,726) drawn from the MBSImP Swallowing Data Registry and a prospective study of the interrater and intrarater reliability of a subset of studies (N = 50) rated by four MBSImP-trained speech-language pathologists. Structural validity was assessed via exploratory factor analysis. Internal consistency was measured using Cronbach’s alpha for each of the multicomponent MBSImP domains, namely, the oral and pharyngeal domains. Interrater reliability and intrarater reliability were measured using the intraclass correlation coefficient (ICC). Results: The exploratory factor analysis showed a two-factor solution with factors precisely corresponding to the scale’s oral and pharyngeal domains, consistent with findings from the initial study. Component 17, that is, the esophageal domain, did not load onto either factor. Internal consistency was good for both the oral and pharyngeal domains (αoral =.81, αpharyngeal =.87). Interrater reliability was found to be good with ICCinterrater =.78 (95% confidence interval [CI;.76,.80]). Intrarater reliability was good for each rater, ICCRater-1 =.82 (95% CI [.77,.86]), ICCRater-2 =.83 (95% CI [.79,.87]), ICCRater-3 =.87 (95% CI [.83,.90]), and ICCRater-4 =.87 (95% CI [.83,.90]). Conclusions: This study leverages a large-scale, clinical data set to provide strong, generalizable evidence that the MBSImP assessment method has excel-lent structural validity and internal consistency. In addition, the results show that MBSImP-trained speech-language pathologists can demonstrate good interrater and intrarater reliability.
AB - Purpose: The purpose of this study was to extend the assessment of the psychometric properties of the Modified Barium Swallow Impairment Profile (MBSImP). Here, we re-examined structural validity and internal consistency using a large clinical-registry data set and formally examined rater reliability in a smaller data set. Method: This study consists of a retrospective structural validity and internal consistency analysis of MBSImP using a large data set (N = 52,726) drawn from the MBSImP Swallowing Data Registry and a prospective study of the interrater and intrarater reliability of a subset of studies (N = 50) rated by four MBSImP-trained speech-language pathologists. Structural validity was assessed via exploratory factor analysis. Internal consistency was measured using Cronbach’s alpha for each of the multicomponent MBSImP domains, namely, the oral and pharyngeal domains. Interrater reliability and intrarater reliability were measured using the intraclass correlation coefficient (ICC). Results: The exploratory factor analysis showed a two-factor solution with factors precisely corresponding to the scale’s oral and pharyngeal domains, consistent with findings from the initial study. Component 17, that is, the esophageal domain, did not load onto either factor. Internal consistency was good for both the oral and pharyngeal domains (αoral =.81, αpharyngeal =.87). Interrater reliability was found to be good with ICCinterrater =.78 (95% confidence interval [CI;.76,.80]). Intrarater reliability was good for each rater, ICCRater-1 =.82 (95% CI [.77,.86]), ICCRater-2 =.83 (95% CI [.79,.87]), ICCRater-3 =.87 (95% CI [.83,.90]), and ICCRater-4 =.87 (95% CI [.83,.90]). Conclusions: This study leverages a large-scale, clinical data set to provide strong, generalizable evidence that the MBSImP assessment method has excel-lent structural validity and internal consistency. In addition, the results show that MBSImP-trained speech-language pathologists can demonstrate good interrater and intrarater reliability.
UR - http://www.scopus.com/inward/record.url?scp=85130002241&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85130002241&partnerID=8YFLogxK
U2 - 10.1044/2022_JSLHR-21-00554
DO - 10.1044/2022_JSLHR-21-00554
M3 - Article
C2 - 35353597
AN - SCOPUS:85130002241
SN - 1092-4388
VL - 65
SP - 1659
EP - 1670
JO - Journal of Speech, Language, and Hearing Research
JF - Journal of Speech, Language, and Hearing Research
IS - 5
ER -