TY - JOUR
T1 - Online Reviews of Mental Health Treatment Facilities
T2 - Narrative Themes Associated With Positive and Negative Ratings
AU - Stokes, Daniel C.
AU - Kishton, Rachel
AU - McCalpin, Haley J.
AU - Pelullo, Arthur P.
AU - Meisel, Zachary F.
AU - Beidas, Rinad S.
AU - Merchant, Raina M.
N1 - Funding Information:
This study was supported by funding from the National Institutes of Health and the National Institute on Drug Abuse (grant R21 DA050761).
Publisher Copyright:
© 2021 Authors. All rights reserved.
PY - 2021/7
Y1 - 2021/7
N2 - Objective: Previous studies indicate that patients' satisfaction with mental health care is correlated with both treatment outcomes and quality of life. The aims of this study were to describe online reviews of mental health treatment facilities, including key themes in review content, and to evaluate the correlation between narrative review themes, facility characteristics, and review ratings. Methods: United States National Mental Health Services Survey (N-MHSS) facilities were linked to corresponding Yelp pages, created between March 2007 and September 2019. Correlations between review ratings and both machine learning-generated latent Dirichlet allocation topics and N-MHSS-reported facility characteristics were measured by using Spearman's rank-order correlation coefficient. Significance was defined by a Bonferroni-adjusted p, 0.001. Results: Of 10, 191 unique mental health treatment facilities, 1, 383 (13.6%) had relevant Yelp pages with 8, 133 corresponding reviews. The number of newly reviewed facilities and the number of new reviews increased throughout the study period. Narrative topics positively correlated with review ratings included caring staff (Spearman's r50.39) and nonpharmacologic treatment (r50.16). Topics negatively correlated with review ratings included rude staff (r520.14) and safety and abuse (r520.14). Of 126 N-MHSS survey items, 11 were positively correlated with review rating, including “outpatient mental health facility” (r50.13), and 33 were negatively correlated with review rating, including accepting Medicare (r520.21). Conclusions: Narrative topics provide information beyond what is currently collected through the N-MHSS. Topics associated with positive and negative reviews, such as staff attitude toward patients, can guide improvement in patients' satisfaction and engagement with mental health care.
AB - Objective: Previous studies indicate that patients' satisfaction with mental health care is correlated with both treatment outcomes and quality of life. The aims of this study were to describe online reviews of mental health treatment facilities, including key themes in review content, and to evaluate the correlation between narrative review themes, facility characteristics, and review ratings. Methods: United States National Mental Health Services Survey (N-MHSS) facilities were linked to corresponding Yelp pages, created between March 2007 and September 2019. Correlations between review ratings and both machine learning-generated latent Dirichlet allocation topics and N-MHSS-reported facility characteristics were measured by using Spearman's rank-order correlation coefficient. Significance was defined by a Bonferroni-adjusted p, 0.001. Results: Of 10, 191 unique mental health treatment facilities, 1, 383 (13.6%) had relevant Yelp pages with 8, 133 corresponding reviews. The number of newly reviewed facilities and the number of new reviews increased throughout the study period. Narrative topics positively correlated with review ratings included caring staff (Spearman's r50.39) and nonpharmacologic treatment (r50.16). Topics negatively correlated with review ratings included rude staff (r520.14) and safety and abuse (r520.14). Of 126 N-MHSS survey items, 11 were positively correlated with review rating, including “outpatient mental health facility” (r50.13), and 33 were negatively correlated with review rating, including accepting Medicare (r520.21). Conclusions: Narrative topics provide information beyond what is currently collected through the N-MHSS. Topics associated with positive and negative reviews, such as staff attitude toward patients, can guide improvement in patients' satisfaction and engagement with mental health care.
UR - http://www.scopus.com/inward/record.url?scp=85111789250&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85111789250&partnerID=8YFLogxK
U2 - 10.1176/APPI.PS.202000267
DO - 10.1176/APPI.PS.202000267
M3 - Article
C2 - 34015944
AN - SCOPUS:85111789250
SN - 1075-2730
VL - 72
SP - 776
EP - 783
JO - Psychiatric Services
JF - Psychiatric Services
IS - 7
ER -
