TY - JOUR
T1 - Uroflowmetry with pelvic floor electromyography
T2 - inter-rater agreement on diagnosis of pediatric non-neurogenic voiding disorders
AU - Faasse, M. A.
AU - Nosnik, I. P.
AU - Diaz-Saldano, D.
AU - Hodgkins, K. S.
AU - Liu, D. B.
AU - Schreiber, J.
AU - Yerkes, E. B.
N1 - Publisher Copyright:
© 2015 Journal of Pediatric Urology Company.
PY - 2015/8/1
Y1 - 2015/8/1
N2 - Summary Introduction Uroflowmetry with electromyography (uroflow-EMG) is commonly used for evaluation of lower urinary tract (LUT) function in children. Diagnostic criteria based largely on uroflow-EMG findings have previously been proposed for several conditions collectively termed non-neurogenic voiding disorders (NNVDs). These include dysfunctional voiding (DV), idiopathic detrusor overactivity disorder (IDOD), detrusor underutilization disorder (DUD), and primary bladder neck dysfunction (PBND). It is unknown whether practitioners with varying levels of training and experience can apply the diagnostic criteria for these conditions with a high level of consistency. Objective To assess inter-rater agreement on diagnosis of NNVDs using uroflow-EMG studies. Study design Six raters performed post hoc evaluation of 84 uroflow-EMG studies and associated clinical data from children with symptoms of LUT dysfunction and no evidence of neurologic or anatomic abnormalities. Each rater was asked to categorize the uroflow-EMG studies as being consistent with DV, IDOD, DUD, PBND, or normal/unclassifiable. A consensus diagnosis was noted for studies on which at least four raters agreed. Inter-rater agreement was assessed via calculation of unweighted Fleiss' kappa statistics. Results Overall inter-rater agreement on NNVD diagnoses was moderate (kappa 0.46, 95% CI 0.38-0.54). Agreement between individual raters ranged from 0.33 (fair) to 0.74 (substantial) (Figure). There was no consensus on diagnosis for 20 patients (24%). Discussion Several factors may contribute to inter-rater disagreement on diagnosis of NNVDs. These include instances where patients satisfy one criterion for a particular diagnosis while missing others - or have findings consistent with more than one diagnosis. Strategies to address this may involve simplifying the diagnostic criteria, developing a clear algorithm that prioritizes certain criteria, and/or allowing assignment of multiple diagnoses. Practitioners could also benefit from standardized education regarding the diagnostic criteria for NNVDs. Potential limitations of this analysis included the use of just one uroflow-EMG study per patient in almost all cases. Also, the raters had variable levels of previous experience using the diagnostic criteria for NNVDs, and it is possible that they were not always applied as originally intended. If this were the case, it would support development of a standardized education tool to facilitate practitioner understanding and application of the criteria. Conclusions Uroflow-EMG has shown promise for improving clinical management of NNVDs associated with pediatric LUT dysfunction. However, inter-rater agreement on NNVD diagnoses using current criteria is suboptimal. Various mechanisms should be explored to improve consistency in practitioners' diagnosis of NNVDs. (Table presented.).
AB - Summary Introduction Uroflowmetry with electromyography (uroflow-EMG) is commonly used for evaluation of lower urinary tract (LUT) function in children. Diagnostic criteria based largely on uroflow-EMG findings have previously been proposed for several conditions collectively termed non-neurogenic voiding disorders (NNVDs). These include dysfunctional voiding (DV), idiopathic detrusor overactivity disorder (IDOD), detrusor underutilization disorder (DUD), and primary bladder neck dysfunction (PBND). It is unknown whether practitioners with varying levels of training and experience can apply the diagnostic criteria for these conditions with a high level of consistency. Objective To assess inter-rater agreement on diagnosis of NNVDs using uroflow-EMG studies. Study design Six raters performed post hoc evaluation of 84 uroflow-EMG studies and associated clinical data from children with symptoms of LUT dysfunction and no evidence of neurologic or anatomic abnormalities. Each rater was asked to categorize the uroflow-EMG studies as being consistent with DV, IDOD, DUD, PBND, or normal/unclassifiable. A consensus diagnosis was noted for studies on which at least four raters agreed. Inter-rater agreement was assessed via calculation of unweighted Fleiss' kappa statistics. Results Overall inter-rater agreement on NNVD diagnoses was moderate (kappa 0.46, 95% CI 0.38-0.54). Agreement between individual raters ranged from 0.33 (fair) to 0.74 (substantial) (Figure). There was no consensus on diagnosis for 20 patients (24%). Discussion Several factors may contribute to inter-rater disagreement on diagnosis of NNVDs. These include instances where patients satisfy one criterion for a particular diagnosis while missing others - or have findings consistent with more than one diagnosis. Strategies to address this may involve simplifying the diagnostic criteria, developing a clear algorithm that prioritizes certain criteria, and/or allowing assignment of multiple diagnoses. Practitioners could also benefit from standardized education regarding the diagnostic criteria for NNVDs. Potential limitations of this analysis included the use of just one uroflow-EMG study per patient in almost all cases. Also, the raters had variable levels of previous experience using the diagnostic criteria for NNVDs, and it is possible that they were not always applied as originally intended. If this were the case, it would support development of a standardized education tool to facilitate practitioner understanding and application of the criteria. Conclusions Uroflow-EMG has shown promise for improving clinical management of NNVDs associated with pediatric LUT dysfunction. However, inter-rater agreement on NNVD diagnoses using current criteria is suboptimal. Various mechanisms should be explored to improve consistency in practitioners' diagnosis of NNVDs. (Table presented.).
KW - Dysfunctional voiding
KW - Lower urinary tract dysfunction
KW - Noninvasive urodynamics
KW - Observer variation
KW - Urination disorders
KW - Uroflow-EMG
UR - http://www.scopus.com/inward/record.url?scp=84939266320&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84939266320&partnerID=8YFLogxK
U2 - 10.1016/j.jpurol.2015.05.012
DO - 10.1016/j.jpurol.2015.05.012
M3 - Article
C2 - 26159493
AN - SCOPUS:84939266320
SN - 1477-5131
VL - 11
SP - 198.e1-198.e6
JO - Journal of Pediatric Urology
JF - Journal of Pediatric Urology
IS - 4
M1 - 1948
ER -