Implicit Review Instrument to Evaluate Quality of Care Delivered by Physicians to Children in Emergency Departments

the Pediatric Emergency Care Applied Research Network

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

Objective: To evaluate the consistency, reliability, and validity of an implicit review instrument that measures the quality of care provided to children in the emergency department (ED). Data Sources/Study Setting: Medical records of randomly selected children from 12 EDs in the Pediatric Emergency Care Applied Research Network (PECARN). Study Design: Eight pediatric emergency medicine physicians applied the instrument to 620 medical records. Data Collection/Extraction Methods: We determined internal consistency using Cronbach's alpha and inter-rater reliability using the intraclass correlation coefficient (ICC). We evaluated the validity of the instrument by correlating scores with four condition-specific explicit review instruments. Principal Findings: Individual reviewers' Cronbach's alpha had a mean of 0.85 with a range of 0.76–0.97; overall Cronbach's alpha was 0.90. The ICC was 0.49 for the summary score with a range from 0.40 to 0.46. Correlations between the quality of care score and the four condition-specific explicit review scores ranged from 0.24 to 0.38. Conclusions: The quality of care instrument demonstrated good internal consistency, moderate inter-rater reliability, high inter-rater agreement, and evidence supporting validity. The instrument could be useful for systems' assessment and research in evaluating the care delivered to children in the ED.

Original languageEnglish (US)
Pages (from-to)1316-1334
Number of pages19
JournalHealth Services Research
Volume53
Issue number3
DOIs
StatePublished - Jun 2018

Funding

This project was also supported in part by the Health Resources and Services Administration (HRSA), Maternal and Child Health Bureau (MCHB), Emergency Medical Services for Children (EMSC) Network Development Demonstration Program under cooperative agreements U03MC00008, U03MC00001, U03MC00003, U03MC00006, U03MC00007, U03MC22684, and U03MC22685. This information or content and conclusions are those of the author and should not be construed as the official position or policy of, nor should any endorsements be inferred by HRSA, HHS, or the U.S. Government. The authors have no financial relationships relevant to this article to disclose. Disclosure: None. Disclaimer: None. Joint Acknowledgment/Disclosure Statement: We acknowledge the efforts of the following individuals participating in PECARN at the time this study was initiated: PECARN Steering Committee: N. Kuppermann, Chair; E. Alpern, D. Borgialli, J. Callahan, J. Chamberlain, P. Dayan, J. M. Dean, M. Gerardi, M. Gorelick, J. Hoyle, E. Jacobs, D. Jaffe, R. Lichenstein, K. Lillis, P. Mahajan, R. Maio, F. Moler, D. Monroe, R. Ruddy, R. Stanley, M. Tunik, A. Walker. MCHB/EMSC liaisons: D. Kavanaugh, H. Park. Data Coordinating Center (DCC): M. Dean, R. Holubkov, S. Knight, A. Donaldson, S. Zuspan, M. Miskin, J. Wade, A. Jones, M. Fjelstad. Feasibility and Budget Subcommittee (FABS): T. Singh, Chair; A. Drongowski, L. Fukushima, E. Kim, D. Monroe, G. O'Gara, H. Rincon, M. Tunik, S. Zuspan. Grants and Publications Subcommittee (GAPS): M. Gorelick, Chair; E. Alpern, D. Borgialli, K. Brown, L. Babcock, A. Donaldson, G. Foltin, F. Moler, S. Teach. Protocol Concept Review and Development Subcommittee (PCRADS): D. Jaffe, Chair; J. Chamberlain, A. Cooper, P. Dayan, J. M. Dean, R. Holubkov, P. Mahajan, R. Maio, N.C. Mann, K. Shaw, A. Walker. Quality Assurance Subcommittee (QAS): R. Stanley, Chair; P. Ehrlich, R. Enriquez, M. Gerardi, R. Holubkov, E. Jacobs, R. Lichenstein, K. Lillis, B. Millar, R. Ruddy, M. Shults. Safety and Regulatory Affairs Subcommittee (SRAS): W. Schalick, J. Callahan, Co-Chairs; S. Atabaki, J. Burr, K. Call, J. Hoyle, R. Ruddy, J. Suhajda, N. Schamban. Funding Sources: 1R01HS019712 Agency for Healthcare Quality and Research. This project was also supported in part by the Health Resources and Services Administration (HRSA), Maternal and Child Health Bureau (MCHB), Emergency Medical Services for Children (EMSC) Network Development Demonstration Program under cooperative agreements U03MC00008, U03MC00001, U03MC00003, U03MC00006, U03MC00007, U03MC22684, and U03MC22685. This information or content and conclusions are those of the author and should not be construed as the official position or policy of, nor should any endorsements be inferred by HRSA, HHS, or the U.S. Government. The authors have no financial relationships relevant to this article to disclose. Disclosure: None. Disclaimer: None.

Keywords

  • Pediatrics
  • emergency department
  • quality

ASJC Scopus subject areas

  • Health Policy

Fingerprint

Dive into the research topics of 'Implicit Review Instrument to Evaluate Quality of Care Delivered by Physicians to Children in Emergency Departments'. Together they form a unique fingerprint.

Cite this