Development of an objective scoring system for measurement of resident performance on the human patient simulator

Barbara M. Scavone*, Michele T. Sproviero, Robert J. McCarthy, Cynthia A. Wong, John T. Sullivan, Viva J. Siddall, Leonard D. Wade

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

65 Scopus citations

Abstract

BACKGROUND: The decrease in the percentage of patients having cesarean delivery during general anesthesia has led some educators to advocate the increased use of simulation-based training for this anesthetic. The authors developed a scoring system to measure resident performance of this anesthetic on the human patient simulator and subjected the system to tests of validity and reliability. METHODS: A modified Delphi technique was used to achieve a consensus among several experts regarding a standardized scoring system for evaluating resident performance of general anesthesia for emergency cesarean delivery on the human patient simulator. Eight third-year and eight first-year anesthesiology residents performed the scenario and were videotaped and scored by four attending obstetric anesthesiologists. RESULTS: Third-year residents scored an average of 150.5 points, whereas first-year residents scored an average of 128 points (P = 0.004). The scoring instrument demonstrated high interrater reliability with an intraclass correlation coefficient of 0.97 (95% confidence interval, 0.94-0.99) compared with the average score. CONCLUSIONS: The developed scoring tool to measure resident performance of general anesthesia for emergency cesarean delivery on the patient simulator seems both valid and reliable in the context in which it was tested. This scoring system may prove useful for future studies such as those investigating the effect of simulator training on objective assessment of resident performance.

Original languageEnglish (US)
Pages (from-to)260-266
Number of pages7
JournalAnesthesiology
Volume105
Issue number2
DOIs
StatePublished - Aug 1 2006

ASJC Scopus subject areas

  • Anesthesiology and Pain Medicine

Fingerprint Dive into the research topics of 'Development of an objective scoring system for measurement of resident performance on the human patient simulator'. Together they form a unique fingerprint.

Cite this