Psychiatry Clinical Skills Evaluation: a Multisite Study of Validity

Michael D. Jibson*, Gaurava Agarwal, Joan M. Anzia, Richard F. Summers, John Q. Young, Lisa S. Seyfried

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Objective: Since 2007, the American Board of Psychiatry and Neurology (ABPN) has required that residency programs conduct a specific clinical skills evaluation (CSE) of physician-patient interaction, psychiatric interview and mental status examination, and case presentation on a directly observed patient interview as a prerequisite for certification. The authors examined a multisite database of CSE assessments to investigate the validity of the evaluation. Methods: The authors collected 1156 CSE assessments from 4 residency programs conducted over a 6-year period, compared scoring patterns among the programs, score improvement over 4 years of residency, time and number of CSEs required to meet ABPN requirements, and patterns of scoring for individual faculty evaluators. Results: The distribution of scores within each of the 4 programs showed similar, but nonidentical patterns. The number of CSEs required to meet the ABPN standards (3.5) and the point in training at which this was completed (late PGY-2) were the same in all programs. CSE scores were highly correlated with year of training but were not correlated with performance on an unrelated cognitive examination. Individual faculty members tended to stay within a moderate range of scores over multiple residents, partially attributable to year of training. Conclusions: Taken together, these findings support the validity of the CSE as a measure of residents’ clinical skills in the specified areas and demonstrate a moderate-high degree of consistency in the scoring of the CSE across these 4 programs.

Original languageEnglish (US)
JournalAcademic Psychiatry
DOIs
StateAccepted/In press - 2021

Keywords

  • Certification
  • Education
  • Evaluation
  • Psychiatry
  • Validity

ASJC Scopus subject areas

  • Education
  • Psychiatry and Mental health

Fingerprint

Dive into the research topics of 'Psychiatry Clinical Skills Evaluation: a Multisite Study of Validity'. Together they form a unique fingerprint.

Cite this