EVALUATING THE VALIDITY OF ASSESSMENT SYSTEMS IN PSYCHIATRY RESIDENCY PROGRAMS: A MULTISITE COLLABORATIVE STUDY

The Next Accreditation System (NAS) by the Accreditation Council for Graduate Medical Education (ACGME) has prompted residency programs to transform the training and assessment of learners in graduate medical education (GME). To meet this challenge, psychiatry assessment tools have been developed to align with the Psychiatry Milestones (22 subcompetencies). These assessment tools include the “Psychiatry Milestone Project Assessment Tools”, jointly developed by the ACGME and the American Board of Psychiatry and Neurology (ABPN) to assess learners and to track competencies targeting progress toward unsupervised practice. This proposal seeks support from the ABPN, by leveraging three Chicago consortium of Psychiatry Residency Programs (95 residents and 120 full-time faculty psychiatrists), to conduct a two-year multisite collaborative project to study the following: 1) To evaluate sources of validity evidence of assessment tools used to inform the Psychiatry Milestones and; 2) To identify “learning trajectories” of psychiatry learners.