Evaluating the Validity of Assessment Systems in Psychiatry Residency Programs: A Multisite Collaborative Study

The purpose of this work is to leverage a consortium of psychiatry residency programs to conduct a two-year multi-site collaborative project to study. Practice-based research networks (PBRNs) are groups of clinicians, educators, and practitioners working together to answer research questions and to translate scientific findings into practice. In this proposal, we aim to build this collaborative network for psychiatry education PBRN, consisting of six Midwestern training programs to examine how assessments can be used to measure entrustable professional activities (EPAs), units of professional work required of psychiatrists for unsupervised practice. This proposal seeks support from the ABPN Research Award program by expanding and formalizing PBRN for Psychiatry Education to conduct a two-year multisite collaborative project to study the following: 1. To sustain the establishment of psychiatry education PBRN, with research infrastructure in data sharing, analysis, and networking that advance psychiatry education and 2. To leverage the PBRN to examine sources of validity evidence targeting assessment systems for EPAs. Investigators will use best-possible evidence gathered from this large-scale validity study to develop assessment guidelines that support robust training in psychiatry residency programs.