Evaluation of a system designed to enhance the resident selection process

The purpose of this research was to evaluate the use and effectiveness of the Universal Medical Student Performance Profile System in enhancing the resident selection process. The Universal Medical Student Performance Profile System involved the use of a standardized student evaluation form completed by surgery clerkship directors to summarize student performance. These student profile forms were then forwarded to general surgery program directors to whom each student applied. Twenty-five surgery clerkship directors volunteered to complete student profile forms on students pursuing surgical careers for the classes of 1986 and 1987. Program directors who had accepted students in their programs on whom these standardized evaluation forms had been completed were asked to complete a similar form based on the graduate's first year of residency performance. Findings showed statistically significant relationships in several assessment categories between clerkship and program directors' ratings. A survey of program directors showed they agreed with the concept of a standardized medical student evaluation form and found the student profile forms helpful in making decisions on resident selection. We concluded from this baseline study that the use of a standardized student evaluation form will have limited predictive validity, unless clerkships improve efforts to standardize clerkship objectives, expectations, and performance measures.