Composite score validity in clerkship grading

Julia Corcoran; Steven M. Downing; Ara Tekian; Debra A. Darosa

doi:10.1097/ACM.0b013e3181b37009

Composite score validity in clerkship grading

Julia Corcoran^*, Steven M. Downing, Ara Tekian, Debra A. Darosa

^*Corresponding author for this work

Surgery, Surgical Education Division

Research output: Contribution to journal › Article › peer-review

10 Scopus citations

Abstract

BACKGROUND: Composite score validity depends on its reliability, content, and comparison with other outcomes measures. This study examined all three aspects of a composite score used in a third-year surgery clerkship. METHOD: Composite score reliability was calculated using stratified alpha; several other reasonable composite combinations were tested. Correlation coefficients between clerkship composite scores and grades were calculated with other achievement measures. Two consecutive years were studied (N = 162, N = 159). RESULTS: The clerkship composite score reliability was .76 (Year 1) and .81 (Year 2). Positive correlations (P ≤ .05) were found between composite scores and other clerkships' test scores and the United States Medical Licensing Examination Step 2 Clinical Knowledge examination. Positive correlations (P ≤ .05) were found between surgery clerkship grades and other clerkship grades. CONCLUSIONS: This study documents the reliability of a composite score and provides evidence for its validity in a surgery clerkship.

Original language	English (US)
Pages (from-to)	S120-S123
Journal	Academic Medicine
Volume	84
Issue number	SUPPL. 10
DOIs	https://doi.org/10.1097/ACM.0b013e3181b37009
State	Published - Oct 2009

ASJC Scopus subject areas

Education

Access to Document

10.1097/ACM.0b013e3181b37009

Cite this

@article{f5f83cc4050843838c913cf46d7348ea,

title = "Composite score validity in clerkship grading",

abstract = "BACKGROUND: Composite score validity depends on its reliability, content, and comparison with other outcomes measures. This study examined all three aspects of a composite score used in a third-year surgery clerkship. METHOD: Composite score reliability was calculated using stratified alpha; several other reasonable composite combinations were tested. Correlation coefficients between clerkship composite scores and grades were calculated with other achievement measures. Two consecutive years were studied (N = 162, N = 159). RESULTS: The clerkship composite score reliability was .76 (Year 1) and .81 (Year 2). Positive correlations (P ≤ .05) were found between composite scores and other clerkships' test scores and the United States Medical Licensing Examination Step 2 Clinical Knowledge examination. Positive correlations (P ≤ .05) were found between surgery clerkship grades and other clerkship grades. CONCLUSIONS: This study documents the reliability of a composite score and provides evidence for its validity in a surgery clerkship.",

author = "Julia Corcoran and Downing, {Steven M.} and Ara Tekian and Darosa, {Debra A.}",

year = "2009",

month = oct,

doi = "10.1097/ACM.0b013e3181b37009",

language = "English (US)",

volume = "84",

pages = "S120--S123",

journal = "Academic Medicine",

issn = "1040-2446",

publisher = "Lippincott Williams and Wilkins",

number = "SUPPL. 10",

}

TY - JOUR

T1 - Composite score validity in clerkship grading

AU - Corcoran, Julia

AU - Downing, Steven M.

AU - Tekian, Ara

AU - Darosa, Debra A.

PY - 2009/10

Y1 - 2009/10

N2 - BACKGROUND: Composite score validity depends on its reliability, content, and comparison with other outcomes measures. This study examined all three aspects of a composite score used in a third-year surgery clerkship. METHOD: Composite score reliability was calculated using stratified alpha; several other reasonable composite combinations were tested. Correlation coefficients between clerkship composite scores and grades were calculated with other achievement measures. Two consecutive years were studied (N = 162, N = 159). RESULTS: The clerkship composite score reliability was .76 (Year 1) and .81 (Year 2). Positive correlations (P ≤ .05) were found between composite scores and other clerkships' test scores and the United States Medical Licensing Examination Step 2 Clinical Knowledge examination. Positive correlations (P ≤ .05) were found between surgery clerkship grades and other clerkship grades. CONCLUSIONS: This study documents the reliability of a composite score and provides evidence for its validity in a surgery clerkship.

AB - BACKGROUND: Composite score validity depends on its reliability, content, and comparison with other outcomes measures. This study examined all three aspects of a composite score used in a third-year surgery clerkship. METHOD: Composite score reliability was calculated using stratified alpha; several other reasonable composite combinations were tested. Correlation coefficients between clerkship composite scores and grades were calculated with other achievement measures. Two consecutive years were studied (N = 162, N = 159). RESULTS: The clerkship composite score reliability was .76 (Year 1) and .81 (Year 2). Positive correlations (P ≤ .05) were found between composite scores and other clerkships' test scores and the United States Medical Licensing Examination Step 2 Clinical Knowledge examination. Positive correlations (P ≤ .05) were found between surgery clerkship grades and other clerkship grades. CONCLUSIONS: This study documents the reliability of a composite score and provides evidence for its validity in a surgery clerkship.

UR - http://www.scopus.com/inward/record.url?scp=70350648189&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350648189&partnerID=8YFLogxK

U2 - 10.1097/ACM.0b013e3181b37009

DO - 10.1097/ACM.0b013e3181b37009

M3 - Article

C2 - 19907372

AN - SCOPUS:70350648189

SN - 1040-2446

VL - 84

SP - S120-S123

JO - Academic Medicine

JF - Academic Medicine

IS - SUPPL. 10

ER -

Composite score validity in clerkship grading

Abstract

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this