Standardized approach to training for cataract surgery skill evaluation

Andrew Pittner, Michael Nolan, Aisha Traish, Asim Farooq, Robert S Feder, Geoff Hill, Surendar Dwarakanathan, William Craig McGaghie, Charles Bouchard*

*Corresponding author for this work

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Purpose To assess interrater reliability in grading cataract surgery performance of ophthalmology residents and attending physicians before and after rater skill training. Setting Metropolitan Chicago, Illinois, USA. Design Prospective interventional test design. Methods Video versions of a previously validated scoring key for rating cataract surgery were created for participant training. All participants received 2 frame-of-reference training sessions lasting 2 hours each. Participants graded 4 videorecorded cataract surgeries before training (pretest) and 4 more after training (posttest). Intraclass correlation coefficients (ICCs), which measured the degree of rater agreement, were calculated before and after training. Participants completed a subjective confidence questionnaire at the beginning and at the end of the study. Results The study participants included 9 postgraduate year (PGY)-3 residents, 8 PGY-4 residents, and 5 ophthalmology attending physicians from 4 medical centers in metropolitan Chicago. The rater training sessions had the greatest increase in ICCs among PGY-3 residents. The ICC improvement between the PGY-4 residents and attending physicians was uneven. After training, all residents felt more confident about their ability to rate and to perform cataract surgery. Conclusions Learning to effectively grade performance of cataract surgery by reviewing video clips has the potential to be an important part of ophthalmology residency education. The benefit of such a protocol was greatest in the early stages of residency education and might provide a guideline for quality assessment that accelerates surgical skill development. Financial Disclosure None of the authors has a financial or proprietary interest in any material or method mentioned.

Original languageEnglish (US)
Pages (from-to)855-863
Number of pages9
JournalJournal of Cataract and Refractive Surgery
Volume42
Issue number6
DOIs
StatePublished - Jun 1 2016

Fingerprint

Cataract
Ophthalmology
Internship and Residency
Physicians
Education
Aptitude
Disclosure
Surgical Instruments
Learning
Guidelines

ASJC Scopus subject areas

  • Surgery
  • Ophthalmology
  • Sensory Systems

Cite this

Pittner, Andrew ; Nolan, Michael ; Traish, Aisha ; Farooq, Asim ; Feder, Robert S ; Hill, Geoff ; Dwarakanathan, Surendar ; McGaghie, William Craig ; Bouchard, Charles. / Standardized approach to training for cataract surgery skill evaluation. In: Journal of Cataract and Refractive Surgery. 2016 ; Vol. 42, No. 6. pp. 855-863.
@article{5b67895fd7524ca8a86730f60c2e62c2,
title = "Standardized approach to training for cataract surgery skill evaluation",
abstract = "Purpose To assess interrater reliability in grading cataract surgery performance of ophthalmology residents and attending physicians before and after rater skill training. Setting Metropolitan Chicago, Illinois, USA. Design Prospective interventional test design. Methods Video versions of a previously validated scoring key for rating cataract surgery were created for participant training. All participants received 2 frame-of-reference training sessions lasting 2 hours each. Participants graded 4 videorecorded cataract surgeries before training (pretest) and 4 more after training (posttest). Intraclass correlation coefficients (ICCs), which measured the degree of rater agreement, were calculated before and after training. Participants completed a subjective confidence questionnaire at the beginning and at the end of the study. Results The study participants included 9 postgraduate year (PGY)-3 residents, 8 PGY-4 residents, and 5 ophthalmology attending physicians from 4 medical centers in metropolitan Chicago. The rater training sessions had the greatest increase in ICCs among PGY-3 residents. The ICC improvement between the PGY-4 residents and attending physicians was uneven. After training, all residents felt more confident about their ability to rate and to perform cataract surgery. Conclusions Learning to effectively grade performance of cataract surgery by reviewing video clips has the potential to be an important part of ophthalmology residency education. The benefit of such a protocol was greatest in the early stages of residency education and might provide a guideline for quality assessment that accelerates surgical skill development. Financial Disclosure None of the authors has a financial or proprietary interest in any material or method mentioned.",
author = "Andrew Pittner and Michael Nolan and Aisha Traish and Asim Farooq and Feder, {Robert S} and Geoff Hill and Surendar Dwarakanathan and McGaghie, {William Craig} and Charles Bouchard",
year = "2016",
month = "6",
day = "1",
doi = "10.1016/j.jcrs.2016.03.031",
language = "English (US)",
volume = "42",
pages = "855--863",
journal = "Journal of Cataract and Refractive Surgery",
issn = "0886-3350",
publisher = "Elsevier Inc.",
number = "6",

}

Pittner, A, Nolan, M, Traish, A, Farooq, A, Feder, RS, Hill, G, Dwarakanathan, S, McGaghie, WC & Bouchard, C 2016, 'Standardized approach to training for cataract surgery skill evaluation', Journal of Cataract and Refractive Surgery, vol. 42, no. 6, pp. 855-863. https://doi.org/10.1016/j.jcrs.2016.03.031

Standardized approach to training for cataract surgery skill evaluation. / Pittner, Andrew; Nolan, Michael; Traish, Aisha; Farooq, Asim; Feder, Robert S; Hill, Geoff; Dwarakanathan, Surendar; McGaghie, William Craig; Bouchard, Charles.

In: Journal of Cataract and Refractive Surgery, Vol. 42, No. 6, 01.06.2016, p. 855-863.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Standardized approach to training for cataract surgery skill evaluation

AU - Pittner, Andrew

AU - Nolan, Michael

AU - Traish, Aisha

AU - Farooq, Asim

AU - Feder, Robert S

AU - Hill, Geoff

AU - Dwarakanathan, Surendar

AU - McGaghie, William Craig

AU - Bouchard, Charles

PY - 2016/6/1

Y1 - 2016/6/1

N2 - Purpose To assess interrater reliability in grading cataract surgery performance of ophthalmology residents and attending physicians before and after rater skill training. Setting Metropolitan Chicago, Illinois, USA. Design Prospective interventional test design. Methods Video versions of a previously validated scoring key for rating cataract surgery were created for participant training. All participants received 2 frame-of-reference training sessions lasting 2 hours each. Participants graded 4 videorecorded cataract surgeries before training (pretest) and 4 more after training (posttest). Intraclass correlation coefficients (ICCs), which measured the degree of rater agreement, were calculated before and after training. Participants completed a subjective confidence questionnaire at the beginning and at the end of the study. Results The study participants included 9 postgraduate year (PGY)-3 residents, 8 PGY-4 residents, and 5 ophthalmology attending physicians from 4 medical centers in metropolitan Chicago. The rater training sessions had the greatest increase in ICCs among PGY-3 residents. The ICC improvement between the PGY-4 residents and attending physicians was uneven. After training, all residents felt more confident about their ability to rate and to perform cataract surgery. Conclusions Learning to effectively grade performance of cataract surgery by reviewing video clips has the potential to be an important part of ophthalmology residency education. The benefit of such a protocol was greatest in the early stages of residency education and might provide a guideline for quality assessment that accelerates surgical skill development. Financial Disclosure None of the authors has a financial or proprietary interest in any material or method mentioned.

AB - Purpose To assess interrater reliability in grading cataract surgery performance of ophthalmology residents and attending physicians before and after rater skill training. Setting Metropolitan Chicago, Illinois, USA. Design Prospective interventional test design. Methods Video versions of a previously validated scoring key for rating cataract surgery were created for participant training. All participants received 2 frame-of-reference training sessions lasting 2 hours each. Participants graded 4 videorecorded cataract surgeries before training (pretest) and 4 more after training (posttest). Intraclass correlation coefficients (ICCs), which measured the degree of rater agreement, were calculated before and after training. Participants completed a subjective confidence questionnaire at the beginning and at the end of the study. Results The study participants included 9 postgraduate year (PGY)-3 residents, 8 PGY-4 residents, and 5 ophthalmology attending physicians from 4 medical centers in metropolitan Chicago. The rater training sessions had the greatest increase in ICCs among PGY-3 residents. The ICC improvement between the PGY-4 residents and attending physicians was uneven. After training, all residents felt more confident about their ability to rate and to perform cataract surgery. Conclusions Learning to effectively grade performance of cataract surgery by reviewing video clips has the potential to be an important part of ophthalmology residency education. The benefit of such a protocol was greatest in the early stages of residency education and might provide a guideline for quality assessment that accelerates surgical skill development. Financial Disclosure None of the authors has a financial or proprietary interest in any material or method mentioned.

UR - http://www.scopus.com/inward/record.url?scp=85008466127&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85008466127&partnerID=8YFLogxK

U2 - 10.1016/j.jcrs.2016.03.031

DO - 10.1016/j.jcrs.2016.03.031

M3 - Article

VL - 42

SP - 855

EP - 863

JO - Journal of Cataract and Refractive Surgery

JF - Journal of Cataract and Refractive Surgery

SN - 0886-3350

IS - 6

ER -