Objective structured assessment of technical skills in elliptical excision repair of senior dermatology residents a multirater, blinded study of operating room video recordings

Murad Alam*, Michael Nodzenski, Simon S Yoo, Emily Poon Samuelson, Diana Bolotin

*Corresponding author for this work

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

Importance Surgical training in dermatology residencies has increased, and there is growing interest in measuring resident competence more precisely. This study applies the use of the objective structured assessment of technical skills (OSATS) to measure competence in dermatologic surgery. Objective To evaluate the utility of OSATS as a tool for measuring surgery skills during dermatology residency training. Design, Setting, And Participants Multirater, blinded review and ratings of taped video recordings of elliptical excisions performed by senior dermatology residents applying for procedural or Mohs surgery fellowships. Main Outcomes And Measures Ratings on a specific OSATS measure, including global rating scale and task checklist. Results Twelve videos, representing approximately 20% of fellowship applicants during 2009-2010, were rated. Raters agreed on 272 of 288 subscore ratings (94.4%). Mean global ratings were 4 or 5 for all categories, except time and motion, which had a rating of 3. Task checklist ratings had a mean of 14.5 and a mode of 16 (perfect score), with eversion least often performed successfully. No association was found between a resident's scores and the number of surgical rotation months or between scores and the number of Mohs surgeons at the home institution. Conclusions And Relevance Senior dermatology residents preparing for surgery fellowships are highly skilled in performing elliptical excisions and bilayered repairs. The OSATS appears useful and reliable for the evaluation of dermatologic surgery skills.

Original languageEnglish (US)
Pages (from-to)608-612
Number of pages5
JournalJAMA dermatology
Volume150
Issue number6
DOIs
StatePublished - Jan 1 2014

Fingerprint

Video Recording
Operating Rooms
Dermatology
DNA Repair
Dermatologic Surgical Procedures
Internship and Residency
Checklist
Mental Competency
Mohs Surgery
Outcome Assessment (Health Care)

ASJC Scopus subject areas

  • Dermatology

Cite this

@article{f8c0a389437647638a7c29417a4cf567,
title = "Objective structured assessment of technical skills in elliptical excision repair of senior dermatology residents a multirater, blinded study of operating room video recordings",
abstract = "Importance Surgical training in dermatology residencies has increased, and there is growing interest in measuring resident competence more precisely. This study applies the use of the objective structured assessment of technical skills (OSATS) to measure competence in dermatologic surgery. Objective To evaluate the utility of OSATS as a tool for measuring surgery skills during dermatology residency training. Design, Setting, And Participants Multirater, blinded review and ratings of taped video recordings of elliptical excisions performed by senior dermatology residents applying for procedural or Mohs surgery fellowships. Main Outcomes And Measures Ratings on a specific OSATS measure, including global rating scale and task checklist. Results Twelve videos, representing approximately 20{\%} of fellowship applicants during 2009-2010, were rated. Raters agreed on 272 of 288 subscore ratings (94.4{\%}). Mean global ratings were 4 or 5 for all categories, except time and motion, which had a rating of 3. Task checklist ratings had a mean of 14.5 and a mode of 16 (perfect score), with eversion least often performed successfully. No association was found between a resident's scores and the number of surgical rotation months or between scores and the number of Mohs surgeons at the home institution. Conclusions And Relevance Senior dermatology residents preparing for surgery fellowships are highly skilled in performing elliptical excisions and bilayered repairs. The OSATS appears useful and reliable for the evaluation of dermatologic surgery skills.",
author = "Murad Alam and Michael Nodzenski and Yoo, {Simon S} and Samuelson, {Emily Poon} and Diana Bolotin",
year = "2014",
month = "1",
day = "1",
doi = "10.1001/jamadermatol.2013.6858",
language = "English (US)",
volume = "150",
pages = "608--612",
journal = "JAMA Dermatology",
issn = "2168-6068",
publisher = "American Medical Association",
number = "6",

}

TY - JOUR

T1 - Objective structured assessment of technical skills in elliptical excision repair of senior dermatology residents a multirater, blinded study of operating room video recordings

AU - Alam, Murad

AU - Nodzenski, Michael

AU - Yoo, Simon S

AU - Samuelson, Emily Poon

AU - Bolotin, Diana

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Importance Surgical training in dermatology residencies has increased, and there is growing interest in measuring resident competence more precisely. This study applies the use of the objective structured assessment of technical skills (OSATS) to measure competence in dermatologic surgery. Objective To evaluate the utility of OSATS as a tool for measuring surgery skills during dermatology residency training. Design, Setting, And Participants Multirater, blinded review and ratings of taped video recordings of elliptical excisions performed by senior dermatology residents applying for procedural or Mohs surgery fellowships. Main Outcomes And Measures Ratings on a specific OSATS measure, including global rating scale and task checklist. Results Twelve videos, representing approximately 20% of fellowship applicants during 2009-2010, were rated. Raters agreed on 272 of 288 subscore ratings (94.4%). Mean global ratings were 4 or 5 for all categories, except time and motion, which had a rating of 3. Task checklist ratings had a mean of 14.5 and a mode of 16 (perfect score), with eversion least often performed successfully. No association was found between a resident's scores and the number of surgical rotation months or between scores and the number of Mohs surgeons at the home institution. Conclusions And Relevance Senior dermatology residents preparing for surgery fellowships are highly skilled in performing elliptical excisions and bilayered repairs. The OSATS appears useful and reliable for the evaluation of dermatologic surgery skills.

AB - Importance Surgical training in dermatology residencies has increased, and there is growing interest in measuring resident competence more precisely. This study applies the use of the objective structured assessment of technical skills (OSATS) to measure competence in dermatologic surgery. Objective To evaluate the utility of OSATS as a tool for measuring surgery skills during dermatology residency training. Design, Setting, And Participants Multirater, blinded review and ratings of taped video recordings of elliptical excisions performed by senior dermatology residents applying for procedural or Mohs surgery fellowships. Main Outcomes And Measures Ratings on a specific OSATS measure, including global rating scale and task checklist. Results Twelve videos, representing approximately 20% of fellowship applicants during 2009-2010, were rated. Raters agreed on 272 of 288 subscore ratings (94.4%). Mean global ratings were 4 or 5 for all categories, except time and motion, which had a rating of 3. Task checklist ratings had a mean of 14.5 and a mode of 16 (perfect score), with eversion least often performed successfully. No association was found between a resident's scores and the number of surgical rotation months or between scores and the number of Mohs surgeons at the home institution. Conclusions And Relevance Senior dermatology residents preparing for surgery fellowships are highly skilled in performing elliptical excisions and bilayered repairs. The OSATS appears useful and reliable for the evaluation of dermatologic surgery skills.

UR - http://www.scopus.com/inward/record.url?scp=84902293783&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84902293783&partnerID=8YFLogxK

U2 - 10.1001/jamadermatol.2013.6858

DO - 10.1001/jamadermatol.2013.6858

M3 - Article

VL - 150

SP - 608

EP - 612

JO - JAMA Dermatology

JF - JAMA Dermatology

SN - 2168-6068

IS - 6

ER -