A Qualitative, Cross-Sectional Study of Positive and Negative Comments of Residency Programs Across 9 Medical and Surgical Specialties

Brittany O. Dulmage, Lisa Akintilo, Leah J Welty, Matthew Mason Davis, Maria L Colavincenzo, Shuai Xu

Research output: Contribution to journalComment/debate

Abstract

IMPORTANCE: Residency applicants often use social media to discuss the positive and negative features of prospective training programs. An examination of the content discussed by applicants could provide guidance for how a medical education faculty can better engage with prospective trainees and adapt to meet the educational expectations of a new generation of digital-native physicians. OBJECTIVE: The objective was to identify unstructured social media data submitted by residency applicants and categorize positive and negative statements to determine key themes. DESIGN: The study design was qualitative analysis of a retrospective cohort. SETTING: Publicly available datasets were used. PARTICIPANTS: The participants were anonymized medical trainees applying to residency training positions in 9 specialties—dermatology, general surgery, internal medicine, obstetrics/gynecology, plastic surgery, otolaryngology, physical medicine and rehabilitation, pediatrics, and radiology—from 2007 to 2017. MAIN OUTCOMES AND MEASURES: After we developed a standardized coding scheme that broke comments down into major features, themes, and subthemes, all unstructured comments were coded by two independent researchers. Positive and negative comments were coded separately. Frequency counts and percentages were recorded for each identified feature, theme, and subtheme. The percent positive and negative comments by specialty were also calculated. RESULTS: : Of the 6314 comments identified, 4541 were positive and 1773 were negative. Institution was the most commonly cited major feature in both the positive (n = 767 [17%]) and negative (n = 827 [47%]) comments. Geography was the most cited theme, and City, Cost of Living, and Commute were commonly cited subthemes. Training was the next most cited major feature in both positive (n = 1005 [22%]) and negative (n = 291 [16%]) comments, with Clinical Training being more commonly cited compared to Research Opportunities. Overall, 72% of comments from all were positive; however, the percent of comments that were positive comments varied significantly across the 9 specialties. Pediatrics (65%), dermatology (66%), and internal medicine (68%) applicants were more likely to express negative comments compared with the global average, but physical medicine and rehabilitation (85%), radiology (82%), otolaryngology (81%), and plastic surgery (80%) applicants were more likely to express positive comments. CONCLUSIONS AND RELEVANCE: This qualitative analysis of positive and negative themes as posted by applicants in recent matching years is the first and provides new detailed insights into the motivations and desires of trainees.

Original languageEnglish (US)
Pages (from-to)1130-1134.e6
JournalAmerican Journal of Medicine
Volume131
Issue number9
DOIs
StatePublished - Sep 1 2018

Fingerprint

Surgical Specialties
Internship and Residency
Social Media
Physical and Rehabilitation Medicine
Cross-Sectional Studies
Otolaryngology
Medicine
Plastic Surgery
Internal Medicine
Pediatrics
Medical Faculties
Geography
Medical Education
Dermatology
Gynecology
Population Groups
Radiology
Obstetrics
Economics
Research Personnel

Keywords

  • Internet
  • Medical education
  • Residency
  • Resident matching
  • Social media

ASJC Scopus subject areas

  • Medicine(all)

Cite this

@article{49afd785fd2e4b60a49c293b70ed4065,
title = "A Qualitative, Cross-Sectional Study of Positive and Negative Comments of Residency Programs Across 9 Medical and Surgical Specialties",
abstract = "IMPORTANCE: Residency applicants often use social media to discuss the positive and negative features of prospective training programs. An examination of the content discussed by applicants could provide guidance for how a medical education faculty can better engage with prospective trainees and adapt to meet the educational expectations of a new generation of digital-native physicians. OBJECTIVE: The objective was to identify unstructured social media data submitted by residency applicants and categorize positive and negative statements to determine key themes. DESIGN: The study design was qualitative analysis of a retrospective cohort. SETTING: Publicly available datasets were used. PARTICIPANTS: The participants were anonymized medical trainees applying to residency training positions in 9 specialties—dermatology, general surgery, internal medicine, obstetrics/gynecology, plastic surgery, otolaryngology, physical medicine and rehabilitation, pediatrics, and radiology—from 2007 to 2017. MAIN OUTCOMES AND MEASURES: After we developed a standardized coding scheme that broke comments down into major features, themes, and subthemes, all unstructured comments were coded by two independent researchers. Positive and negative comments were coded separately. Frequency counts and percentages were recorded for each identified feature, theme, and subtheme. The percent positive and negative comments by specialty were also calculated. RESULTS: : Of the 6314 comments identified, 4541 were positive and 1773 were negative. Institution was the most commonly cited major feature in both the positive (n = 767 [17{\%}]) and negative (n = 827 [47{\%}]) comments. Geography was the most cited theme, and City, Cost of Living, and Commute were commonly cited subthemes. Training was the next most cited major feature in both positive (n = 1005 [22{\%}]) and negative (n = 291 [16{\%}]) comments, with Clinical Training being more commonly cited compared to Research Opportunities. Overall, 72{\%} of comments from all were positive; however, the percent of comments that were positive comments varied significantly across the 9 specialties. Pediatrics (65{\%}), dermatology (66{\%}), and internal medicine (68{\%}) applicants were more likely to express negative comments compared with the global average, but physical medicine and rehabilitation (85{\%}), radiology (82{\%}), otolaryngology (81{\%}), and plastic surgery (80{\%}) applicants were more likely to express positive comments. CONCLUSIONS AND RELEVANCE: This qualitative analysis of positive and negative themes as posted by applicants in recent matching years is the first and provides new detailed insights into the motivations and desires of trainees.",
keywords = "Internet, Medical education, Residency, Resident matching, Social media",
author = "Dulmage, {Brittany O.} and Lisa Akintilo and Welty, {Leah J} and Davis, {Matthew Mason} and Colavincenzo, {Maria L} and Shuai Xu",
year = "2018",
month = "9",
day = "1",
doi = "10.1016/j.amjmed.2018.05.019",
language = "English (US)",
volume = "131",
pages = "1130--1134.e6",
journal = "American Journal of Medicine",
issn = "0002-9343",
publisher = "Elsevier Inc.",
number = "9",

}

TY - JOUR

T1 - A Qualitative, Cross-Sectional Study of Positive and Negative Comments of Residency Programs Across 9 Medical and Surgical Specialties

AU - Dulmage, Brittany O.

AU - Akintilo, Lisa

AU - Welty, Leah J

AU - Davis, Matthew Mason

AU - Colavincenzo, Maria L

AU - Xu, Shuai

PY - 2018/9/1

Y1 - 2018/9/1

N2 - IMPORTANCE: Residency applicants often use social media to discuss the positive and negative features of prospective training programs. An examination of the content discussed by applicants could provide guidance for how a medical education faculty can better engage with prospective trainees and adapt to meet the educational expectations of a new generation of digital-native physicians. OBJECTIVE: The objective was to identify unstructured social media data submitted by residency applicants and categorize positive and negative statements to determine key themes. DESIGN: The study design was qualitative analysis of a retrospective cohort. SETTING: Publicly available datasets were used. PARTICIPANTS: The participants were anonymized medical trainees applying to residency training positions in 9 specialties—dermatology, general surgery, internal medicine, obstetrics/gynecology, plastic surgery, otolaryngology, physical medicine and rehabilitation, pediatrics, and radiology—from 2007 to 2017. MAIN OUTCOMES AND MEASURES: After we developed a standardized coding scheme that broke comments down into major features, themes, and subthemes, all unstructured comments were coded by two independent researchers. Positive and negative comments were coded separately. Frequency counts and percentages were recorded for each identified feature, theme, and subtheme. The percent positive and negative comments by specialty were also calculated. RESULTS: : Of the 6314 comments identified, 4541 were positive and 1773 were negative. Institution was the most commonly cited major feature in both the positive (n = 767 [17%]) and negative (n = 827 [47%]) comments. Geography was the most cited theme, and City, Cost of Living, and Commute were commonly cited subthemes. Training was the next most cited major feature in both positive (n = 1005 [22%]) and negative (n = 291 [16%]) comments, with Clinical Training being more commonly cited compared to Research Opportunities. Overall, 72% of comments from all were positive; however, the percent of comments that were positive comments varied significantly across the 9 specialties. Pediatrics (65%), dermatology (66%), and internal medicine (68%) applicants were more likely to express negative comments compared with the global average, but physical medicine and rehabilitation (85%), radiology (82%), otolaryngology (81%), and plastic surgery (80%) applicants were more likely to express positive comments. CONCLUSIONS AND RELEVANCE: This qualitative analysis of positive and negative themes as posted by applicants in recent matching years is the first and provides new detailed insights into the motivations and desires of trainees.

AB - IMPORTANCE: Residency applicants often use social media to discuss the positive and negative features of prospective training programs. An examination of the content discussed by applicants could provide guidance for how a medical education faculty can better engage with prospective trainees and adapt to meet the educational expectations of a new generation of digital-native physicians. OBJECTIVE: The objective was to identify unstructured social media data submitted by residency applicants and categorize positive and negative statements to determine key themes. DESIGN: The study design was qualitative analysis of a retrospective cohort. SETTING: Publicly available datasets were used. PARTICIPANTS: The participants were anonymized medical trainees applying to residency training positions in 9 specialties—dermatology, general surgery, internal medicine, obstetrics/gynecology, plastic surgery, otolaryngology, physical medicine and rehabilitation, pediatrics, and radiology—from 2007 to 2017. MAIN OUTCOMES AND MEASURES: After we developed a standardized coding scheme that broke comments down into major features, themes, and subthemes, all unstructured comments were coded by two independent researchers. Positive and negative comments were coded separately. Frequency counts and percentages were recorded for each identified feature, theme, and subtheme. The percent positive and negative comments by specialty were also calculated. RESULTS: : Of the 6314 comments identified, 4541 were positive and 1773 were negative. Institution was the most commonly cited major feature in both the positive (n = 767 [17%]) and negative (n = 827 [47%]) comments. Geography was the most cited theme, and City, Cost of Living, and Commute were commonly cited subthemes. Training was the next most cited major feature in both positive (n = 1005 [22%]) and negative (n = 291 [16%]) comments, with Clinical Training being more commonly cited compared to Research Opportunities. Overall, 72% of comments from all were positive; however, the percent of comments that were positive comments varied significantly across the 9 specialties. Pediatrics (65%), dermatology (66%), and internal medicine (68%) applicants were more likely to express negative comments compared with the global average, but physical medicine and rehabilitation (85%), radiology (82%), otolaryngology (81%), and plastic surgery (80%) applicants were more likely to express positive comments. CONCLUSIONS AND RELEVANCE: This qualitative analysis of positive and negative themes as posted by applicants in recent matching years is the first and provides new detailed insights into the motivations and desires of trainees.

KW - Internet

KW - Medical education

KW - Residency

KW - Resident matching

KW - Social media

UR - http://www.scopus.com/inward/record.url?scp=85050793081&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050793081&partnerID=8YFLogxK

U2 - 10.1016/j.amjmed.2018.05.019

DO - 10.1016/j.amjmed.2018.05.019

M3 - Comment/debate

C2 - 29908767

AN - SCOPUS:85050793081

VL - 131

SP - 1130-1134.e6

JO - American Journal of Medicine

JF - American Journal of Medicine

SN - 0002-9343

IS - 9

ER -