A Qualitative Analysis of Narrative Preclerkship Assessment Data to Evaluate Teamwork Skills

Brigid M Dolan*, Celia Laird O'Brien, Kenzie A Cameron, Marianne Green

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

Construct: Students entering the health professions require competency in teamwork. Background: Although many teamwork curricula and assessments exist, studies have not demonstrated robust longitudinal assessment of preclerkship students' teamwork skills and attitudes. Assessment portfolios may serve to fill this gap, but it is unknown how narrative comments within portfolios describe student teamwork behaviors. Approach: We performed a qualitative analysis of narrative data in 15 assessment portfolios. Student portfolios were randomly selected from 3 groups stratified by quantitative ratings of teamwork performance gathered from small-group and clinical preceptor assessment forms. Narrative data included peer and faculty feedback from these same forms. Data were coded for teamwork-related behaviors using a constant comparative approach combined with an identification of the valence of the coded statements as either “positive observation” or “suggestion for improvement.” Results: Eight codes related to teamwork emerged: attitude and demeanor, information facilitation, leadership, preparation and dependability, professionalism, team orientation, values team member contributions, and nonspecific teamwork comments. The frequency of codes and valence varied across the 3 performance groups, with students in the low-performing group receiving more suggestions for improvement across all teamwork codes. Conclusions: Narrative data from assessment portfolios included specific descriptions of teamwork behavior, with important contributions provided by both faculty and peers. A variety of teamwork domains were represented. Such feedback as collected in an assessment portfolio can be used for longitudinal assessment of preclerkship student teamwork skills and attitudes.

Original languageEnglish (US)
Pages (from-to)1-9
Number of pages9
JournalTeaching and Learning in Medicine
DOIs
StateAccepted/In press - Apr 12 2018

Fingerprint

teamwork
narrative
student
Group
small group
performance
profession
rating
leadership
curriculum

Keywords

  • competency assessment
  • portfolio assessment
  • qualitative analysis
  • teamwork

ASJC Scopus subject areas

  • Education

Cite this

@article{b47972ddb62541b9aa99b577887978b0,
title = "A Qualitative Analysis of Narrative Preclerkship Assessment Data to Evaluate Teamwork Skills",
abstract = "Construct: Students entering the health professions require competency in teamwork. Background: Although many teamwork curricula and assessments exist, studies have not demonstrated robust longitudinal assessment of preclerkship students' teamwork skills and attitudes. Assessment portfolios may serve to fill this gap, but it is unknown how narrative comments within portfolios describe student teamwork behaviors. Approach: We performed a qualitative analysis of narrative data in 15 assessment portfolios. Student portfolios were randomly selected from 3 groups stratified by quantitative ratings of teamwork performance gathered from small-group and clinical preceptor assessment forms. Narrative data included peer and faculty feedback from these same forms. Data were coded for teamwork-related behaviors using a constant comparative approach combined with an identification of the valence of the coded statements as either “positive observation” or “suggestion for improvement.” Results: Eight codes related to teamwork emerged: attitude and demeanor, information facilitation, leadership, preparation and dependability, professionalism, team orientation, values team member contributions, and nonspecific teamwork comments. The frequency of codes and valence varied across the 3 performance groups, with students in the low-performing group receiving more suggestions for improvement across all teamwork codes. Conclusions: Narrative data from assessment portfolios included specific descriptions of teamwork behavior, with important contributions provided by both faculty and peers. A variety of teamwork domains were represented. Such feedback as collected in an assessment portfolio can be used for longitudinal assessment of preclerkship student teamwork skills and attitudes.",
keywords = "competency assessment, portfolio assessment, qualitative analysis, teamwork",
author = "Dolan, {Brigid M} and O'Brien, {Celia Laird} and Cameron, {Kenzie A} and Marianne Green",
year = "2018",
month = "4",
day = "12",
doi = "10.1080/10401334.2018.1450146",
language = "English (US)",
pages = "1--9",
journal = "Teaching and Learning in Medicine",
issn = "1040-1334",
publisher = "Routledge",

}

TY - JOUR

T1 - A Qualitative Analysis of Narrative Preclerkship Assessment Data to Evaluate Teamwork Skills

AU - Dolan, Brigid M

AU - O'Brien, Celia Laird

AU - Cameron, Kenzie A

AU - Green, Marianne

PY - 2018/4/12

Y1 - 2018/4/12

N2 - Construct: Students entering the health professions require competency in teamwork. Background: Although many teamwork curricula and assessments exist, studies have not demonstrated robust longitudinal assessment of preclerkship students' teamwork skills and attitudes. Assessment portfolios may serve to fill this gap, but it is unknown how narrative comments within portfolios describe student teamwork behaviors. Approach: We performed a qualitative analysis of narrative data in 15 assessment portfolios. Student portfolios were randomly selected from 3 groups stratified by quantitative ratings of teamwork performance gathered from small-group and clinical preceptor assessment forms. Narrative data included peer and faculty feedback from these same forms. Data were coded for teamwork-related behaviors using a constant comparative approach combined with an identification of the valence of the coded statements as either “positive observation” or “suggestion for improvement.” Results: Eight codes related to teamwork emerged: attitude and demeanor, information facilitation, leadership, preparation and dependability, professionalism, team orientation, values team member contributions, and nonspecific teamwork comments. The frequency of codes and valence varied across the 3 performance groups, with students in the low-performing group receiving more suggestions for improvement across all teamwork codes. Conclusions: Narrative data from assessment portfolios included specific descriptions of teamwork behavior, with important contributions provided by both faculty and peers. A variety of teamwork domains were represented. Such feedback as collected in an assessment portfolio can be used for longitudinal assessment of preclerkship student teamwork skills and attitudes.

AB - Construct: Students entering the health professions require competency in teamwork. Background: Although many teamwork curricula and assessments exist, studies have not demonstrated robust longitudinal assessment of preclerkship students' teamwork skills and attitudes. Assessment portfolios may serve to fill this gap, but it is unknown how narrative comments within portfolios describe student teamwork behaviors. Approach: We performed a qualitative analysis of narrative data in 15 assessment portfolios. Student portfolios were randomly selected from 3 groups stratified by quantitative ratings of teamwork performance gathered from small-group and clinical preceptor assessment forms. Narrative data included peer and faculty feedback from these same forms. Data were coded for teamwork-related behaviors using a constant comparative approach combined with an identification of the valence of the coded statements as either “positive observation” or “suggestion for improvement.” Results: Eight codes related to teamwork emerged: attitude and demeanor, information facilitation, leadership, preparation and dependability, professionalism, team orientation, values team member contributions, and nonspecific teamwork comments. The frequency of codes and valence varied across the 3 performance groups, with students in the low-performing group receiving more suggestions for improvement across all teamwork codes. Conclusions: Narrative data from assessment portfolios included specific descriptions of teamwork behavior, with important contributions provided by both faculty and peers. A variety of teamwork domains were represented. Such feedback as collected in an assessment portfolio can be used for longitudinal assessment of preclerkship student teamwork skills and attitudes.

KW - competency assessment

KW - portfolio assessment

KW - qualitative analysis

KW - teamwork

UR - http://www.scopus.com/inward/record.url?scp=85045461134&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045461134&partnerID=8YFLogxK

U2 - 10.1080/10401334.2018.1450146

DO - 10.1080/10401334.2018.1450146

M3 - Article

SP - 1

EP - 9

JO - Teaching and Learning in Medicine

JF - Teaching and Learning in Medicine

SN - 1040-1334

ER -