TY - JOUR
T1 - Checklist-style rubric development for practical examination of clinical skills in entry-level physical therapist education
AU - Tappan, Rachel S.
AU - Hedman, Lois D.
AU - López-Rosado, Roberto
AU - Roth, Heidi R.
N1 - Publisher Copyright:
© 2020 Assoc. of Schools Advancing Health Professions, Wash., DC.
PY - 2020/9
Y1 - 2020/9
N2 - BACKGROUND: Grading rubrics used in the assessment of physical therapy students' clinical skills should be developed in a method that promotes validity. This study applied a systematic approach to the development of rubrics to assess student performance within a Doctor of Physical Therapy curriculum. PARTICIPANTS: Ten faculty participated. METHODS: Checklist-style rubrics covering four clinical skills were developed using a five-step process: 1) evidence-based rubric item development; 2) multiple Delphi review rounds to achieve consensus on item content; 3) pilot testing and formatting of rubrics; 4) final Delphi review; 5) weighting of rubric sections. Consensus in the Delphi review was defined as: ≥75% of participants rate each item Agree/Strongly Agree in two consecutive rounds, no statistically significant difference between Likert ratings on the final two rounds for each item using the Wilcoxon signed-rank test (p>0.05), and a reduction in participant comments between the first and last rounds. RESULTS: All rubric items achieved consensus with: 100% agreement, no statistically significant difference between the two final sets of ratings (p=0.102 to 1.000), and a decrease in the number of comments from 81 in Round 1 to 21 in Round 5. CONCLUSION: This method of rubric development resulted in rubrics with validity, acceptability, and time efficiencies.
AB - BACKGROUND: Grading rubrics used in the assessment of physical therapy students' clinical skills should be developed in a method that promotes validity. This study applied a systematic approach to the development of rubrics to assess student performance within a Doctor of Physical Therapy curriculum. PARTICIPANTS: Ten faculty participated. METHODS: Checklist-style rubrics covering four clinical skills were developed using a five-step process: 1) evidence-based rubric item development; 2) multiple Delphi review rounds to achieve consensus on item content; 3) pilot testing and formatting of rubrics; 4) final Delphi review; 5) weighting of rubric sections. Consensus in the Delphi review was defined as: ≥75% of participants rate each item Agree/Strongly Agree in two consecutive rounds, no statistically significant difference between Likert ratings on the final two rounds for each item using the Wilcoxon signed-rank test (p>0.05), and a reduction in participant comments between the first and last rounds. RESULTS: All rubric items achieved consensus with: 100% agreement, no statistically significant difference between the two final sets of ratings (p=0.102 to 1.000), and a decrease in the number of comments from 81 in Round 1 to 21 in Round 5. CONCLUSION: This method of rubric development resulted in rubrics with validity, acceptability, and time efficiencies.
UR - http://www.scopus.com/inward/record.url?scp=85090261371&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85090261371&partnerID=8YFLogxK
M3 - Article
C2 - 32877478
AN - SCOPUS:85090261371
SN - 0090-7421
VL - 49
SP - 202
EP - 211
JO - Journal of allied health
JF - Journal of allied health
IS - 3
ER -