AO patient outcomes center

Design, implementation, and evaluation of a software application for the collection of patient-reported outcome measures in orthopedic outpatient clinics

Nan E Rothrock*, Michael Bass, Andrea Blumenthal, Richard Gershon, Beate Hanson, Alexander Joeris, Aaron James Kaat, Suzanne Morrison, Robert V. O'Toole, Shalini Patel, Michael D Stover, Michael J. Weaver, Raymond White, Maria Varela Diaz, Mark S. Vrahas

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

Background: Patient-reported outcomes are increasingly utilized in routine orthopedic clinical care. Computer adaptive tests (CATs) from the Patient-Reported Outcomes Measurement Information System (PROMIS) offer a brief and precise assessment that is well suited for collection within busy clinical environments. However, software apps that support the administration and scoring of CATs, provide immediate access to patient-reported outcome (PRO) scores, and minimize clinician burden are not widely available. Objective: Our objective was to design, implement, and test the feasibility and usability of a Web-based system for collecting CATs in orthopedic clinics. Methods: AO Patient Outcomes Center (AOPOC) was subjected to 2 rounds of testing. Alpha testing was conducted in 3 orthopedic clinics to evaluate ease of use and feasibility of integration in clinics. Patients completed an assessment of PROMIS CATs and a usability survey. Clinicians participated in a brief semistructured interview. Beta-phase testing evaluated system performance through load testing and usability of the updated version of AOPOC. In both rounds of testing, user satisfaction, bugs, change requests, and performance of PROMIS CATs were captured. Results: Patient feedback supported the ease of use in completing an assessment in AOPOC. Across both phases of testing, clinicians rated AOPOC as easy to use but noted difficulties in integrating a Web-based software application within their clinics. PROMIS CATs performed well; the default assessment of 2 CATs was completed quickly (mean 9.5 items) with a satisfactory range of measurement.

Original languageEnglish (US)
Article numbere10880
JournalJournal of medical Internet research
Volume21
Issue number4
DOIs
StatePublished - Apr 1 2019

Fingerprint

Ambulatory Care Facilities
Orthopedics
Software
Information Systems
Computer Systems
Patient Reported Outcome Measures
Interviews

Keywords

  • Orthopedics
  • Patient reported outcome measures
  • Tablet computers

ASJC Scopus subject areas

  • Health Informatics

Cite this

Rothrock, Nan E ; Bass, Michael ; Blumenthal, Andrea ; Gershon, Richard ; Hanson, Beate ; Joeris, Alexander ; Kaat, Aaron James ; Morrison, Suzanne ; O'Toole, Robert V. ; Patel, Shalini ; Stover, Michael D ; Weaver, Michael J. ; White, Raymond ; Diaz, Maria Varela ; Vrahas, Mark S. / AO patient outcomes center : Design, implementation, and evaluation of a software application for the collection of patient-reported outcome measures in orthopedic outpatient clinics. In: Journal of medical Internet research. 2019 ; Vol. 21, No. 4.
@article{a21859f8cd494030b7df8a03e686d255,
title = "AO patient outcomes center: Design, implementation, and evaluation of a software application for the collection of patient-reported outcome measures in orthopedic outpatient clinics",
abstract = "Background: Patient-reported outcomes are increasingly utilized in routine orthopedic clinical care. Computer adaptive tests (CATs) from the Patient-Reported Outcomes Measurement Information System (PROMIS) offer a brief and precise assessment that is well suited for collection within busy clinical environments. However, software apps that support the administration and scoring of CATs, provide immediate access to patient-reported outcome (PRO) scores, and minimize clinician burden are not widely available. Objective: Our objective was to design, implement, and test the feasibility and usability of a Web-based system for collecting CATs in orthopedic clinics. Methods: AO Patient Outcomes Center (AOPOC) was subjected to 2 rounds of testing. Alpha testing was conducted in 3 orthopedic clinics to evaluate ease of use and feasibility of integration in clinics. Patients completed an assessment of PROMIS CATs and a usability survey. Clinicians participated in a brief semistructured interview. Beta-phase testing evaluated system performance through load testing and usability of the updated version of AOPOC. In both rounds of testing, user satisfaction, bugs, change requests, and performance of PROMIS CATs were captured. Results: Patient feedback supported the ease of use in completing an assessment in AOPOC. Across both phases of testing, clinicians rated AOPOC as easy to use but noted difficulties in integrating a Web-based software application within their clinics. PROMIS CATs performed well; the default assessment of 2 CATs was completed quickly (mean 9.5 items) with a satisfactory range of measurement.",
keywords = "Orthopedics, Patient reported outcome measures, Tablet computers",
author = "Rothrock, {Nan E} and Michael Bass and Andrea Blumenthal and Richard Gershon and Beate Hanson and Alexander Joeris and Kaat, {Aaron James} and Suzanne Morrison and O'Toole, {Robert V.} and Shalini Patel and Stover, {Michael D} and Weaver, {Michael J.} and Raymond White and Diaz, {Maria Varela} and Vrahas, {Mark S.}",
year = "2019",
month = "4",
day = "1",
doi = "10.2196/10880",
language = "English (US)",
volume = "21",
journal = "Journal of Medical Internet Research",
issn = "1439-4456",
publisher = "Journal of medical Internet Research",
number = "4",

}

AO patient outcomes center : Design, implementation, and evaluation of a software application for the collection of patient-reported outcome measures in orthopedic outpatient clinics. / Rothrock, Nan E; Bass, Michael; Blumenthal, Andrea; Gershon, Richard; Hanson, Beate; Joeris, Alexander; Kaat, Aaron James; Morrison, Suzanne; O'Toole, Robert V.; Patel, Shalini; Stover, Michael D; Weaver, Michael J.; White, Raymond; Diaz, Maria Varela; Vrahas, Mark S.

In: Journal of medical Internet research, Vol. 21, No. 4, e10880, 01.04.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - AO patient outcomes center

T2 - Design, implementation, and evaluation of a software application for the collection of patient-reported outcome measures in orthopedic outpatient clinics

AU - Rothrock, Nan E

AU - Bass, Michael

AU - Blumenthal, Andrea

AU - Gershon, Richard

AU - Hanson, Beate

AU - Joeris, Alexander

AU - Kaat, Aaron James

AU - Morrison, Suzanne

AU - O'Toole, Robert V.

AU - Patel, Shalini

AU - Stover, Michael D

AU - Weaver, Michael J.

AU - White, Raymond

AU - Diaz, Maria Varela

AU - Vrahas, Mark S.

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Background: Patient-reported outcomes are increasingly utilized in routine orthopedic clinical care. Computer adaptive tests (CATs) from the Patient-Reported Outcomes Measurement Information System (PROMIS) offer a brief and precise assessment that is well suited for collection within busy clinical environments. However, software apps that support the administration and scoring of CATs, provide immediate access to patient-reported outcome (PRO) scores, and minimize clinician burden are not widely available. Objective: Our objective was to design, implement, and test the feasibility and usability of a Web-based system for collecting CATs in orthopedic clinics. Methods: AO Patient Outcomes Center (AOPOC) was subjected to 2 rounds of testing. Alpha testing was conducted in 3 orthopedic clinics to evaluate ease of use and feasibility of integration in clinics. Patients completed an assessment of PROMIS CATs and a usability survey. Clinicians participated in a brief semistructured interview. Beta-phase testing evaluated system performance through load testing and usability of the updated version of AOPOC. In both rounds of testing, user satisfaction, bugs, change requests, and performance of PROMIS CATs were captured. Results: Patient feedback supported the ease of use in completing an assessment in AOPOC. Across both phases of testing, clinicians rated AOPOC as easy to use but noted difficulties in integrating a Web-based software application within their clinics. PROMIS CATs performed well; the default assessment of 2 CATs was completed quickly (mean 9.5 items) with a satisfactory range of measurement.

AB - Background: Patient-reported outcomes are increasingly utilized in routine orthopedic clinical care. Computer adaptive tests (CATs) from the Patient-Reported Outcomes Measurement Information System (PROMIS) offer a brief and precise assessment that is well suited for collection within busy clinical environments. However, software apps that support the administration and scoring of CATs, provide immediate access to patient-reported outcome (PRO) scores, and minimize clinician burden are not widely available. Objective: Our objective was to design, implement, and test the feasibility and usability of a Web-based system for collecting CATs in orthopedic clinics. Methods: AO Patient Outcomes Center (AOPOC) was subjected to 2 rounds of testing. Alpha testing was conducted in 3 orthopedic clinics to evaluate ease of use and feasibility of integration in clinics. Patients completed an assessment of PROMIS CATs and a usability survey. Clinicians participated in a brief semistructured interview. Beta-phase testing evaluated system performance through load testing and usability of the updated version of AOPOC. In both rounds of testing, user satisfaction, bugs, change requests, and performance of PROMIS CATs were captured. Results: Patient feedback supported the ease of use in completing an assessment in AOPOC. Across both phases of testing, clinicians rated AOPOC as easy to use but noted difficulties in integrating a Web-based software application within their clinics. PROMIS CATs performed well; the default assessment of 2 CATs was completed quickly (mean 9.5 items) with a satisfactory range of measurement.

KW - Orthopedics

KW - Patient reported outcome measures

KW - Tablet computers

UR - http://www.scopus.com/inward/record.url?scp=85067276576&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067276576&partnerID=8YFLogxK

U2 - 10.2196/10880

DO - 10.2196/10880

M3 - Article

VL - 21

JO - Journal of Medical Internet Research

JF - Journal of Medical Internet Research

SN - 1439-4456

IS - 4

M1 - e10880

ER -