Computerized Adaptive Testing in Pediatric Brain Tumor Clinics

Jin-Shei Lai*, Jennifer L. Beaumont, Cindy J Nowinski, David Cella, William F. Hartsell, John Han-Chih Chang, Peter E. Manley, Stewart Goldman

*Corresponding author for this work

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Context Monitoring of health-related quality of life and symptoms of patients with brain tumors is needed yet not always feasible. This is partially due to lack of brief-yet-precise assessments with minimal administration burden that are easily incorporated into clinics. Dynamic computerized adaptive testing (CAT) or static fixed-length short forms, derived from psychometrically sound item banks, are designed to fill this void. Objective This study evaluated the comparability of scores obtained from CATs and short forms. Methods Patients (ages 7–22 years) were recruited from brain tumor clinics and completed Patient-Reported Outcome Measurement Information System CATs and short forms (Fatigue, Mobility, Upper Extremity, Depressive Symptoms, Anxiety, and Peer Relationships). Pearson correlations, paired t-tests, and Cohen's d were used to evaluate the relationship, significant differences, and the magnitude of the difference between these two scores, respectively. Results Data from 161 patients with brain tumors were analyzed. Patients completed each CAT within 2 minutes. Scores obtained from CATs and short forms were highly correlated (r = 0.95–0.98). Significantly different CAT vs. short-form scores were found on 4 (of 6) domains yet with negligible effect sizes (|d| < 0.09). These relationships varied across patients with different levels of reported symptoms, with the strongest association at the worst or best symptom scores. Conclusions This study demonstrated the comparability of scores from CATs and short forms. Yet the agreement between these two varied across degrees of symptom severity which was a result of the ceiling effects of static short forms. We recommend CATs to enable individualized assessment for longitudinal monitoring.

Original languageEnglish (US)
Pages (from-to)289-297
Number of pages9
JournalJournal of Pain and Symptom Management
Volume54
Issue number3
DOIs
StatePublished - Sep 1 2017

Fingerprint

Brain Neoplasms
Pediatrics
Information Systems
Upper Extremity
Fatigue
Anxiety
Quality of Life
Depression

Keywords

  • Children
  • PROMIS
  • brain tumor
  • computerized adaptive testing (CAT)
  • patient-centered outcomes

ASJC Scopus subject areas

  • Nursing(all)
  • Clinical Neurology
  • Anesthesiology and Pain Medicine

Cite this

Lai, Jin-Shei ; Beaumont, Jennifer L. ; Nowinski, Cindy J ; Cella, David ; Hartsell, William F. ; Han-Chih Chang, John ; Manley, Peter E. ; Goldman, Stewart. / Computerized Adaptive Testing in Pediatric Brain Tumor Clinics. In: Journal of Pain and Symptom Management. 2017 ; Vol. 54, No. 3. pp. 289-297.
@article{bc177d5bebb845ddb2a493cf2b9aafe2,
title = "Computerized Adaptive Testing in Pediatric Brain Tumor Clinics",
abstract = "Context Monitoring of health-related quality of life and symptoms of patients with brain tumors is needed yet not always feasible. This is partially due to lack of brief-yet-precise assessments with minimal administration burden that are easily incorporated into clinics. Dynamic computerized adaptive testing (CAT) or static fixed-length short forms, derived from psychometrically sound item banks, are designed to fill this void. Objective This study evaluated the comparability of scores obtained from CATs and short forms. Methods Patients (ages 7–22 years) were recruited from brain tumor clinics and completed Patient-Reported Outcome Measurement Information System CATs and short forms (Fatigue, Mobility, Upper Extremity, Depressive Symptoms, Anxiety, and Peer Relationships). Pearson correlations, paired t-tests, and Cohen's d were used to evaluate the relationship, significant differences, and the magnitude of the difference between these two scores, respectively. Results Data from 161 patients with brain tumors were analyzed. Patients completed each CAT within 2 minutes. Scores obtained from CATs and short forms were highly correlated (r = 0.95–0.98). Significantly different CAT vs. short-form scores were found on 4 (of 6) domains yet with negligible effect sizes (|d| < 0.09). These relationships varied across patients with different levels of reported symptoms, with the strongest association at the worst or best symptom scores. Conclusions This study demonstrated the comparability of scores from CATs and short forms. Yet the agreement between these two varied across degrees of symptom severity which was a result of the ceiling effects of static short forms. We recommend CATs to enable individualized assessment for longitudinal monitoring.",
keywords = "Children, PROMIS, brain tumor, computerized adaptive testing (CAT), patient-centered outcomes",
author = "Jin-Shei Lai and Beaumont, {Jennifer L.} and Nowinski, {Cindy J} and David Cella and Hartsell, {William F.} and {Han-Chih Chang}, John and Manley, {Peter E.} and Stewart Goldman",
year = "2017",
month = "9",
day = "1",
doi = "10.1016/j.jpainsymman.2017.05.008",
language = "English (US)",
volume = "54",
pages = "289--297",
journal = "Journal of Pain and Symptom Management",
issn = "0885-3924",
publisher = "Elsevier Inc.",
number = "3",

}

Computerized Adaptive Testing in Pediatric Brain Tumor Clinics. / Lai, Jin-Shei; Beaumont, Jennifer L.; Nowinski, Cindy J; Cella, David; Hartsell, William F.; Han-Chih Chang, John; Manley, Peter E.; Goldman, Stewart.

In: Journal of Pain and Symptom Management, Vol. 54, No. 3, 01.09.2017, p. 289-297.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Computerized Adaptive Testing in Pediatric Brain Tumor Clinics

AU - Lai, Jin-Shei

AU - Beaumont, Jennifer L.

AU - Nowinski, Cindy J

AU - Cella, David

AU - Hartsell, William F.

AU - Han-Chih Chang, John

AU - Manley, Peter E.

AU - Goldman, Stewart

PY - 2017/9/1

Y1 - 2017/9/1

N2 - Context Monitoring of health-related quality of life and symptoms of patients with brain tumors is needed yet not always feasible. This is partially due to lack of brief-yet-precise assessments with minimal administration burden that are easily incorporated into clinics. Dynamic computerized adaptive testing (CAT) or static fixed-length short forms, derived from psychometrically sound item banks, are designed to fill this void. Objective This study evaluated the comparability of scores obtained from CATs and short forms. Methods Patients (ages 7–22 years) were recruited from brain tumor clinics and completed Patient-Reported Outcome Measurement Information System CATs and short forms (Fatigue, Mobility, Upper Extremity, Depressive Symptoms, Anxiety, and Peer Relationships). Pearson correlations, paired t-tests, and Cohen's d were used to evaluate the relationship, significant differences, and the magnitude of the difference between these two scores, respectively. Results Data from 161 patients with brain tumors were analyzed. Patients completed each CAT within 2 minutes. Scores obtained from CATs and short forms were highly correlated (r = 0.95–0.98). Significantly different CAT vs. short-form scores were found on 4 (of 6) domains yet with negligible effect sizes (|d| < 0.09). These relationships varied across patients with different levels of reported symptoms, with the strongest association at the worst or best symptom scores. Conclusions This study demonstrated the comparability of scores from CATs and short forms. Yet the agreement between these two varied across degrees of symptom severity which was a result of the ceiling effects of static short forms. We recommend CATs to enable individualized assessment for longitudinal monitoring.

AB - Context Monitoring of health-related quality of life and symptoms of patients with brain tumors is needed yet not always feasible. This is partially due to lack of brief-yet-precise assessments with minimal administration burden that are easily incorporated into clinics. Dynamic computerized adaptive testing (CAT) or static fixed-length short forms, derived from psychometrically sound item banks, are designed to fill this void. Objective This study evaluated the comparability of scores obtained from CATs and short forms. Methods Patients (ages 7–22 years) were recruited from brain tumor clinics and completed Patient-Reported Outcome Measurement Information System CATs and short forms (Fatigue, Mobility, Upper Extremity, Depressive Symptoms, Anxiety, and Peer Relationships). Pearson correlations, paired t-tests, and Cohen's d were used to evaluate the relationship, significant differences, and the magnitude of the difference between these two scores, respectively. Results Data from 161 patients with brain tumors were analyzed. Patients completed each CAT within 2 minutes. Scores obtained from CATs and short forms were highly correlated (r = 0.95–0.98). Significantly different CAT vs. short-form scores were found on 4 (of 6) domains yet with negligible effect sizes (|d| < 0.09). These relationships varied across patients with different levels of reported symptoms, with the strongest association at the worst or best symptom scores. Conclusions This study demonstrated the comparability of scores from CATs and short forms. Yet the agreement between these two varied across degrees of symptom severity which was a result of the ceiling effects of static short forms. We recommend CATs to enable individualized assessment for longitudinal monitoring.

KW - Children

KW - PROMIS

KW - brain tumor

KW - computerized adaptive testing (CAT)

KW - patient-centered outcomes

UR - http://www.scopus.com/inward/record.url?scp=85031747482&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85031747482&partnerID=8YFLogxK

U2 - 10.1016/j.jpainsymman.2017.05.008

DO - 10.1016/j.jpainsymman.2017.05.008

M3 - Article

VL - 54

SP - 289

EP - 297

JO - Journal of Pain and Symptom Management

JF - Journal of Pain and Symptom Management

SN - 0885-3924

IS - 3

ER -