Calibration and initial validation of a general self-efficacy item bank and short form for the NIH PROMIS®

John M. Salsman*, Benjamin David Schalet, Thomas V. Merluzzi, Crystal L. Park, Elizabeth A Hahn, Mallory A. Snyder, David Cella

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

Aims: General self-efficacy is associated with adaptive coping and positive health outcomes. The Patient-Reported Outcomes Measurement Information System (PROMIS®) has developed self-efficacy item banks for managing chronic conditions, but lacks a general self-efficacy measure. We sought to refine and validate an item-response theory (IRT)-based measure of general self-efficacy for PROMIS®. Methods: Ten items were modified from the NIH Toolbox® Self-Efficacy Item Bank by creating “confidence” response options, and administered to a general population sample (n = 1000) with the Toolbox® Self-Efficacy Item Bank, Life Orientation Test-Revised (LOT-R), and Generalized Expectancy for Success Scale (GESS). We split the sample in half for exploratory factor analysis (EFA) followed by confirmatory factor analysis (CFA). IRT analyses included evaluation of differential item functioning (DIF). Results: Participants had a mean age of 47.8 years and 50.3% were male. EFA showed all items loaded onto one dominant factor and CFA yielded a good fitting model for a general self-efficacy bank with confidence response options (CFI = 0.987, TLI = 0.984, RMSEA = 0.090). Items showed no evidence of DIF by gender, age, education, or race. Internal consistency reliability was α =.94 and.88 for a new 10-item general self-efficacy bank and 4-item short form, respectively. The new bank was correlated with the LOT-R (r =.58), the GESS (r =.55), and the Toolbox® Self-Efficacy Item Bank (r =.87). Conclusions: The PROMIS® General Self-Efficacy measure demonstrated sufficient unidimensionality and displayed good internal consistency reliability, model fit, and convergent validity. Further psychometric testing of the PROMIS® General Self-Efficacy Item Bank and Short Form can evaluate its utility in people with chronic health conditions.

Original languageEnglish (US)
JournalQuality of Life Research
DOIs
StatePublished - Jan 1 2019

Fingerprint

Self Efficacy
Information Systems
Calibration
Statistical Factor Analysis
Patient Reported Outcome Measures
Health
Psychometrics
Education

Keywords

  • Item-response theory
  • Oncology
  • Patient-reported outcomes
  • Psychological adaptation
  • Self-efficacy
  • Well-being

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

@article{f89dce591f1d4a239b2ea32f58c28c03,
title = "Calibration and initial validation of a general self-efficacy item bank and short form for the NIH PROMIS{\circledR}",
abstract = "Aims: General self-efficacy is associated with adaptive coping and positive health outcomes. The Patient-Reported Outcomes Measurement Information System (PROMIS{\circledR}) has developed self-efficacy item banks for managing chronic conditions, but lacks a general self-efficacy measure. We sought to refine and validate an item-response theory (IRT)-based measure of general self-efficacy for PROMIS{\circledR}. Methods: Ten items were modified from the NIH Toolbox{\circledR} Self-Efficacy Item Bank by creating “confidence” response options, and administered to a general population sample (n = 1000) with the Toolbox{\circledR} Self-Efficacy Item Bank, Life Orientation Test-Revised (LOT-R), and Generalized Expectancy for Success Scale (GESS). We split the sample in half for exploratory factor analysis (EFA) followed by confirmatory factor analysis (CFA). IRT analyses included evaluation of differential item functioning (DIF). Results: Participants had a mean age of 47.8 years and 50.3{\%} were male. EFA showed all items loaded onto one dominant factor and CFA yielded a good fitting model for a general self-efficacy bank with confidence response options (CFI = 0.987, TLI = 0.984, RMSEA = 0.090). Items showed no evidence of DIF by gender, age, education, or race. Internal consistency reliability was α =.94 and.88 for a new 10-item general self-efficacy bank and 4-item short form, respectively. The new bank was correlated with the LOT-R (r =.58), the GESS (r =.55), and the Toolbox{\circledR} Self-Efficacy Item Bank (r =.87). Conclusions: The PROMIS{\circledR} General Self-Efficacy measure demonstrated sufficient unidimensionality and displayed good internal consistency reliability, model fit, and convergent validity. Further psychometric testing of the PROMIS{\circledR} General Self-Efficacy Item Bank and Short Form can evaluate its utility in people with chronic health conditions.",
keywords = "Item-response theory, Oncology, Patient-reported outcomes, Psychological adaptation, Self-efficacy, Well-being",
author = "Salsman, {John M.} and Schalet, {Benjamin David} and Merluzzi, {Thomas V.} and Park, {Crystal L.} and Hahn, {Elizabeth A} and Snyder, {Mallory A.} and David Cella",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/s11136-019-02198-6",
language = "English (US)",
journal = "Quality of Life Research",
issn = "0962-9343",
publisher = "Springer Netherlands",

}

Calibration and initial validation of a general self-efficacy item bank and short form for the NIH PROMIS®. / Salsman, John M.; Schalet, Benjamin David; Merluzzi, Thomas V.; Park, Crystal L.; Hahn, Elizabeth A; Snyder, Mallory A.; Cella, David.

In: Quality of Life Research, 01.01.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Calibration and initial validation of a general self-efficacy item bank and short form for the NIH PROMIS®

AU - Salsman, John M.

AU - Schalet, Benjamin David

AU - Merluzzi, Thomas V.

AU - Park, Crystal L.

AU - Hahn, Elizabeth A

AU - Snyder, Mallory A.

AU - Cella, David

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Aims: General self-efficacy is associated with adaptive coping and positive health outcomes. The Patient-Reported Outcomes Measurement Information System (PROMIS®) has developed self-efficacy item banks for managing chronic conditions, but lacks a general self-efficacy measure. We sought to refine and validate an item-response theory (IRT)-based measure of general self-efficacy for PROMIS®. Methods: Ten items were modified from the NIH Toolbox® Self-Efficacy Item Bank by creating “confidence” response options, and administered to a general population sample (n = 1000) with the Toolbox® Self-Efficacy Item Bank, Life Orientation Test-Revised (LOT-R), and Generalized Expectancy for Success Scale (GESS). We split the sample in half for exploratory factor analysis (EFA) followed by confirmatory factor analysis (CFA). IRT analyses included evaluation of differential item functioning (DIF). Results: Participants had a mean age of 47.8 years and 50.3% were male. EFA showed all items loaded onto one dominant factor and CFA yielded a good fitting model for a general self-efficacy bank with confidence response options (CFI = 0.987, TLI = 0.984, RMSEA = 0.090). Items showed no evidence of DIF by gender, age, education, or race. Internal consistency reliability was α =.94 and.88 for a new 10-item general self-efficacy bank and 4-item short form, respectively. The new bank was correlated with the LOT-R (r =.58), the GESS (r =.55), and the Toolbox® Self-Efficacy Item Bank (r =.87). Conclusions: The PROMIS® General Self-Efficacy measure demonstrated sufficient unidimensionality and displayed good internal consistency reliability, model fit, and convergent validity. Further psychometric testing of the PROMIS® General Self-Efficacy Item Bank and Short Form can evaluate its utility in people with chronic health conditions.

AB - Aims: General self-efficacy is associated with adaptive coping and positive health outcomes. The Patient-Reported Outcomes Measurement Information System (PROMIS®) has developed self-efficacy item banks for managing chronic conditions, but lacks a general self-efficacy measure. We sought to refine and validate an item-response theory (IRT)-based measure of general self-efficacy for PROMIS®. Methods: Ten items were modified from the NIH Toolbox® Self-Efficacy Item Bank by creating “confidence” response options, and administered to a general population sample (n = 1000) with the Toolbox® Self-Efficacy Item Bank, Life Orientation Test-Revised (LOT-R), and Generalized Expectancy for Success Scale (GESS). We split the sample in half for exploratory factor analysis (EFA) followed by confirmatory factor analysis (CFA). IRT analyses included evaluation of differential item functioning (DIF). Results: Participants had a mean age of 47.8 years and 50.3% were male. EFA showed all items loaded onto one dominant factor and CFA yielded a good fitting model for a general self-efficacy bank with confidence response options (CFI = 0.987, TLI = 0.984, RMSEA = 0.090). Items showed no evidence of DIF by gender, age, education, or race. Internal consistency reliability was α =.94 and.88 for a new 10-item general self-efficacy bank and 4-item short form, respectively. The new bank was correlated with the LOT-R (r =.58), the GESS (r =.55), and the Toolbox® Self-Efficacy Item Bank (r =.87). Conclusions: The PROMIS® General Self-Efficacy measure demonstrated sufficient unidimensionality and displayed good internal consistency reliability, model fit, and convergent validity. Further psychometric testing of the PROMIS® General Self-Efficacy Item Bank and Short Form can evaluate its utility in people with chronic health conditions.

KW - Item-response theory

KW - Oncology

KW - Patient-reported outcomes

KW - Psychological adaptation

KW - Self-efficacy

KW - Well-being

UR - http://www.scopus.com/inward/record.url?scp=85066786514&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066786514&partnerID=8YFLogxK

U2 - 10.1007/s11136-019-02198-6

DO - 10.1007/s11136-019-02198-6

M3 - Article

JO - Quality of Life Research

JF - Quality of Life Research

SN - 0962-9343

ER -