A Multi-Trait Multi-Method Examination of Psychometric Instrument Performance in Autism Spectrum Disorder

Michael A. Levine, Huan Chen, Ericka L. Wodka, Alyssa C. Deronda, Brian S. Caffo, Joshua B. Ewen*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Anecdotal evidence has suggested that rater-based measures (e.g., parent report) may have strong across-trait/within-individual covariance that detracts from trait-specific measurement precision; rater measurement-related bias may help explain poor correlation within Autism Spectrum Disorder (ASD) samples between rater-based and performance-based measures of the same trait. We used a multi-trait, multi-method approach to examine method-associated bias within an ASD sample (n = 83). We examined performance/rater-instrument pairs for attention, inhibition, working memory, motor coordination, and core ASD features. Rater-based scores showed an overall greater methodology bias (57% of variance in score explained by method), while performance-based scores showed a weaker methodology bias (22%). The degree of inter-individual variance explained by method alone substantiates an anecdotal concern associated with the use of rater measures in ASD.

Original languageEnglish (US)
Pages (from-to)892-898
Number of pages7
JournalAssessment
Volume31
Issue number4
DOIs
StatePublished - Jun 2024

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Funding for this work came from the NIH grant R01MH113652 to J.B.E. and P50HD103538. Funding sources were not involved in the analysis or interpretation of data, writing of the report, or the decision to submit for publication.

Keywords

  • MTMM
  • autism
  • autism symptom severity
  • performance instrument
  • rater instrument

ASJC Scopus subject areas

  • Clinical Psychology
  • Applied Psychology

Fingerprint

Dive into the research topics of 'A Multi-Trait Multi-Method Examination of Psychometric Instrument Performance in Autism Spectrum Disorder'. Together they form a unique fingerprint.

Cite this