Tracking sentence comprehension

Test-retest reliability in people with aphasia and unimpaired adults

Jennifer E Mack*, Andrew Zu Sern Wei, Stephanie Gutierrez, Cynthia K Thompson

*Corresponding author for this work

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Purpose: Visual-world eyetracking is increasingly used to investigate online language processing in normal and language impaired listeners. Tracking changes in eye movements over time also may be useful for indexing language recovery in those with language impairments. Therefore, it is critical to determine the test-retest reliability of results obtained using this method. Methods: Unimpaired young adults and people with aphasia took part in two eyetracking sessions spaced about one week apart. In each session, participants completed a sentence-picture matching task in which they listened to active and passive sentences (e.g., The [N1+Aux woman was] [V visiting/visited] [NP/PP2 (by) the man]) and selected between two pictures with reversed thematic roles. We used intraclass correlations (ICCs) to examine the test-retest reliability of response measures (accuracy, reaction time (RT)) and online eye movements (i.e., the likelihood of fixating the target picture in each region of the sentence) in each participant group. Results: In the unimpaired adults, accuracy was at ceiling (thus ICCs were not computed), with moderate ICCs for RT (i.e., 0.4-0.58) for passive sentences and low (<0.4) for actives. In individuals with aphasia, test-retest reliability was strong (0.59 < ICC < 0.75) for accuracy and excellent (>0.75) for RT for both sentence types. Similarly, for the unimpaired listeners, reliability of eye movements was moderate for passive sentences (NP/PP2 region) and low in all regions for active sentences. But, for the aphasic participant group, eye movement reliability was excellent for passive sentences (in the first second after sentence end) and strong for active sentences (V and NP/PP2 regions). Conclusion: Results indicated moderate-to-low reliability for unimpaired listeners; however, reliable eye movement patterns were detected for processes specific to passive sentences (e.g., thematic reanalysis). In contrast, individuals with aphasia exhibited strong and stable performance across sentence types in response measures and online eye movements. These findings indicate that visual-world eyetracking provides a reliable measure of online sentence comprehension in aphasia, and thus may be useful for investigating sentence processing changes over time.

Original languageEnglish (US)
Pages (from-to)98-111
Number of pages14
JournalJournal of Neurolinguistics
Volume40
DOIs
StatePublished - Nov 1 2016

Fingerprint

Aphasia
speech disorder
Eye Movements
Reproducibility of Results
comprehension
listener
Language
Reaction Time
language
indexing
young adult
Group
time
Test-retest Reliability
Sentence Comprehension
Young Adult
Passive Sentences
performance
Listeners

Keywords

  • Aphasia
  • Eyetracking
  • Sentence comprehension
  • Test-retest reliability

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Arts and Humanities (miscellaneous)
  • Linguistics and Language
  • Cognitive Neuroscience

Cite this

@article{98213e1c4f97449d80d6062ac247f539,
title = "Tracking sentence comprehension: Test-retest reliability in people with aphasia and unimpaired adults",
abstract = "Purpose: Visual-world eyetracking is increasingly used to investigate online language processing in normal and language impaired listeners. Tracking changes in eye movements over time also may be useful for indexing language recovery in those with language impairments. Therefore, it is critical to determine the test-retest reliability of results obtained using this method. Methods: Unimpaired young adults and people with aphasia took part in two eyetracking sessions spaced about one week apart. In each session, participants completed a sentence-picture matching task in which they listened to active and passive sentences (e.g., The [N1+Aux woman was] [V visiting/visited] [NP/PP2 (by) the man]) and selected between two pictures with reversed thematic roles. We used intraclass correlations (ICCs) to examine the test-retest reliability of response measures (accuracy, reaction time (RT)) and online eye movements (i.e., the likelihood of fixating the target picture in each region of the sentence) in each participant group. Results: In the unimpaired adults, accuracy was at ceiling (thus ICCs were not computed), with moderate ICCs for RT (i.e., 0.4-0.58) for passive sentences and low (<0.4) for actives. In individuals with aphasia, test-retest reliability was strong (0.59 < ICC < 0.75) for accuracy and excellent (>0.75) for RT for both sentence types. Similarly, for the unimpaired listeners, reliability of eye movements was moderate for passive sentences (NP/PP2 region) and low in all regions for active sentences. But, for the aphasic participant group, eye movement reliability was excellent for passive sentences (in the first second after sentence end) and strong for active sentences (V and NP/PP2 regions). Conclusion: Results indicated moderate-to-low reliability for unimpaired listeners; however, reliable eye movement patterns were detected for processes specific to passive sentences (e.g., thematic reanalysis). In contrast, individuals with aphasia exhibited strong and stable performance across sentence types in response measures and online eye movements. These findings indicate that visual-world eyetracking provides a reliable measure of online sentence comprehension in aphasia, and thus may be useful for investigating sentence processing changes over time.",
keywords = "Aphasia, Eyetracking, Sentence comprehension, Test-retest reliability",
author = "Mack, {Jennifer E} and Wei, {Andrew Zu Sern} and Stephanie Gutierrez and Thompson, {Cynthia K}",
year = "2016",
month = "11",
day = "1",
doi = "10.1016/j.jneuroling.2016.06.001",
language = "English (US)",
volume = "40",
pages = "98--111",
journal = "Journal of Neurolinguistics",
issn = "0911-6044",
publisher = "Elsevier BV",

}

Tracking sentence comprehension : Test-retest reliability in people with aphasia and unimpaired adults. / Mack, Jennifer E; Wei, Andrew Zu Sern; Gutierrez, Stephanie; Thompson, Cynthia K.

In: Journal of Neurolinguistics, Vol. 40, 01.11.2016, p. 98-111.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Tracking sentence comprehension

T2 - Test-retest reliability in people with aphasia and unimpaired adults

AU - Mack, Jennifer E

AU - Wei, Andrew Zu Sern

AU - Gutierrez, Stephanie

AU - Thompson, Cynthia K

PY - 2016/11/1

Y1 - 2016/11/1

N2 - Purpose: Visual-world eyetracking is increasingly used to investigate online language processing in normal and language impaired listeners. Tracking changes in eye movements over time also may be useful for indexing language recovery in those with language impairments. Therefore, it is critical to determine the test-retest reliability of results obtained using this method. Methods: Unimpaired young adults and people with aphasia took part in two eyetracking sessions spaced about one week apart. In each session, participants completed a sentence-picture matching task in which they listened to active and passive sentences (e.g., The [N1+Aux woman was] [V visiting/visited] [NP/PP2 (by) the man]) and selected between two pictures with reversed thematic roles. We used intraclass correlations (ICCs) to examine the test-retest reliability of response measures (accuracy, reaction time (RT)) and online eye movements (i.e., the likelihood of fixating the target picture in each region of the sentence) in each participant group. Results: In the unimpaired adults, accuracy was at ceiling (thus ICCs were not computed), with moderate ICCs for RT (i.e., 0.4-0.58) for passive sentences and low (<0.4) for actives. In individuals with aphasia, test-retest reliability was strong (0.59 < ICC < 0.75) for accuracy and excellent (>0.75) for RT for both sentence types. Similarly, for the unimpaired listeners, reliability of eye movements was moderate for passive sentences (NP/PP2 region) and low in all regions for active sentences. But, for the aphasic participant group, eye movement reliability was excellent for passive sentences (in the first second after sentence end) and strong for active sentences (V and NP/PP2 regions). Conclusion: Results indicated moderate-to-low reliability for unimpaired listeners; however, reliable eye movement patterns were detected for processes specific to passive sentences (e.g., thematic reanalysis). In contrast, individuals with aphasia exhibited strong and stable performance across sentence types in response measures and online eye movements. These findings indicate that visual-world eyetracking provides a reliable measure of online sentence comprehension in aphasia, and thus may be useful for investigating sentence processing changes over time.

AB - Purpose: Visual-world eyetracking is increasingly used to investigate online language processing in normal and language impaired listeners. Tracking changes in eye movements over time also may be useful for indexing language recovery in those with language impairments. Therefore, it is critical to determine the test-retest reliability of results obtained using this method. Methods: Unimpaired young adults and people with aphasia took part in two eyetracking sessions spaced about one week apart. In each session, participants completed a sentence-picture matching task in which they listened to active and passive sentences (e.g., The [N1+Aux woman was] [V visiting/visited] [NP/PP2 (by) the man]) and selected between two pictures with reversed thematic roles. We used intraclass correlations (ICCs) to examine the test-retest reliability of response measures (accuracy, reaction time (RT)) and online eye movements (i.e., the likelihood of fixating the target picture in each region of the sentence) in each participant group. Results: In the unimpaired adults, accuracy was at ceiling (thus ICCs were not computed), with moderate ICCs for RT (i.e., 0.4-0.58) for passive sentences and low (<0.4) for actives. In individuals with aphasia, test-retest reliability was strong (0.59 < ICC < 0.75) for accuracy and excellent (>0.75) for RT for both sentence types. Similarly, for the unimpaired listeners, reliability of eye movements was moderate for passive sentences (NP/PP2 region) and low in all regions for active sentences. But, for the aphasic participant group, eye movement reliability was excellent for passive sentences (in the first second after sentence end) and strong for active sentences (V and NP/PP2 regions). Conclusion: Results indicated moderate-to-low reliability for unimpaired listeners; however, reliable eye movement patterns were detected for processes specific to passive sentences (e.g., thematic reanalysis). In contrast, individuals with aphasia exhibited strong and stable performance across sentence types in response measures and online eye movements. These findings indicate that visual-world eyetracking provides a reliable measure of online sentence comprehension in aphasia, and thus may be useful for investigating sentence processing changes over time.

KW - Aphasia

KW - Eyetracking

KW - Sentence comprehension

KW - Test-retest reliability

UR - http://www.scopus.com/inward/record.url?scp=84975508533&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84975508533&partnerID=8YFLogxK

U2 - 10.1016/j.jneuroling.2016.06.001

DO - 10.1016/j.jneuroling.2016.06.001

M3 - Article

VL - 40

SP - 98

EP - 111

JO - Journal of Neurolinguistics

JF - Journal of Neurolinguistics

SN - 0911-6044

ER -