Language experience changes audiovisual perception

Viorica Marian*, Sayuri Hayakawa, Tuan Q. Lam, Scott R. Schroeder

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Can experience change perception? Here, we examine whether language experience shapes the way individuals process auditory and visual information. We used the McGurk effect—the discovery that when people hear a speech sound (e.g., “ba”) and see a conflicting lip movement (e.g., “ga”), they recognize it as a completely new sound (e.g., “da”). This finding suggests that the brain fuses input across auditory and visual modalities demonstrates that what we hear is profoundly influenced by what we see. We find that cross-modal integration is affected by language background, with bilinguals experiencing the McGurk effect more than monolinguals. This increased reliance on the visual channel is not due to decreased language proficiency, as the effect was observed even among highly proficient bilinguals. Instead, we propose that the challenges of learning and monitoring multiple languages have lasting consequences for how individuals process auditory and visual information.

Original languageEnglish (US)
Article number85
JournalBrain Sciences
Volume8
Issue number5
DOIs
StatePublished - May 2018

Keywords

  • Bilingualism
  • Language
  • McGurk effect
  • Multisensory integration
  • Speech perception

ASJC Scopus subject areas

  • Neuroscience(all)

Fingerprint Dive into the research topics of 'Language experience changes audiovisual perception'. Together they form a unique fingerprint.

Cite this