Improving Visual Memory with Auditory Input

Scott R. Schroeder, Viorica Marian

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Can input in one sensory modality strengthen memory in a different sensory modality? To address this question, we asked participants to encode images presented in various locations (e.g., a depicted dog in the top left corner of the screen) while they heard spatially uninformative sounds. Some of these sounds matched the image (e.g., the word “dog” or a barking sound) while others did not. In a subsequent memory test, participants were better at remembering the locations of images that were encoded with a matching sound, even though these sounds were spatially uninformative - an effect that was mediated by whether the sounds were verbal or non-verbal. Because the sounds did not provide any relevant location information, better spatial memory cannot be attributed to auditory memory; rather, it is attributed to visual memory being strengthened by the matching auditory input. These findings provide the first behavioral evidence for cross-modal interactions in memory.

Original languageEnglish (US)
Title of host publicationProceedings of the 38th Annual Meeting of the Cognitive Science Society, CogSci 2016
EditorsAnna Papafragou, Daniel Grodner, Daniel Mirman, John C. Trueswell
PublisherThe Cognitive Science Society
Pages348-353
Number of pages6
ISBN (Electronic)9780991196739
StatePublished - 2016
Externally publishedYes
Event38th Annual Meeting of the Cognitive Science Society: Recognizing and Representing Events, CogSci 2016 - Philadelphia, United States
Duration: Aug 10 2016Aug 13 2016

Publication series

NameProceedings of the 38th Annual Meeting of the Cognitive Science Society, CogSci 2016

Conference

Conference38th Annual Meeting of the Cognitive Science Society: Recognizing and Representing Events, CogSci 2016
Country/TerritoryUnited States
CityPhiladelphia
Period8/10/168/13/16

Keywords

  • Audio-Visual Integration
  • Memory
  • Multisensory Processing
  • Visual Spatial Memory

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Human-Computer Interaction
  • Cognitive Neuroscience

Fingerprint

Dive into the research topics of 'Improving Visual Memory with Auditory Input'. Together they form a unique fingerprint.

Cite this