Beep, Be-, or -Ep: The impact of auditory transients on perceived bouncing/streaming

Hauke S. Meyerhoff*, Satoru Suzuki

*Corresponding author for this work

Research output: Contribution to journalArticle

1 Scopus citations

Abstract

Establishing object correspondence over time ("Which object went where?") is important for productively interacting with the surrounding environment. Here, we study auditory contributions to this process using the ambiguous bouncing/streaming display. Typically, a brief coinciding tone alters this dynamic event toward the perception of 2 disks bouncing off each other rather than streaming past each other. In 4 experiments, we tested the hypothesis that this crossmodal interaction is primarily driven by additive contributions of sensory transients rather than by the high-level processing of sound category. We orthogonally manipulated the number and semantic category of auditory transients. Specifically, different combinations of auditory transients generate qualitatively different events with distinct meanings; a single auditory transient can be a tone onset or offset, and a pair of transients can be a brief tone (onset + offset) or a brief gap (offset + onset). The proportion of seeing bouncing was larger for 2 transients than 1 transient and larger for 1 transient than no transients regardless of the sound's semantic category. A tone onset and a tone offset were equally effective (relative to no transients), and a brief tone (onset + offset) and a brief gap (offset + onset) were equivalently more effective. We identified a critical window of ±200 ms around the visual overlap; a longer tone whose offset occurred outside the window was only as effective as a single onset. These results suggest that a simple addition of auditory transients within the critical time window primarily contributes to the auditory biasing of visual bouncing percepts.

Original languageEnglish (US)
Pages (from-to)1995-2004
Number of pages10
JournalJournal of Experimental Psychology: Human Perception and Performance
Volume44
Issue number12
DOIs
StatePublished - Dec 1 2018

    Fingerprint

Keywords

  • Audio-visual interaction
  • Auditory transients
  • Bouncing/streaming illusion
  • Onset versus offset
  • SOA

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Arts and Humanities (miscellaneous)
  • Behavioral Neuroscience

Cite this