Towards Inclusive Streaming: Building Multimodal Music Experiences for the Deaf and Hard of Hearing

Thomas Barlow McHugh, Abir Saha, David Bar-El, Marcelo Worsley, Anne Marie Piper

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As online streaming becomes a primary method for music consumption, the various modalities that many people with hearing loss rely on for their enjoyment need to be supported. While visual or tactile representations can be used to experience music in a live event or from a recording, DRM anti-piracy encryption restricts access to audio data needed to create these multimodal experiences for music streaming. We introduce BufferBeats, a toolkit for building multimodal music streaming experiences. To explore the flexibility of the toolkit and to exhibit its potential use cases, we introduce and reflect upon building a collection of technical demonstrations that bring previous and new multimodal music experiences to streaming. Grounding our work in critical theories on design, making, and disability, as well as experiences from a small group of community partners, we argue that support for multimodal music streaming experiences will not only be more inclusive to the deaf and hard of hearing, but it will also empower researchers and hobbyist makers to use streaming as a platform to build creative new representations of music.

Original languageEnglish (US)
Title of host publicationExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450380959
DOIs
StatePublished - May 8 2021
Event2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI EA 2021 - Virtual, Online, Japan
Duration: May 8 2021May 13 2021

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI EA 2021
Country/TerritoryJapan
CityVirtual, Online
Period5/8/215/13/21

Keywords

  • accessibility
  • deaf and hard of hearing
  • music streaming
  • toolkit

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint

Dive into the research topics of 'Towards Inclusive Streaming: Building Multimodal Music Experiences for the Deaf and Hard of Hearing'. Together they form a unique fingerprint.

Cite this