Audio Source Separation in a Musical Context

Bryan Pardo, Zafar Rafii, Zhiyao Duan

Research output: Chapter in Book/Report/Conference proceedingChapter

3 Scopus citations

Abstract

When musical instruments are recorded in isolation, modern editing and mixing tools allow correction of small errors without requiring a group to re-record an entire passage. Isolated recording also allows rebalancing of levels between musicians without re-recording and application of audio effects to individual instruments. Many of these techniques require (nearly) isolated instrumental recordings to work. Unfortunately, there are many recording situations (e. g., a stereo recording of a 10-piece ensemble) where there are many more instruments than there are microphones, making many editing or remixing tasks difficult or impossible. Audio source separation is the process of extracting individual sound sources (e. g., a single flute) from a mixture of sounds (e. g., a recording of a concert band using a single microphone). Effective source separation would allow application of editing and remixing techniques to existing recordings with multiple instruments on a single track. In this chapter we will focus on a pair of source separation approaches designed to work with music audio. The first seeks the repeated elements in the musical scene and separates the repeating from the nonrepeating. The second looks for melodic elements, pitch tracking and streaming the audio into separate elements. Finally, we consider informing source separation with information from the musical score.

Original languageEnglish (US)
Title of host publicationHandbook of Systematic Musicology
PublisherSpringer
Pages285-298
Number of pages14
ISBN (Electronic)978-3662550045
ISBN (Print)978-3662550021
DOIs
StatePublished - Jan 1 2018

Publication series

NameSpringer Handbooks
ISSN (Print)2522-8692
ISSN (Electronic)2522-8706

ASJC Scopus subject areas

  • General

Fingerprint

Dive into the research topics of 'Audio Source Separation in a Musical Context'. Together they form a unique fingerprint.

Cite this