Online Score-Informed Source Separation with Adaptive Instrument Models

Francisco J. Rodriguez-Serrano*, Zhiyao Duan, Pedro Vera-Candeas, Bryan A Pardo, Julio J. Carabias-Orti

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

12 Scopus citations

Abstract

In this paper, an online score-informed source separation system is proposed under the Non-negative Matrix Factorization (NMF) framework, using parametric instrument models. Each instrument is modelled using a multi-excitation source-filter model, which provides the flexibility to model different instruments. The instrument models are initially learned on training excerpts of the same kinds of instruments, and are then adapted, during the separation, to the specific instruments used in the audio being separated. The model adaptation method needs to access the musical score content for each instrument, which is provided by an online audio-score alignment method. Source separation is improved by adapting the instrument models using score alignment. Experiments are performed to evaluate the proposed system and its individual components. Results show that it outperforms a state-of-the-art comparison method.

Original languageEnglish (US)
Pages (from-to)83-96
Number of pages14
JournalJournal of New Music Research
Volume44
Issue number2
DOIs
StatePublished - Apr 3 2015

Keywords

  • NMF
  • adaptive
  • instrument-models
  • online
  • score alignment
  • score-informed
  • source separation

ASJC Scopus subject areas

  • Visual Arts and Performing Arts
  • Music

Fingerprint Dive into the research topics of 'Online Score-Informed Source Separation with Adaptive Instrument Models'. Together they form a unique fingerprint.

Cite this