Aligning semi-improvised music audio with its lead sheet

Zhiyao Duan*, Bryan A Pardo

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Existing audio-score alignment methods assume that the audio performance is faithful to a fully-notated MIDI score. For semi-improvised music (e.g. jazz), this assumption is strongly violated. In this paper, we address the problem of aligning semi-improvised music audio with a lead sheet. Our approach does not require prior training on performances of the lead sheet to be aligned. We start by analyzing the problem and propose to represent the lead sheet as a MIDI file together with a structural information file. Then we propose a dynamic-programming-based system to align the chromagram representations of the audio performance and the MIDI score. Techniques are proposed to address the chromagram scaling, key transposition and structural change (e.g. a performer unexpectedly repeats a section) problems. We test our system on 3 jazz lead sheets. For each sheet we align a set of solo piano performances and a set of fullband commercial recordings with different instrumentation and styles. Results show that our system achieves promising results on some highly improvised music.

Original languageEnglish (US)
Title of host publicationProceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011
Pages513-518
Number of pages6
StatePublished - Dec 1 2011
Event12th International Society for Music Information Retrieval Conference, ISMIR 2011 - Miami, FL, United States
Duration: Oct 24 2011Oct 28 2011

Publication series

NameProceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011

Other

Other12th International Society for Music Information Retrieval Conference, ISMIR 2011
CountryUnited States
CityMiami, FL
Period10/24/1110/28/11

ASJC Scopus subject areas

  • Music
  • Information Systems

Fingerprint Dive into the research topics of 'Aligning semi-improvised music audio with its lead sheet'. Together they form a unique fingerprint.

  • Cite this

    Duan, Z., & Pardo, B. A. (2011). Aligning semi-improvised music audio with its lead sheet. In Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011 (pp. 513-518). (Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011).