Music/Voice separation using the 2D fourier transform

Prem Seetharaman; Fatemeh Pishdadian; Bryan A Pardo

doi:10.1109/WASPAA.2017.8169990

Music/Voice separation using the 2D fourier transform

Prem Seetharaman, Fatemeh Pishdadian, Bryan A Pardo

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

14 Scopus citations

Abstract

Audio source separation is the act of isolating sound sources in an audio scene. One application of source separation is singing voice extraction. In this work, we present a novel approach for music/voice separation that uses the 2D Fourier Transform (2DFT). Our approach leverages how periodic patterns manifest in the 2D Fourier Transform and is connected to research in biological auditory systems as well as image processing. We find that our system is very simple to describe and implement and competitive with existing unsupervised source separation approaches that leverage similar assumptions.

Original language	English (US)
Title of host publication	2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	36-40
Number of pages	5
ISBN (Electronic)	9781538616321
DOIs	https://doi.org/10.1109/WASPAA.2017.8169990
State	Published - Dec 7 2017
Event	2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017 - New Paltz, United States Duration: Oct 15 2017 → Oct 18 2017

Publication series

Name	IEEE Workshop on Applications of Signal Processing to Audio and Acoustics
Volume	2017-October

Other

Other	2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017
Country/Territory	United States
City	New Paltz
Period	10/15/17 → 10/18/17

Funding

This work was supported by NSF Grant 1420971. ∗This work was supported by NSF Grant 1420971.

Keywords

2DFT
Audio source separation
auditory scene analysis
automatic karaoke
foreground/background separation
image processing
singing voice extraction

ASJC Scopus subject areas

Electrical and Electronic Engineering
Computer Science Applications

Access to Document

10.1109/WASPAA.2017.8169990

Cite this

Seetharaman, P., Pishdadian, F., & Pardo, B. A. (2017). Music/Voice separation using the 2D fourier transform. In 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017 (pp. 36-40). (IEEE Workshop on Applications of Signal Processing to Audio and Acoustics; Vol. 2017-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WASPAA.2017.8169990

@inproceedings{683a60b45b1d4d6eb94ae49430968604,

title = "Music/Voice separation using the 2D fourier transform",

abstract = "Audio source separation is the act of isolating sound sources in an audio scene. One application of source separation is singing voice extraction. In this work, we present a novel approach for music/voice separation that uses the 2D Fourier Transform (2DFT). Our approach leverages how periodic patterns manifest in the 2D Fourier Transform and is connected to research in biological auditory systems as well as image processing. We find that our system is very simple to describe and implement and competitive with existing unsupervised source separation approaches that leverage similar assumptions.",

keywords = "2DFT, Audio source separation, auditory scene analysis, automatic karaoke, foreground/background separation, image processing, singing voice extraction",

author = "Prem Seetharaman and Fatemeh Pishdadian and Pardo, \{Bryan A\}",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017 ; Conference date: 15-10-2017 Through 18-10-2017",

year = "2017",

month = dec,

day = "7",

doi = "10.1109/WASPAA.2017.8169990",

language = "English (US)",

series = "IEEE Workshop on Applications of Signal Processing to Audio and Acoustics",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "36--40",

booktitle = "2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017",

address = "United States",

}

Seetharaman, P, Pishdadian, F & Pardo, BA 2017, Music/Voice separation using the 2D fourier transform. in 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, vol. 2017-October, Institute of Electrical and Electronics Engineers Inc., pp. 36-40, 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017, New Paltz, United States, 10/15/17. https://doi.org/10.1109/WASPAA.2017.8169990

Music/Voice separation using the 2D fourier transform. / Seetharaman, Prem; Pishdadian, Fatemeh; Pardo, Bryan A.
2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 36-40 (IEEE Workshop on Applications of Signal Processing to Audio and Acoustics; Vol. 2017-October).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Music/Voice separation using the 2D fourier transform

AU - Seetharaman, Prem

AU - Pishdadian, Fatemeh

AU - Pardo, Bryan A

PY - 2017/12/7

Y1 - 2017/12/7

N2 - Audio source separation is the act of isolating sound sources in an audio scene. One application of source separation is singing voice extraction. In this work, we present a novel approach for music/voice separation that uses the 2D Fourier Transform (2DFT). Our approach leverages how periodic patterns manifest in the 2D Fourier Transform and is connected to research in biological auditory systems as well as image processing. We find that our system is very simple to describe and implement and competitive with existing unsupervised source separation approaches that leverage similar assumptions.

AB - Audio source separation is the act of isolating sound sources in an audio scene. One application of source separation is singing voice extraction. In this work, we present a novel approach for music/voice separation that uses the 2D Fourier Transform (2DFT). Our approach leverages how periodic patterns manifest in the 2D Fourier Transform and is connected to research in biological auditory systems as well as image processing. We find that our system is very simple to describe and implement and competitive with existing unsupervised source separation approaches that leverage similar assumptions.

KW - 2DFT

KW - Audio source separation

KW - auditory scene analysis

KW - automatic karaoke

KW - foreground/background separation

KW - image processing

KW - singing voice extraction

UR - http://www.scopus.com/inward/record.url?scp=85042363115&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85042363115&partnerID=8YFLogxK

U2 - 10.1109/WASPAA.2017.8169990

DO - 10.1109/WASPAA.2017.8169990

M3 - Conference contribution

AN - SCOPUS:85042363115

T3 - IEEE Workshop on Applications of Signal Processing to Audio and Acoustics

SP - 36

EP - 40

BT - 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017

Y2 - 15 October 2017 through 18 October 2017

ER -

Seetharaman P, Pishdadian F, Pardo BA. Music/Voice separation using the 2D fourier transform. In 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 36-40. (IEEE Workshop on Applications of Signal Processing to Audio and Acoustics). doi: 10.1109/WASPAA.2017.8169990

Music/Voice separation using the 2D fourier transform

Abstract

Publication series

Other

Funding

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this