Abstract
In this paper, we propose algorithms for computing Walsh-Hadamard transform with arbitrary K-sparse support. When K is sublinear in the dimension N of the time-domain signal, the algorithms achieve vanishing error probability as K increases without bound and involve sublinear computational complexity. Specifically, under the noiseless setting, an algorithm based on random hashing and successive cancellation is proposed, where O (K log K log N over K) operations on O(K log N over K) samples of the signal suffice. Under the noisy setting, a fast algorithm using the same framework is also proposed, which needs O (K log3 K log N over K) operations and O (K log2 K log N over K) samples. The latter algorithm reduces the complexity from superlinear in existing work to sublinear. The enabling idea is to relate the random hashing design to coding over a binary symmetric channel or a binary-input additive white Gaussian noise channel, whose quality depends on the noise level of the observations. Such inherent connection allows us to leverage well-established capacity-approaching codes to obtain the transform-domain signal with sublinear complexity.
Original language | English (US) |
---|---|
Title of host publication | Proceedings - 2015 IEEE International Symposium on Information Theory, ISIT 2015 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 2573-2577 |
Number of pages | 5 |
ISBN (Electronic) | 9781467377041 |
DOIs | |
State | Published - Sep 28 2015 |
Event | IEEE International Symposium on Information Theory, ISIT 2015 - Hong Kong, Hong Kong Duration: Jun 14 2015 → Jun 19 2015 |
Publication series
Name | IEEE International Symposium on Information Theory - Proceedings |
---|---|
Volume | 2015-June |
ISSN (Print) | 2157-8095 |
Other
Other | IEEE International Symposium on Information Theory, ISIT 2015 |
---|---|
Country/Territory | Hong Kong |
City | Hong Kong |
Period | 6/14/15 → 6/19/15 |
Funding
This work was supported in part by the National Science Foundation under Grant Nos. ECCS-1231828 and CCF-1423040.
ASJC Scopus subject areas
- Theoretical Computer Science
- Information Systems
- Modeling and Simulation
- Applied Mathematics