[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Efficient and robust compressed sensing using optimized expander graphs

Published: 01 September 2009 Publication History

Abstract

Expander graphs have been recently proposed to construct efficient compressed sensing algorithms. In particular, it has been shown that any n-dimensional vector that is k-sparse can be fully recovered using O(k log n) measurements and only O(k log n) simple recovery iterations. In this paper, we improve upon this result by considering expander graphs with expansion coefficient beyond 3/4 and show that, with the same number of measurements, only O(k) recovery iterations are required, which is a significant improvement when n is large. In fact, full recovery can be accomplished by at most 2k very simple iterations. The number of iterations can be reduced arbitrarily close to k, and the recovery algorithm can be implemented very efficiently using a simple priority queue with total recovery time O(n log(n/k)). We also show that by tolerating a small penalty on the number of measurements, and not on the number of recovery iterations, one can use the efficient construction of a family of expander graphs to come up with explicit measurement matrices for this method. We compare our result with other recently developed expander-graph-based methods and argue that it compares favorably both in terms of the number of required measurements and in terms of the time complexity and the simplicity of recovery. Finally, we will show how our analysis extends to give a robust algorithm that finds the position and sign of the k significant elements of an almost k-sparse signal and then, using very simple optimization techniques, finds a k-sparse signal which is close to the best k-term approximation of the original signal.

References

[1]
E. Candés and M. Wakin, "People hearing without listening: An introduction to compressive sampling," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 21-30, 2008.
[2]
R. Baraniuk, M. Davenport, R. DeVore, and M. Wakin, "A simple proof of the restricted isometry property for random matrices," Constructive Approximation, vol. 28, no. 3, pp. 253-263, Dec. 2008.
[3]
W. Johnson and J. Lindenstrauss, "Extensions of Lipschitz mapping into a Hilbert space," Contemp. Math., vol. 26, pp. 189-206, Sep. 1984.
[4]
W. Xu and B. Hassibi, "Efficient compressive sensing with deterministic guarantees using expander graphs," in Proc. IEEE Information Theory Workshop, Lake Tahoe, CA, Sep. 2007, pp. 414-419.
[5]
W. Xu and B. Hassibi, "Further results on performance analysis for compressive sensing using expander graphs," in Conf. Rec. 41st Asilomar Conf. Signals, Systems and Computers (ACSSC 2007), Thousand Oaks, CA, Nov. 2008, pp. 621-625.
[6]
R. Berinde and P. Indyk, "Sparse Recovery Using Sparse Random Matrices," MIT, Cambridge, MA, Tech. Rep. MIT-CSAIL-TR-2008-001, Jan. 2008.
[7]
R. Berinde, A. Gilbert, P. Indyk, H. Karloff, and M. Strauss, "Combining geometry and combinatorics: A unified approach to sparse signal recovery," in Proc. Allerton Conf. Communication, Control and Computing, Monticello, IL, Sep. 2008, pp. 798-805.
[8]
P. Indyk, "Explicit constructions for compressed sensing of sparse signals," in Proc. 19th Annu. ACM-SIAM Symp. Discrete Algorithms (SODA), San Francisco, CA, Jan. 2008.
[9]
M. Sipser and D. Spielman, "Expander codes," IEEE Trans. Inf. Theory, vol. 42, no. 6, pp. 1710-1722, Nov. 1996.
[10]
P. Sarnak, "What is an expander," Notices Amer. Math. Soc., vol. 51, no. 7, Aug. 2004.
[11]
L. Bassalygo and M. Pinsker, "Complexity of an optimum nonblocking switching network without reconnections," Probl. Inf. Transm., vol. 9, no. 1, pp. 289-313, 1973.
[12]
M. Capalbo, O. Reingold, S. Vadhan, and A. Wigderson, "Randomness conductors and constant degree expansions beyond the degree 2 barrier," in Proc. 34th Annu. ACM Symp. Theory of Computing (STOC), Montreal, QC, Canada, May 2002, pp. 659-668.
[13]
M. Akcakaya and V. Tarokh, "A frame construction and a universal distortion bound for sparse representations," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2443-2450, Jun. 2008.
[14]
L. Applebaum, S. Howard, S. Searle, and R. Calderbank, "Chirp sensing codes: Deterministic compressed sensing measurements for fast recovery," Appl. Comput. Harmonic Anal., vol. 26, no. 2, pp. 283-290, Mar. 2008.
[15]
S. Howard, R. Calderbank, and S. Searle, "A fast reconstruction algorithm for deterministic compressive sensing using second order Reed-Muller codes," in Proc. Conf. Information Sciences and Systems (CISS), Princeton, NJ, Mar. 2008, pp. 11-15.
[16]
R. Calderbank, S. Howard, and S. Jafarpour, "Construction of a large class of deterministic sensing matrices that satisfy a statistical isometry property", submitted for publication.
[17]
R. Calderbank, S. Howard, and S. Jafarpour, "Deterministic sensing with groups of random variables", submitted for publication.
[18]
F. Parvaresh and B. Hassibi, "List decoding for compressed sensing", unpublished.
[19]
V. Guruswami, C. Umans, and S. Vadhan, "Unbalanced expanders and randomness extractors from Parvaresh-Vardy codes," J. ACM, vol. 56, no. 4, Jun. 2009, Article No. 20.
[20]
F. Parvaresh and A. Vardy, "Correcting errors beyond the Guruswami-Sudan radius in polynomial time," in Proc. 46th Ann. IEEE Symp. Foundations of Computer Science, Pittsburgh, PA, Oct. 2008, pp. 285-294.
[21]
S. Hoory, N. Linial, and A. Wigderson, "Expander graphs and their applications," Bull. (New Series) Amer. Math. Soc., vol. 43, pp. 439-561, 2006.
[22]
P. Indyk and M. Ruzic, "Near-optimal sparse recovery in the l1 norm," in Proc. IEEE Symp. Foundations of Computer Science (FOCS), Philadelpha, PA, Oct. 2008, pp. 199-207.
[23]
V. Guruswami, J. Lee, and A. Razborov, "Almost Euclidean subspaces of l 1 via expander codes," in Proc. 19th Annu. ACM-SIAM Symp. Discrete Algorithms (SODA), San Francisco, CA, Jan. 2008, pp. 649-658.
[24]
R. Berinde, P. Indyk, and M. Ruzic, "Practical near-optimal sparse recovery in the l1 norm," in Proc. Allerton Conf. Communication, Control and Computing, Monticello, IL, Sep. 2008, pp. 198-205.
[25]
D. Needell and J. A. Tropp, "CoSaMP: Iterative signal recovery from incomplete and inaccurate samples," Appl. Comp. Harmonic Anal., vol. 26, no. 3, pp. 301-321, May 2009.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Information Theory
IEEE Transactions on Information Theory  Volume 55, Issue 9
September 2009
458 pages

Publisher

IEEE Press

Publication History

Published: 01 September 2009
Revised: 12 March 2009
Received: 25 May 2008

Author Tags

  1. Compressive sensing
  2. compressive sensing
  3. expander graphs
  4. sparse recovery
  5. sparse sensing matrices
  6. unique neighborhood property

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 13 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A General Compressive Sensing Construct Using Density EvolutionIEEE Transactions on Signal Processing10.1109/TSP.2022.321670872(203-218)Online publication date: 1-Jan-2024
  • (2024)ASB-CSExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121378236:COnline publication date: 1-Feb-2024
  • (2023)Efficient Compressed Sensing Reconstruction Algorithm for Nonnegative Vectors in Wireless Data TransmissionJournal of Electrical and Computer Engineering10.1155/2023/14347362023Online publication date: 1-Jan-2023
  • (2021)Adaptive Non-Uniform Compressive Sensing Using SOT-MRAM Multi-Bit Precision Crossbar ArraysIEEE Transactions on Nanotechnology10.1109/TNANO.2021.306035820(224-228)Online publication date: 1-Jan-2021
  • (2021)A General Framework for the Design of Compressive Sensing using Density Evolution2021 IEEE Information Theory Workshop (ITW)10.1109/ITW48936.2021.9611415(1-6)Online publication date: 17-Oct-2021
  • (2021)Discrete optimization methods for group model selection in compressed sensingMathematical Programming: Series A and B10.1007/s10107-020-01529-7190:1-2(171-220)Online publication date: 1-Nov-2021
  • (2019)Active Two Phase Collaborative Representation ClassifierACM Transactions on Knowledge Discovery from Data10.1145/332691913:4(1-10)Online publication date: 2-Jul-2019
  • (2019)Simple Codes and Sparse Recovery with Fast Decoding2019 IEEE International Symposium on Information Theory (ISIT)10.1109/ISIT.2019.8849702(156-160)Online publication date: 7-Jul-2019
  • (2019)Active Two Phase Collaborative Representation Classifier for Image CategorizationImage Analysis and Processing – ICIAP 201910.1007/978-3-030-30642-7_16(175-184)Online publication date: 9-Sep-2019
  • (2018)Optimal Nested Test Plan for Combinatorial Quantitative Group TestingIEEE Transactions on Signal Processing10.1109/TSP.2017.278005366:4(992-1006)Online publication date: 1-Feb-2018
  • Show More Cited By

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media