The tree-structured complex wavelet Bayesian compressing sensing (TSCW-BCS) is introduced. The Bessel K form (BKF) probability density function; which has heavy tails out of the origin, is used as the prior. The inter-scale statistical relation between complex wavelet coefficients is modelled by the hidden Markov tree. The Markov chain Monte Carlo inference is obtained based on the BKF and then the posterior parameters of wavelet coefficients are derived. Simulation results show that the proposed TSCW-BCS outperforms many well-known CS methods.

References

1. 1)
  - 30. Tropp, J.A., Gilbert, A.C.: ‘Signal recovery from random measurements via orthogonal matching pursuit’, IEEE Trans. Inf. Theory, 2007, 53, (12), pp. 4655–4666 (doi: 10.1109/TIT.2007.909108).
2. 2)
  - 21. Mallat, S.: ‘A wavelet tour of signal processing’ (Academic, New York, 1998, 2nd edn.).
3. 3)
  - 3. Candes, E., Romberg, J.: ‘Sparsity and incoherence in compressive sampling’, Inverse Probl., 2007, 23, pp. 969–985 (doi: 10.1088/0266-5611/23/3/008).
4. 4)
  - 19. Shi, J., Zhang, N., Liu, X.: ‘A novel fractional wavelet transform and its applications’, Sci. China Inf. Sci., 2012, 55, (6), pp. 1270–1279 (doi: 10.1007/s11432-011-4320-x).
5. 5)
  - 31. Berg, E.V.D., Friedlander, M.P.: ‘Probing the pareto frontier for basis pursuit solution’, SIAM J. Sci. Comput., 2008, 31, (2), pp. 890–912 (doi: 10.1137/080714488).
6. 6)
  - 28. Robert, C.P., Cassella, G.: ‘Monte carlo statistical methods’ (Springer, New York, 2004, 2nd edn.).
7. 7)
  - 6. Duarte, M.F., Wakin, M.B., Baraniuk, R.G.: ‘Wavelet-domain compressive signal reconstruction using a hidden Markov tree model’. Proc. Int. Conf. on Acoustic, Speech Signal Process. (ICASSP), 2008, pp. 5137–5140.
8. 8)
  - 17. La, C., Do, M.: ‘Signal reconstruction using sparse tree representations’. Proc. SPIE Wavelets XI, 2005.
9. 9)
  - 24. Srivastava, A., Liu, X., Grenander, U.: ‘Universal analytical forms for modeling image probabilities’, IEEE Trans. Pattern Anal. Mach. Intell., 2002, 24, (9), pp. 1200–1214 (doi: 10.1109/TPAMI.2002.1033212).
10. 10)
  - 15. Hormati, A., Vetterli, M.: ‘Annihilating filter-based decoding in the compressed sensing framework’. Proc. SPIE Wavelets XII, 2007.
11. 11)
  - 12. Babacan, S.D., Molina, R., Katsaggelos, A.K.: ‘Bayesian compressive sensing using laplace priors’, , IEEE Trans. Image Process., 2010, 19, (1), pp. 53–63 (doi: 10.1109/TIP.2009.2032894).
12. 12)
  - 32. Berg, E.V.D., Friedlander, M.P.: ‘Sparse optimization with least-squares constraints’, SIAM J. Sci. Comput., 2011, 21, (4), pp. 1201–1229.
13. 13)
  - 33. Mohimani, G.H., Babaie-zadeh, M., Jutten, Ch.: ‘A fast approach for overcomplete sparse decomposition based on smoothed ℓ0 norm’, IEEE Trans. Signal Process, 2009, 57, (1), pp. 289–301 (doi: 10.1109/TSP.2008.2007606).
14. 14)
  - 13. Baraniuk, R.G., Cevher, V., Duarte, M.F., Hegde, C.: ‘Model-based compressive sensing’, IEEE Trans. Inf. Theory, 2010, 56, (4), pp. 1982–2001 (doi: 10.1109/TIT.2010.2040894).
15. 15)
  - 11. Ji, S., Xue, Y., Carin, L.: ‘Bayesian compressive sensing’, IEEE Trans. Signal Process., 2008, 56, pp. 2346–2356 (doi: 10.1109/TSP.2007.914345).
16. 16)
  - 29. Available at http://research.microsoft.com/en-us/projects/objectclassrecog-nition/.
17. 17)
  - 23. Fadaili, M.J., Boubchir, L.: ‘Analytical form for a Bayesian wavelet estimator of images using the Bessel K form densities’, IEEE Trans. Image Process., 2005, 14, (2), pp. 231–240 (doi: 10.1109/TIP.2004.840704).
18. 18)
  - 10. Needell, D., Tropp, J.A.: ‘CoSaMAP: Iterative signal recovery from incomplete and inaccurate samples’, Appl. Comput. Harmon. Anal., 2009, 26, (3), pp. 301–321 (doi: 10.1016/j.acha.2008.07.002).
19. 19)
  - 35. Ji, S., Krishnapuram, B., Carin, L.: ‘Variational Bayes for continuous hidden Markov models and its application to active learning’, IEEE Trans. Pattern Anal. Mach. Intell., 2006, 28, pp. 522–532 (doi: 10.1109/TPAMI.2006.85).
20. 20)
  - 25. West, M.: ‘On scale mixtures of normal distributions’, Biometrika, 1987, 74, pp. 646–648 (doi: 10.1093/biomet/74.3.646).
21. 21)
  - 32. Selesnick, W., Baraniuk, R.G., Kingsbury, N.G.: ‘The dual-tree complex wavelet transform’, IEEE Signal Process. Mag., 2005, 05, (22), pp. 123–151 (doi: 10.1109/MSP.2005.1550194).
22. 22)
  - 14. Blumensath, T., Davies, M.E.: ‘Sampling theorems for signals from the union of linear subspaces’, IEEE Trans. Inf. Theory, 2009, 55, pp. 1872–1882 (doi: 10.1109/TIT.2009.2013003).
23. 23)
  - 4. Candes, E., Romberg, J., Tao, T.: ‘Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information’, IEEE Trans. Inf. Theory, 2006, 52, pp. 489–509 (doi: 10.1109/TIT.2005.862083).
24. 24)
  - 36. Bishop, C., Tipping, M.: ‘Variational relevance vector machines’. Proc. 16th Annual Conf. Uncertainty in Artificial Intelligence (UAI), San Francisco, CA, 2000, pp. 46–53.
25. 25)
  - 34. Beal, M.J.: ‘Variational Algorithms for approximate bayesian inference’. Ph.D., Gatsby Computational Neuroscience Unit, University College London, London, U.K., 2003.
26. 26)
  - 22. Crouse, M.S., Nowak, R.D., Baraniuk, R.G.: ‘Wavelet-based statistical signal processing using hidden Markov model’, IEEE Trans. Signal Process., 1998, 46, pp. 886–902 (doi: 10.1109/78.668544).
27. 27)
  - 9. Efron, B., Hastie, T., Johnstone, I., Tibshirani, R.: ‘Least angle regression’, Ann. Statist. (With Discussion), 2004, 32, pp. 407–499 (doi: 10.1214/009053604000000067).
28. 28)
  - 30. Kim, S.-J., Koh, K., Lustig, M., Boyd, S., Gorinevsky, D.: ‘An interior point method for large-scale l1-regularized least squares’, IEEE J. Sel. Topics Signal Process., 2007, 1, (4), pp. 606–617 (doi: 10.1109/JSTSP.2007.910971).
29. 29)
  - 13. Donoho, D.L.: ‘Compressed sensing’, IEEE Trans. Inf. Theory, 2006, 52, pp. 1289–1306 (doi: 10.1109/TIT.2006.871582).
30. 30)
  - 17. Candès, E.J., Wakin, M.B.: ‘An introduction to compressed sampling’, IEEE Signal Process. Mag., 2008, 25, (2), pp. 21–30 (doi: 10.1109/MSP.2007.914731).
31. 31)
  - 26. Grffin, J.E., Brown, J.Ph.: ‘Inference with normal-gamma prior distributions in regression problem’, Bayesian Anal., 2010, 5, (1), pp. 171–188 (doi: 10.1214/10-BA507).
32. 32)
  - 16. Elder, Y.C., Mishali, M.: ‘Robust recovery of signals from a structured union of subspaces’, IEEE Trans. Inf. Theory, 2009, 55, pp. 5302–5316 (doi: 10.1109/TIT.2009.2030471).
33. 33)
  - 20. Sadeghigol, Z., Kahaei, M.H., Haddadi, F.: ‘Tree-structured complex wavelet-based Bayesian compressive sensing method’, IET Electron. Lett., 2013, 49, pp. 1489–1491 (doi: 10.1049/el.2013.2300).
34. 34)
  - 8. Donoho, D.L., Tsaig, Y., Drori, I., Starck, L.: ‘Sparse solution of underdetermined linear equations by stagewise orthogonal matching pursuit’. Stanford Statistics Technical Report, 2006–2, April2006.
35. 35)
  - 37. Chen, S.S., Donoho, D.L., Saunders, M.A.: ‘Atomic decomposition by basis pursuit’, SIAMJ. Sci. Comput., 1999, 20, pp. 33–61 (doi: 10.1137/S1064827596304010).
36. 36)
  - 27. Grenander, U., Srivastava, A.: ‘Probability models for clutter in natural images’, IEEE Trans. Pattern Anal. Mach. Intell., 2001, 23, (4), pp. 424–429 (doi: 10.1109/34.917579).
37. 37)
  - 1. He, L., Carin, L.: ‘Exploiting structure in wavelet-based Bayesian compressive sensing’, IEEE Trans. Signal Process., 2009, 57, (9), pp. 3488–3497 (doi: 10.1109/TSP.2009.2022003).

Bayesian compressive sensing using tree-structured complex wavelet transform

References

Related content