Unified framework for multi-scale decomposition and applications

Xu Guanlei; Wang Xiaotong; Xu Xiaogang; Zhou Lijia; Liu Yonglu

Unified framework for multi-scale decomposition and applications

View Fulltext

Author(s): Xu Guanlei¹ ; Wang Xiaotong² ; Xu Xiaogang² ; Zhou Lijia¹ ; Liu Yonglu¹
- Affiliations: 1: Ocean Department of Dalian Naval Academy, Dalian, 116018 , China ;
  2: Navigation Department of Dalian Naval Academy, Dalian, 116018 , China
Source: Volume 2017, Issue 11, November 2017, p. 577 – 588
DOI: 10.1049/joe.2017.0212 , Online ISSN 2051-3305

« Previous Article
Table of contents
Next Article »

This is an open access article published by the IET under the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0/)

Received 31/05/2017, Accepted 24/09/2017, Published 04/10/2017

Since real-world digital images differ in thousands ways, an adaptive multi-scale decomposition scheme adapting to images is increasingly urgently required for image analysis and applications. In this paper, a unified framework for multi-scale decomposition is developed. Instead of full using the extrema in bi-dimensional empirical mode decomposition (BEMD), edges are fully taken into account because edges play an important role in images. First, effective edges are extracted using spatial scale, intensity difference and other parameters through their coarse-to-fine edge detection approach. Given Gaussian noise series with the same variance are added to these edges repeatedly to produce extrema. Then the produced extrema on edges are employed to interpolate to calculate the mean and further the different detail components from multiple noised signals on average. Through manipulating the parameters of this framework, multiple decomposition patterns: the alternative edge-preserving multi-scale decomposition and non-edge-preserving multi-scale decomposition along with in-between transitional multi-scale decomposition can be obtained, respectively. It shows that the existing multi-scale decomposition methods of BEMD can be taken as special cases of this decomposition framework. Finally, comparisons with other methods are performed and numerous applications of this decomposition approach are explored to show its efficiency.

References

1. 1)
  - 40. Elder, J.H., Zucker, S.W.: ‘Local scale control for edge detection and blur estimation’, IEEE Trans. Pattern Anal. Mach. Intell., 1998, 20, (7), pp. 699–716 (doi: 10.1109/34.689301).
2. 2)
  - 28. van Beek, P.J.L.: ‘Edge-based image representation and coding’, PhD dissertation, Delft University Technology, Delft, the Netherlands, 1995.
3. 3)
  - 18. Farbman, F., Lischinski, S.: ‘Edge-preserving decompositions for multi-Scale tone and detail manipulation’, ACM Trans. on Graphics, 2008, 27, (3), pp. 1–10 (doi: 10.1145/1360612.1360666).
4. 4)
  - 37. Wen, C., Gao, G., Chen, Z.: ‘Multiresolution model for image denoising based on total least squares’. Fourth Int. Conf. Fuzzy Systems and Knowledge Discovery, 2007, vol. 3, no. 24–27, pp. 622–626.
5. 5)
  - 20. Xu, G.L., Wang, X.T., Xu, X.G.: ‘Neighborhood limited empirical mode decomposition and application in image processing’. Fourth Int. Conf. Image and Graphics, Chengdu of China, 2007, pp. 149–154.
6. 6)
  - 44. http://www.mathworks.com/products/matlab/.
7. 7)
  - 1. Canny, J.: ‘A computational approach to edge detection’, IEEE Trans. Pattern Anal. Mach. Intell., 1986, (6), pp. 679–698 (doi: 10.1109/TPAMI.1986.4767851).
8. 8)
  - 8. Kopsinis, Y., McLaughlin, S.: ‘Investigation and performance enhancement of the empirical mode decomposition method based on a heuristic search optimization approach’, IEEE Trans. Signal Process., 2008, 56, (1), pp. 1–13 (doi: 10.1109/TSP.2007.901155).
9. 9)
  - 47. Marr, D., Hildreth, E.: ‘Theory of edge detection’, Proc. R. Soc. Lond. B, 1980, 207, pp. 187–217 (doi: 10.1098/rspb.1980.0020).
10. 10)
  - 48. Sarkar, S., Boyer, K.L.: ‘On optimal infinite impulse response edge detection filters’, IEEE Trans. Pattern Anal. Mach. Intell., 1991, 13, pp. 1154–1171 (doi: 10.1109/34.103275).
11. 11)
  - 41. Elder, J.H., Goldberg, R.M.: ‘Image editing in contour domain’, IEEE Trans. Pattern Anal. Mach. Intell., 20011, 23, (3), pp. 291–296 (doi: 10.1109/34.910881).
12. 12)
  - 42. Chen, J., Paris, S., Durand, F.: ‘Real-time edge-aware image processing with the bilateral grid’. ACM Transactions on Graphics, Proc. ACM SIGGRAPH 2007 Article No. 103, vol. 26, no. 3.
13. 13)
  - 21. Xu, G.L., Wang, X.T., Xu, X.G.: ‘Improved bi-dimensional EMD and hilbert spectrum for the analysis of textures’, Pattern Recognit., 2009, 42, (5), pp. 718–734 (doi: 10.1016/j.patcog.2008.09.017).
14. 14)
  - 46. Shanmugam, K.S., Dickey, F.M., Green, J.A.: ‘An optimal frequency domain filter for edge detection in digital pictures’, IEEE Trans. Pattern Anal. Mach. Intell., 1979, 1, pp. 37–49 (doi: 10.1109/TPAMI.1979.4766874).
15. 15)
  - 14. Xiong, C.Z., Xu, J.Y., Zou, J.C., et al: ‘Texture classification based on EMD and FFT’, J. Zhejiang Univ. Sci. (A), 2006, 7, (9), pp. 1516–1521 (doi: 10.1631/jzus.2006.A1516).
16. 16)
  - 4. Flandrin, P., Gonçalvès, P., Rilling, G.: ‘EMD equivalent filter banks, from interpretation to applications’, in Huang, N.E., Shen, S.S.P., (Ed.): ‘Hilbert-Huang transform: introduction and applications’, (World Scientific, Singapore, 360pp. 2005), pp. 67–87.
17. 17)
  - 16. Liu, Z.X., Wang, H.J., Peng, S.L.: ‘Texture segmentation using directional empirical mode decomposition’. Proc. 17th Int. Conf. Pattern Recognition, 2004, pp. 279–282.
18. 18)
  - 10. Han, C., Wang, G.H., Fan, C.D.: ‘A novel method to reduce speckle in SAR images’, Int. J. Remote Sens., 2002, 23, (23), pp. 5095–5101 (doi: 10.1080/01431160210153110).
19. 19)
  - 10. Xu, G.L., Wang, X.T., Xu, X.G.: ‘Improved bi-dimensional empirical mode decomposition based on 2D-assisted signals: analysis and application’, IET Image Process., 2011, 5, pp. 205–221 (doi: 10.1049/iet-ipr.2009.0158).
20. 20)
  - 32. Yi, L., Sharan, L., Adelson, E.H.: ‘Compressing and companding high dynamic range images with subband architectures’, ACM Trans. Graph., 2005, 24, (3), pp. 836–844 (doi: 10.1145/1073204.1073271).
21. 21)
  - 5. Wu, Z., Huang, N.E.: ‘Ensemble empirical mode decomposition: a noise assisted data analysis method’, COLA Technical Report, 2005. Available at ftp://grads.iges.org/pub/ctr/ctr_193.pdf.
22. 22)
  - 33. Velde, K.V.: ‘Multi-scale color image enhancement’. Proc. Int. Conf. Image Processing, 1999, vol. 3, pp. 584–587.
23. 23)
  - 38. Tomasi, C., Manduchi, R.: ‘Bilateral filtering for gray and color images’. Proc. ICCV ‘98, IEEE Computer Society, 1998, pp. 839–846.
24. 24)
  - 11. Yue, H.Y., Guo, H.D., Han, C.M., et al: ‘A SAR interferogram filter based on the empirical mode decomposition method’, Geosci. Remote Sens. Symp., 2001, 5, pp. 2061–2063.
25. 25)
  - 35. Black, M.J., Sapiro, G., Marimont, D.H., et al: ‘Robust anisotropic diffusion’, IEEE Trans. Image Process., 1998, 7, (3), pp. 421–432 (doi: 10.1109/83.661192).
26. 26)
  - 7. Rilling, G., Flandrin, P.: ‘One or two frequencies? The empirical mode decomposition answers’, IEEE Trans. Signal Process., 2008, 56, (1), pp. 85–95 (doi: 10.1109/TSP.2007.906771).
27. 27)
  - 24. Flandrin, P., Rilling, G., Goncalves, P.: ‘Empirical mode decomposition as a filter bank’, IEEE Signal Process. Lett., 2004, 11, (2), pp. 112–114 (doi: 10.1109/LSP.2003.821662).
28. 28)
  - 18. Huang, N.E., Shen, Z., Long, S.R.: ‘A new view of nonlinear water waves: the Hilbert spectrum 1’, Annu. Rev. Fluid Mech., 1999, 31, pp. 417–457 (doi: 10.1146/annurev.fluid.31.1.417).
29. 29)
  - 25. Wietzke, L., Sommer, G., Fleischmann, O.: ‘The geometry of 2D image signals’. ICIP, 2009, pp. 1690–1697.
30. 30)
  - 8. Fattal, R., Lischinski, D., Werman, M.: ‘Gradient domain high dynamic range compression’, ACM Trans. Graphics, 2002, 21, (3), pp. 249–256 (doi: 10.1145/566654.566573).
31. 31)
  - 36. Cai, Z., Naik, P.A., Tsai, C.-L.: ‘Denoised least squares estimators: an application to estimation advertising effectiveness’, Stat. Sin., 2000, 10, pp. 1231–1241.
32. 32)
  - 19. Xu, G.L., Wang, X.T., Xu, X.G., et al: ‘Multi-band image fusion algorithm based on neighborhood limited empirical mode decomposition’, J. Infrared Millim. Waves, 2006, 25, (3), pp. 225–228.
33. 33)
  - 17. Huang, N., Shen, Z., Long, S., et al: ‘The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis’, Proc. R. Soc. Lond. A, 1971, 454, pp. 903–995 (doi: 10.1098/rspa.1998.0193).
34. 34)
  - 9. Xu, G.L., Wang, X.T., Xu, X.G.: ‘The decomposition condition and the principle for the direct decomposition from multi-component to mono-component using EMD’, Progr. Nat. Sci., 2006, 16, (10), pp. 1356–1360.
35. 35)
  - 2. Wu, Z., Huang, N.E.: ‘A study of the characteristics of white noise using the empirical mode decomposition method’, Proc. R. Soc. Lond. A, 2004, 460, pp. 1597–1611 (doi: 10.1098/rspa.2003.1221).
36. 36)
  - 50. Guanlei, X., Xiaotong, W., Xiaogang, X., et al: ‘Entropic inequalities on sparse representation’, IET Signal Process., 2016, 10, (4), pp. 413–421 (doi: 10.1049/iet-spr.2014.0072).
37. 37)
  - 12. Nunes, J.C., Niang, O., Bouaoune, Y., et al: ‘Texture analysis based on the bidimensional empirical mode decomposition with gray-level co-occurrence models’, IEEE Mach. Vis. Appl., 2003, 2, pp. 633–635.
38. 38)
  - 29. Orzan, A., Bousseau, A., Winnemoller, H., et al: ‘Diffusion curves: a vector representation for smooth-shaded images’. ACM Transactions on Graphics (SIGGRAPH2008), vol. 27, Article 92.
39. 39)
  - 15. Nunes, J.C., Guyot, S., Delechelle, E.: ‘Texture analysis based on local analysis of the bidimensional empirical mode decomposition’, Mach. Vis. Appl., 2005, 16, pp. 177–188 (doi: 10.1007/s00138-004-0170-5).
40. 40)
  - 39. Ben, W.: ‘Fast median and bilateral filtering’, ACM Trans. Graph., 2006, 25, (3), pp. 519–526 (doi: 10.1145/1141911.1141918).
41. 41)
  - 17. Liu, Z.X., Peng, S.L.: ‘The directional empirical mode decomposition and application in texture segmentation’, Chin. Sci. (E), 2005, 35, (2), pp. 113–123.
42. 42)
  - 27. Wang, S.J., Kuo, L.C., Jong, H.H., et al: ‘Representing images using points on image surfaces’, IEEE Trans. Image Process., 2005, 14, (8), pp. 1043–1056 (doi: 10.1109/TIP.2005.851693).
43. 43)
  - 5. Barash, D.: ‘A fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation’, Trans. Pattern Anal. Mach. Intell., 2002, 24, (6), pp. 844–847 (doi: 10.1109/TPAMI.2002.1008390).
44. 44)
  - 4. Perona, P., Malik, J.: ‘Scale-space and edge detection using anisotropic diffusion’, IEEE Trans. Pattern Anal. Mach. Intell., 1990, 12, (7), pp. 629–639 (doi: 10.1109/34.56205).
45. 45)
  - 23. Wu, Z.H., Huang, N.E., Chen, X.Y.: ‘The multi-dimensional ensemble empirical mode decomposition method’, Adv. Adapt. Data Anal., 2009, 1, (3), pp. 339–372 (doi: 10.1142/S1793536909000187).
46. 46)
  - 18. Xu, G.L., Wang, X.T., Xu, X.G., et al: ‘Image enhancement algorithm based on neighborhood limited empirical mode decomposition’, Acta Electron. Sin., 2006, 34, (3), pp. 99–103.
47. 47)
  - 13. Yang, Z.H., Qi, D.X., Yang, L.H.: ‘Signal period analysis based on hilbert-Huang transform and its application to texture analysis’. IEEE, Proc. Third Int. Conf. Image and Graphics, 2004, pp. 430–433.
48. 48)
  - 26. Gonzalez, C.R., Richard Woods, E.: ‘Digital image processing’ (Pearson Education, 2003, 2nd edn.).
49. 49)
  - 24. Bulow, T., Sommer, G.: ‘Hypercomplex signals-a novel extension of the analytic signal to the multidimensional case’, IEEE Trans. Signal Process., 2001, 49, (11), pp. 2844–2852 (doi: 10.1109/78.960432).
50. 50)
  - 49. Guanlei, S., Xiaotong, W., Xiaogang, X.: ‘On analysis of bi-dimensional component decomposition via BEMD’, Pattern Recognit., 2012, 45, (4), pp. 1617–1626 (doi: 10.1016/j.patcog.2011.11.004).

Login

Not registered yet?

Share

Tools

Login to add to favourites

Key

Unified framework for multi-scale decomposition and applications

References

Related content