Gradient descent with adaptive momentum for active contour models
- Author(s): Guoqi Liu 1 ; Zhiheng Zhou 1 ; Huiqiang Zhong 1 ; Shengli Xie 1
-
-
View affiliations
-
Affiliations:
1:
School of Electronic and Information Engineering, South China University of Technology, Guangzhou 510641, People's Republic of China
-
Affiliations:
1:
School of Electronic and Information Engineering, South China University of Technology, Guangzhou 510641, People's Republic of China
- Source:
Volume 8, Issue 4,
August 2014,
p.
287 – 298
DOI: 10.1049/iet-cvi.2013.0089 , Print ISSN 1751-9632, Online ISSN 1751-9640
In active contour models (snakes), various vector force fields replacing the gradient of the original external energy in the equations of motion are a popular way to extract the object boundary. Gradient descent method is usually used to obtain the equations of motion by minimising the energy functional. However, it always suffers from local minimum in extracting complex geometries because of non-convex functional. Gradient descent method with adaptive momentum term is proposed in this study. First, an acceleration function of evolution is defined. Then, the adaptive momentum term is obtained by calculating the product between the edge stopping function and the defined acceleration function. Finally, adaptive momentum is compatible with the snakes. The edge stopping function is used to decide the influence region of the momentum, whereas the defined acceleration function determines the magnitude of the momentum. It is used to extract the complex geometries (such as deep concavity) when adding the adaptive momentum into some snakes, such as gradient vector field or vector field convolution snakes. On the other hand, the proposed method also accelerates the rate of convergence. It can be applied to extract a single object in real images. The experimental results show that the proposed method is effective and efficient.
Inspec keywords: gradient methods; convolution; feature extraction; edge detection; geometry
Other keywords: energy functional; real images; object boundary extraction; adaptive momentum term; gradient descent method; vector field convolution snakes; external energy; vector force fields; acceleration function of evolution; active contour models; gradient vector field; edge stopping function; complex geometries; deep concavity; equations of motion
Subjects: Combinatorial mathematics; Interpolation and function approximation (numerical analysis); Interpolation and function approximation (numerical analysis); Optical, image and video signal processing; Combinatorial mathematics; Computer vision and image processing techniques
References
-
-
1)
-
19. Andersson, T., Lathen, G., Lenz, R., Borga, M.: ‘Modified gradient search for level set based image segmentation’, IEEE Trans. Image Process., 2013, 22, (2), pp. 621–630 (doi: 10.1109/TIP.2012.2220148).
-
-
2)
-
6. Li, B., Acton, S.: ‘Active contour external force using vector field convolution for image segmentation’, IEEE Trans. Image Process., 2007, 16, (8), pp. 2096–2106 (doi: 10.1109/TIP.2007.899601).
-
-
3)
-
23. Wang, Y., Liu, L., Zhang, H., Cao, Z., Lu, S.: ‘Image segmentation using active contours with normally biased GVF external force’, IEEE Signal Process. Lett., 2010, 17, (10), pp. 875–879 (doi: 10.1109/LSP.2010.2060482).
-
-
4)
- A.A. Amini , T.E. Weymouth , R.C. Jain . Using dynamic programming for solving variational problems in vision. IEEE Trans. Pattern Anal. Mach. Intell. , 9 , 855 - 860
-
5)
- J.-F. Aujol , G. Gilboa , T. Chan , S. Osher . Structure-texture image decomposition modeling, algorithms, and parameter selection. Int. J. Comput. Vis. , 1 , 111 - 136
-
6)
-
10. Bresson, X., Esedoglu, S., Vandergheynst, P., Thiran, J., Osher, S.: ‘Fast global minimization of the active contour/snake model’, J. Math. Imaging Vis., 2007, 28, (2), pp. 151–167 (doi: 10.1007/s10851-007-0002-0).
-
-
7)
-
17. Mishra, A.K., Fieguth, P.W., Clausi, D.A.: ‘Decoupled active contour (DAC) for boundary detection’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, (2), pp. 310–324 (doi: 10.1109/TPAMI.2010.83).
-
-
8)
-
21. Sum, K.W., Cheung, P.Y.S.: ‘Boundary vector field for parametric active contours’, Pattern Recognit., 2007, 40, (6), pp. 1635–1645 (doi: 10.1016/j.patcog.2006.11.006).
-
-
9)
-
22. Xie, X., Mirmehdi, M.: ‘MAC: magnetostatic active contour model’, IEEE Trans. Patt. Anal., 2008, 30, (4), pp. 632–646 (doi: 10.1109/TPAMI.2007.70737).
-
-
10)
- C. Xu , J.L. Prince . Generalized gradient vector flow external forces for active contours. Signal Process. , 131 - 139
-
11)
-
8. Wang, T., Cheng, I., Basu, A.: ‘Fluid vector flow and applications in brain tumor segmentation’, IEEE Trans. Biomed. Eng., 2009, 56, (3), pp. 781–789 (doi: 10.1109/TBME.2009.2012423).
-
-
12)
- D. Mumford , J. Shah . Optimal approximations by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. , 5 , 577 - 685
-
13)
-
25. Qian, N.: ‘On the momentum term in gradient descent learning algorithms’, Neural Netw., 1999, 12, pp. 145–151 (doi: 10.1016/S0893-6080(98)00116-6).
-
-
14)
- M. Kass , A. Witkin , D. Terzopoulos . Snakes: active contour models. Int. J. Comput. Vis. , 4 , 321 - 331
-
15)
- S. Osher , J.A. Sethian . Fronts propagating with curvature dependent speed: algorithms based on Hamilton–Jacobi formulations. J. Comput. Phys. , 1 , 12 - 49
-
16)
- C. Xu , J.L. Prince . Snakes, shapes and gradient vector flow. IEEE Trans. Image. Process. , 3 , 359 - 369
-
17)
-
24. Xie, S.L., Zeng, D.L., Zhou, Z.H., Zhang, J.: ‘Arranging and interpolating sparse unorganized feature points with geodesic circular arc’, IEEE Trans. Image Process., 2009, 18, (3), pp. 582–595 (doi: 10.1109/TIP.2008.2010146).
-
-
18)
-
22. Cheng, J., Foo, S.W.: ‘Dynamic directional gradient vector flow for snakes’, IEEE Trans. Image Process., 2006, 15, (6), pp. 1563–1571 (doi: 10.1109/TIP.2006.871140).
-
-
19)
- V. Caselles , R. Kimmel , G. Sapiro . Geodesic active contours. Int. J. Comput. Vis. , 1 , 61 - 79
-
20)
-
26. Shao, H., Zheng, G.: ‘A new BP algorithm with adaptive momentum for FNNs training’. 2009 WRI Global Congress on Intelligent Systems (GCIS 2009), 2009, vol. 4, pp. 16–20 (doi: 10.1109/GCIS.2009.136).
-
-
21)
- A.J. Viterbi . Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans. Inf. Theory , 4 , 260 - 269
-
22)
-
11. Brown, E., Chan, T., Bresson, X.: ‘Completely convex formulation of the Chan–Vese image segmentation model’, Int. J. Comput. Vis., 2012, 98, (1), pp. 103–121 (doi: 10.1007/s11263-011-0499-y).
-
-
23)
- T. Chan , L. Vese . Active contours without edges. IEEE Trans. Image Process. , 2 , 266 - 277
-
24)
-
27. Shao, H., Zheng, G.: ‘Convergence analysis of a back-propagation algorithm with adaptive momentum’, Neurocomputing, 2011, 74, (5), pp. 749–752 (doi: 10.1016/j.neucom.2010.10.008).
-
-
25)
-
29. Chambolle, A.: ‘An algorithm for total variation minimization and applications’, J. Math. Imaging Vis., 2004, 20, (1–2), pp. 89–97.
-
-
26)
-
24. Xie, S.L., Zeng, D.L., Zhou, Z.H., Zhang, J.: ‘Arranging and interpolating sparse unorganized feature points with geodesic circular arc’, IEEE Trans. Image Process., 2009, 18, (3), pp. 582–595 (doi: 10.1109/TIP.2008.2010146).
-
-
27)
-
30. Aujol, J.F., Gilboa, G., Chan, T., Osher, S.: ‘Structure-texture image decomposition-modeling, algorithms, and parameter selection’, Int. J. Comput. Vis., 2006, 67, (1), pp. 111–136 (doi: 10.1007/s11263-006-4331-z).
-
-
28)
-
13. Caselles, V., Kimmel, R., Sapiro, G.: ‘Geodesic active contour’, Int. J. Comput. Vis., 1997, 22, (1), pp. 61–79 (doi: 10.1023/A:1007979827043).
-
-
29)
-
28. [Online]. Available: http://www.dmforge.itn.liu.se/lsopt/.
-
-
30)
-
27. Shao, H., Zheng, G.: ‘Convergence analysis of a back-propagation algorithm with adaptive momentum’, Neurocomputing, 2011, 74, (5), pp. 749–752 (doi: 10.1016/j.neucom.2010.10.008).
-
-
31)
-
14. Eric, N.M., William, A.B.: ‘Intelligent scissors for image composition’. Proc. ACM SIGGRAPH, 1995, pp. 191–198.
-
-
32)
-
2. Aubert, G., Kornprobst, P.: ‘Mathematical problems in image processing: partial differential equations and the calculi of variations’ (Springer, New York, 2006, 2nd edn.).
-
-
33)
-
11. Brown, E., Chan, T., Bresson, X.: ‘Completely convex formulation of the Chan–Vese image segmentation model’, Int. J. Comput. Vis., 2012, 98, (1), pp. 103–121 (doi: 10.1007/s11263-011-0499-y).
-
-
34)
-
4. Xu, C., Prince, J.: ‘Snakes, shapes, and gradient vector flow’, IEEE Trans. Image Process., 1998, 7, (3), pp. 359–369 (doi: 10.1109/83.661186).
-
-
35)
-
26. Shao, H., Zheng, G.: ‘A new BP algorithm with adaptive momentum for FNNs training’. 2009 WRI Global Congress on Intelligent Systems (GCIS 2009), 2009, vol. 4, pp. 16–20 (doi: 10.1109/GCIS.2009.136).
-
-
36)
-
12. Osher, S., Sethian, J.: ‘Fronts propagating with curvature-dependent speed: algorithms based on Hamilton–Jacobi formulations’, J. Comput. Phys., 1988, 79, pp. 12–49 (doi: 10.1016/0021-9991(88)90002-2).
-
-
37)
-
18. Viterbi, A.: ‘Error bounds for convolutional codes and an asymptotically optimum decoding algorithm’, IEEE Trans. Inf. Theory, 1967, 13, (2/3), pp. 260–269 (doi: 10.1109/TIT.1967.1054010).
-
-
38)
-
6. Li, B., Acton, S.: ‘Active contour external force using vector field convolution for image segmentation’, IEEE Trans. Image Process., 2007, 16, (8), pp. 2096–2106 (doi: 10.1109/TIP.2007.899601).
-
-
39)
-
5. Xu, C., Prince, J.: ‘Generalized gradient vector flow external forces for active contours’, Signal Process., 1998, 71, (2), pp. 131–139 (doi: 10.1016/S0165-1684(98)00140-6).
-
-
40)
-
8. Wang, T., Cheng, I., Basu, A.: ‘Fluid vector flow and applications in brain tumor segmentation’, IEEE Trans. Biomed. Eng., 2009, 56, (3), pp. 781–789 (doi: 10.1109/TBME.2009.2012423).
-
-
41)
-
20. Mumford, D., Shah, J.: ‘Optimal approximations by piecewise smooth functions and associated variational problems’, Commun. Pure. Appl. Math., 1989, 42, pp. 577–685 (doi: 10.1002/cpa.3160420503).
-
-
42)
-
7. Xie, X., Mirmehdi, M.: ‘MAC: magnetostatic active contour model’, IEEE Trans. Pattern Anal. Mach. Intell., 2008, 30, (4), pp. 632–647 (doi: 10.1109/TPAMI.2007.70737).
-
-
43)
-
19. Andersson, T., Lathen, G., Lenz, R., Borga, M.: ‘Modified gradient search for level set based image segmentation’, IEEE Trans. Image Process., 2013, 22, (2), pp. 621–630 (doi: 10.1109/TIP.2012.2220148).
-
-
44)
-
9. Chan, T., Vese, L.: ‘Active contours without edges’, IEEE Trans. Image Process., 2001, 10, (2), pp. 266–277 (doi: 10.1109/83.902291).
-
-
45)
-
1. Kass, M., Witkin, A., Terzopoulus, D.: ‘Snakes: active contour model’, Int. J. Comput. Vis., 1988, 1, (4), pp. 321–331 (doi: 10.1007/BF00133570).
-
-
46)
-
16. Williams, D., Shah, M.: ‘A fast algorithm for active contours and curvature estimation’, Comput. Vis. Graph. Image Understand., 1992, 55, (1), pp. 14–26.
-
-
47)
-
15. Amini, A., Weymouth, T.E., Jain, R.: ‘Using dynamic programming for solving variational problems in vision’, IEEE Trans. Pattern Anal. Mach. Intell., 1990, 12, (9), pp. 855–867 (doi: 10.1109/34.57681).
-
-
48)
-
21. Sum, K.W., Cheung, P.Y.S.: ‘Boundary vector field for parametric active contours’, Pattern Recognit., 2007, 40, (6), pp. 1635–1645 (doi: 10.1016/j.patcog.2006.11.006).
-
-
49)
-
25. Qian, N.: ‘On the momentum term in gradient descent learning algorithms’, Neural Netw., 1999, 12, pp. 145–151 (doi: 10.1016/S0893-6080(98)00116-6).
-
-
50)
-
23. Wang, Y., Liu, L., Zhang, H., Cao, Z., Lu, S.: ‘Image segmentation using active contours with normally biased GVF external force’, IEEE Signal Process. Lett., 2010, 17, (10), pp. 875–879 (doi: 10.1109/LSP.2010.2060482).
-
-
51)
-
17. Mishra, A.K., Fieguth, P.W., Clausi, D.A.: ‘Decoupled active contour (DAC) for boundary detection’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, (2), pp. 310–324 (doi: 10.1109/TPAMI.2010.83).
-
-
52)
-
10. Bresson, X., Esedoglu, S., Vandergheynst, P., Thiran, J., Osher, S.: ‘Fast global minimization of the active contour/snake model’, J. Math. Imaging Vis., 2007, 28, (2), pp. 151–167 (doi: 10.1007/s10851-007-0002-0).
-
-
53)
-
22. Cheng, J., Foo, S.W.: ‘Dynamic directional gradient vector flow for snakes’, IEEE Trans. Image Process., 2006, 15, (6), pp. 1563–1571 (doi: 10.1109/TIP.2006.871140).
-
-
54)
-
3. Nocedal, J., Wright, S.: ‘Numerical optimization’ (Springer, 2006, 2nd edn.).
-
-
1)