© The Institution of Engineering and Technology
A methodology for comparison of boundary and segmentation images based on Precision–Recall graphs is presented in this study. The proposed methodology compares the location of edge pixels between an image under test and an ideal reference, in order to obtain a precise normalised similarity measure. This approach also deals with the case when multiple references are available using a merging procedure. Small displacement errors in edge pixel location are handled using a tolerance radius, which introduces the problem of multiple matching between test and reference edge pixels. This problem is addressed as a bipartite graph, solved by using the Hopcroft–Karp algorithm to obtain the maximum number of unique matchings. Experiments have been carried out in order to determine the performance of this evaluation approach.
References
-
-
1)
-
R. Motwani
.
Average-case analysis of algorithms for matchings and related problems.
J. ACM
,
6 ,
1329 -
1356
-
2)
-
H. Zhang ,
J.E. Fritts ,
S.A. Goldman
.
Image segmentation evaluation: a survey of unsupervised methods.
Comput. Vis. Image Underst.
,
2 ,
260 -
280
-
3)
-
I.E. Abdou ,
W.K. Pratt
.
Quantitative design and evaluation of enhancement/thresholding edge detectors.
Proc. IEEE
,
5 ,
753 -
763
-
4)
-
M. Mucha ,
P. Sankowski
.
Maximum matchings in planar graphs via Gaussian elimination.
Algorithmica
,
1 ,
3 -
20
-
5)
-
M. Borsotti ,
P. Campadelli ,
R. Schettini
.
Quantitative evaluation of color image segmentation results.
Pattern Recognit. Lett.
,
8 ,
741 -
747
-
6)
-
J. Edmonds ,
R.M. Karp
.
Theoretical improvements in algorithmic efficiency for network flow problems.
J. ACM
,
2 ,
248 -
264
-
7)
-
Y.J. Zhang ,
H. Luo
.
Optimal selection of segmentation algorithms based on performance evaluation.
Opt. Eng.
,
6 ,
1450 -
1455
-
8)
-
Davis, J., Goadrich, M.: `The relationship between Precision-Recall and ROC curves', ICML 06: Proc. 23rd Int. Conf. on Machine Learning, 2006, 148, p. 233–240.
-
9)
-
H. Bast ,
K. Mehlhorn ,
G. Schafer ,
H. Tamaki
.
Matching algorithms are fast in sparse random graphs.
Theory Comput Syst.
,
1 ,
3 -
14
-
10)
-
The Berkeley Segmentation Dataset and Benchmark. http://www.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/segbench, 2007, accessed March 2011.
-
11)
-
C.J. van Rijsbergen
.
(1979)
Information retrieval.
-
12)
-
Bowyer, K., Kranenburg, C., Dougherty, S.: `Edge detector evaluation using empirical ROC curves', Proc. IEEE Comput. Soc. Conf. on Computer Vision and Pattern Recognition CVPR, 1999, 1, p. 1354–1359.
-
13)
-
N.R. Pal ,
S.K. Pal
.
A review on image segmentation techniques.
Pattern Recognit.
,
9 ,
1277 -
1294
-
14)
-
R.M. Haralick ,
L.G. Shapiro
.
Image segmentation techniques.
Comput. Vis. Graph. Image Process.
,
1 ,
100 -
132
-
15)
-
Y.J. Zhang ,
J.J. Gerbrands
.
Segmentation evaluation using ultimate measurement accuracy.
Image Process. Algorithms Tech. III
,
1 ,
449 -
460
-
16)
-
L.R. Ford ,
D.R. Fulkerson
.
Maximal flow through a network.
Can. J. Math.
,
399 -
404
-
17)
-
Zhang, Y.J.: `A review of recent evaluation methods for image segmentation', Sixth Int. Symp. on Signal Processing and its Applications ISSPA, 2001, Kuala-Lampur, Malaysia, 1, p. 148–151.
-
18)
-
Martin, D.R., Fowlkes, C.C., Tal, D., Malik, J.: `A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics', Proc. IEEE Eighth Int. Conf. on Computer Vision ICCV, 2001, Vancouver, Canada, 2, p. 416–423.
-
19)
-
D.R. Martin ,
C.C. Fowlkes ,
J. Malik
.
Learning to detect natural image boundaries using local brightness, color, and texture cues.
IEEE Trans. Pattern Anal. Mach. Intell.
,
530 -
549
-
20)
-
Y.J. Zhang
.
A survey on evaluation methods for image segmentation.
Pattern Recognit.
,
8 ,
1335 -
1346
-
21)
-
L. Lucchese ,
S.K. Mitra
.
Colour image segmentation: a state-of-the-art survey.
Proc. Indian Nat. Sci. Acad. A
,
2 ,
207 -
222
-
22)
-
J. Liu ,
Y. Yang
.
Multiresolution color image segmentation.
IEEE Trans. Pattern Anal. Mach. Intell.
,
7 ,
689 -
700
-
23)
-
Hopcroft, J.E., Karp, R.M.: `A ', Annual IEEE Symp. on Foundations of Computer Science FOCS, 1971, p. 122–125.
-
24)
-
J.S. Cardoso ,
L. Corte-Real
.
Toward a generic evaluation of image segmentation.
IEEE Trans. Image Process.
,
11 ,
1773 -
1782
-
25)
-
J. Edmonds
.
Paths, trees, and flowers.
Can. J. Math.
,
449 -
467
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2010.0179
Related content
content/journals/10.1049/iet-cvi.2010.0179
pub_keyword,iet_inspecKeyword,pub_concept
6
6