© The Institution of Engineering and Technology
Various methods for lip segmentation have been proposed, and it still remains a challenging and difficult problem due to the weak colour contrast between the lip and other face regions. A novel automatic lip segmentation algorithm is proposed based on the wavelet multi-scale edge detection across the discrete Hartley transform. Comparative study with some existing lip segmentation algorithms has indicated the superior performance of the developed algorithm. The proposed algorithm produces better segmentation without the need to determine an optimum threshold for each lip image. In contrast to the other methods investigated, the lip segmentation is determined completely automatically.
References
-
-
1)
-
Liew, A.W.-C., Leung, S.H., Lau, W.H.: `Lip contour extraction using a deformable model', Proc. Int. Conf. Image Processing, September 2000, Vancouver, Canada, 2, p. 255–258.
-
2)
-
Delmas, P., Coulon, P.Y., Fristot, V.: `Automatic snakes for robust lip boundaries extraction', Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, March 1999, Phoenix, USA, 6, p. 3069–3072.
-
3)
-
S. Dupont ,
J. Luettin
.
Audio-visual speech modeling for continuous speech recognition.
IEEE Trans. Multimed.
,
3 ,
141 -
151
-
4)
-
A.W.-C. Liew ,
S.H. Leung ,
W.H. Lau
.
Segmentation of color lip images by spatial fuzzy clustering.
IEEE Trans. Fuzzy Syst.
,
4 ,
542 -
549
-
5)
-
Gocke, R., Millar, J.B., Zelinsky, A., Robert-Ribes, J.: `Automatic extraction of lip feature points', Proc. Austral. Conf. Robotics and Automation, August 2000, Melbourne, Australia, p. 31–36.
-
6)
-
Sadeghi, M., Kittler, J., Messer, K.: `Real time segmentation of lip pixels for lip tracker initialization', Proc. 9th Int. Conf. Computer Analysis of Images and Patterns, September 2001, Warsaw, Poland, p. 317–324.
-
7)
-
Wark, T., Sridharan, S.: `A syntactic approach to automatic lip feature extraction for speaker identification', Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Process, May 1998, Seattle, USA, vol. 6, p. 3693–3696.
-
8)
-
Lucey, S., Sridharan, S., Chandran, V.: `A suitability metric for mouth tracking through chromatic segmentation', Proc. Int. Conf. Image Processing, October 2001, Thessaloniki, Greece, 3, p. 258–261.
-
9)
-
Eveno, N., Caplier, A., Coulon, P.-Y.: `A new color transformation for lips segmentation', Proc. 4th IEEE Workshop on Multimedia Signal Processing, October 2000, Cannes, France, p. 3–8.
-
10)
-
Werda, S., Mahdi, W., Hamadou, A.B.: `Colour and geometric based model for lip localisation: application for lip-reading system', Proc. 14th Int. Conf. Image Analysis and Processing, 2007, Modena, Italy, p. 9–14.
-
11)
-
S. Mallat ,
S. Zhong
.
Characterization of signals from multiscale edges.
IEEE Trans. Pattern Anal. Mach. Intell.
,
7 ,
710 -
732
-
12)
-
F.S. Werblin ,
D.R. Copenhagen
.
Control of retinal sensitivity: III. Lateral interactions at the inner plexiform layer.
J. Gen. Physiol.
,
88 -
110
-
13)
-
W. Gao ,
Y.-Q. Chen ,
R. Wang ,
S.-G. Shan ,
D.-L. Jiang
.
Learning and synthesizing MPEG-4 compatible 3-D face animation from video sequence.
IEEE Trans. Circuits Syst. Video Technol.
,
11 ,
1119 -
1128
-
14)
-
I. Matthews ,
T.F. Cootes ,
J.A. Bangham ,
S. Cox ,
R. Harvey
.
Extraction of visual features for lipreading.
IEEE Trans. Pattern Anal. Mach. Intell.
,
2 ,
198 -
213
-
15)
-
Dargham, J.A., Chekima, A.: `Lips detection in the normalized RGB colour scheme', Proc. 2nd IEEE Int. Conf. Information and Communication Tech, April 2006, Damascus, Syria, 1, p. 1546–1551.
-
16)
-
Gosami, B., Christmas, W.J., Kittler, J.: `Statistical estimators for use in automatic lip segmentation', Proc. 3rd European Conf. Visual Media Production, 2006, London, UK, p. 79–86.
-
17)
-
Sadeghi, M., Kittler, J., Messer, K.: `Spatial clustering of pixels in the mouth area of face images', Proc. 11th Int. Conf. Image Analysis and Processing, September 2001, Palermo, Italy, p. 36–41.
-
18)
-
‘Yale face database B’,http://cvc.yale.edu/projects/yalefacesB/yalefacesB.html,accessed May 2001.
-
19)
-
Li, Y.-Zh., Kobatake, K.: `Extraction of facial sketch images and expression transformation based on FACS', Proc. Int. Conf. Image Processing, October 1995, Washington, USA, 3, p. 520–523.
-
20)
-
R.N. Bracewell
.
(1986)
The Hartley transform.
-
21)
-
Li, J.: `A wavelet approach to edge detection', 2003, MS, Sam Houston State University.
-
22)
-
I. Pitas ,
A. Karasaridis
.
Multichannel transforms for signal/image processing.
IEEE Trans. Image Process.
,
10 ,
1402 -
1413
-
23)
-
H.E. Cetingul ,
Y. Yemez ,
E. Erzin ,
A.M. Tekalp
.
Discriminative analysis of lip motion features for speaker identification and speech-reading.
IEEE Trans. Image Process.
,
10 ,
2879 -
2891
-
24)
-
S.L. Wang ,
W.H. Lau ,
A.W.C. Liew ,
S.H. Leung
.
Robust lip region segmentation for lip images with complex background.
Pattern Recognit.
,
12 ,
3481 -
3491
-
25)
-
A.C. Hulbert ,
T. Poggio
.
Synthesizing a color algorithm from examples.
Science
,
4839 ,
482 -
485
-
26)
-
Chetty, G., Wagner, M.: `Automated lip feature extraction for liveness verification in audio-video authentication', Proc. Image and Vision Computing, November 2004, Akaroa, New Zealand, p. 17–23.
-
27)
-
Shdaifat, I., Grigat, R., Langmann, D.: `Active shape lip modeling', Proc. Int. Conf. Image Processing, September 2003, Barcelona, Spain, 2, p. 875–878.
-
28)
-
Guan, Y.-P.: `Automatic extraction of lip based on wavelet edge detection', Proc. 8th Int. Symp. Symbolic and Numeric Algorithms for Scientific Computing, September 2006, Timisoara, Romania, p. 125–129.
-
29)
-
G. Chiou ,
J. Hwang
.
Lipreading from color video.
IEEE Trans. Image Process.
,
8 ,
1192 -
1195
-
30)
-
N. Eveno ,
A. Caplier ,
P.-Y. Coulon
.
Accurate and quasi-automatic lip tracking.
IEEE Trans. Circuits Syst. Video Technol.
,
5 ,
706 -
715
-
31)
-
‘CVI face database’http://www.lrv.fri.uni-lj.si/facedb.html,accessed December 1999.
-
32)
-
A.M. Martinez ,
R. Benavente
.
CVC Technical Report #24.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi_20070061
Related content
content/journals/10.1049/iet-cvi_20070061
pub_keyword,iet_inspecKeyword,pub_concept
6
6