SPECIAL ISSUE: Facial Image Processing and Analysis; Edited by M. Grgic, S. Shan, R. Lukac, H. Wechsler and M. S. BartlettNo Access

TOWARDS PRACTICAL FACIAL FEATURE DETECTION

MICAH ECKHARDT

Machine Perception Laboratory, Institute for Neural Computation, University of California, San Diego, La Jolla, CA 92093, USA

Search for more papers by this author

IAN FASEL

Department of Computer Science, University of Arizona, Tucson, AZ 85721, USA

Search for more papers by this author

, and

JAVIER MOVELLAN

Machine Perception Laboratory, Institute for Neural Computation, University of California, San Diego, La Jolla, CA 92093, USA

Search for more papers by this author

https://doi.org/10.1142/S0218001409007247Cited by:34 (Source: Crossref)

Abstract

Localizing facial features is a critical component in many computer vision applications such as expression recognition, face recognition, face tracking, animation, and red-eye correction. Practical applications require detectors that operate reliably under a wide range of conditions, including variations in illumination, pose, ethnicity, gender and age. One challenge for the development of such detectors is the inherent trade-off between robustness and precision. Robust detectors tend to provide poor localization and detectors sensitive to small changes in local structure, which are needed for precise localization, generate a large number of false alarms. Here we present an approach to this trade-off based on context dependent inference. First, robust detectors are used to detect contexts in which target features occur, then precise detectors are trained to localize the features given the detected context. This paper describes the approach and presents a thorough empirical examination of the parameters needed to achieve practical levels of performance, including the size of the training database, size of the detector's receptive fields and methods for information integration. The approach operates in real time and achieves, to our knowledge, the most accurate localization performance to date.

Keywords:

References

The BANCA Database. http://www.ee.surrey.ac.uk/CVSSP/banca/ . Google Scholar
The BioID Database. http://www.bioid.com/downloads/facedb . Google Scholar
P. Campadelli , R. Lanzarotti and G. Lipori , Percise eye localization through a general-to-specific model definition , Proc. British Machine Vision Conf. ( 2006 ) . Google Scholar
P. Campadelli , R. Lanzarotti and G. Lipori , Face Recognition ( Publisher I-Tech Education , 2007 ) . Google Scholar
P. Campadelli , R. Lanzarotti and G. Lipori , The Fundamentals of Verbal and Non Verbal Communication and the Biometrical Issues , NATO Science Series 18 ( Amsterdam , 2007 ) . Google Scholar
D. Cristinacce and T. Coots , Facial feature detection using adaboost with shape constraints , Proc. British Machine Vision Conf. ( 2003 ) . Google Scholar
A. Pnevmatikakis et al. , Impact of face registration errors on recognition , 3rd IFIP Conf. Artificial Intelligence Applications & Innovations (AIAI) ( 2006 ) . Google Scholar
M. Everingham and A. Zisserman , Regression and classification approaches to eye localization , 7th Int. Conf. Automatic Face and Gesture ( 2006 ) . Google Scholar
I. Fasel, B. Fortenberry and J. Movellan, Comput. Vis. Imag. Underst. 98, 182 (2005), DOI: 10.1016/j.cviu.2004.07.014. Crossref, Web of Science, Google Scholar
I. R. Fasel , M. S. Bartlett and J. R. Movellan , A comparison of Gabor filter methods for automatic detection of facial landmarks , Proc. 5th Int. Conf. Automatic Face and Gesture Recognition ( 2002 ) . Google Scholar
Y. Freund and R. E. Schapire, Experiments with a new boosting algorithm, Proc. 13th Int. Conf. Machine Learning (1996) pp. 146–148. Google Scholar
J. Friedman, T. Hastie and R. Tibshirani, Ann. Statist. 28(2), 337 (2000), DOI: 10.1214/aos/1016218223. Crossref, Web of Science, Google Scholar
The GENKI-4K Database. http://mplab.ucsd.edu . Google Scholar
J. Huang and H. Wechsler, Int. J. Patt. Recogn. Artif. Intell. 7(13), (1999). Google Scholar
O. Jesorsky , K. J. Kirchberg and R. W. Frischholz , Robust face detection using the hausdorff distance , Proc. Audio and Video Based Person Authentication ( 2001 ) . Google Scholar
B. H. Juang, L. R. Rabiner and J. G. Wilpson, IEEE Trans. Acoustics, Speech, Signal Proc. SSSP 35(7), 947 (1987). Crossref, Web of Science, Google Scholar
R. Kothari and J. Mitchell , Detection of eye locations in unconstrained visual images , ICIP96 ( 1996 ) . Google Scholar
T. Leung , M. Burl and P. Perona , Finding faces in cluttered scenes using random labeled graph matching , 5th Int. Conf. Computer Vision ( 1995 ) . Google Scholar
Y. Maet al., Robust precise eye location under probabilistic framework, IEEE Int. Conf. Automatic Face and Gesture Recognition (2004) pp. 339–344. Google Scholar
M. S. Barlett et al. , Fully automatic facial action recognition in spontaneous behavior , Proc. IEEE Int. Conf. Automatic Face and Gesture Recognition ( 2006 ) . Google Scholar
Q. Ji and P. Wang , Learning discriminant features for multi-view face and eye detection , Computer Vision and Pattern Recogniton ( 2005 ) . Google Scholar
P. J. Phillipset al., Imag. Vis. Comput. 16(5), 295 (1998), DOI: 10.1016/S0262-8856(97)00070-X. Crossref, Web of Science, Google Scholar
G. Shakhnarovich , P. Violaand and B. Moghaddam , A unified learning framework for real-time face detection and classification , Int. Conf. Automatic Face and Gesture Recognition ( 2002 ) . Google Scholar
P. Viola and M. Jones , Rapid object detection using a boosted cascade of simple feature , IEEE Conf. Computer Vision and Pattern Recognition (CVPR) ( 2001 ) . Google Scholar
P. Wang et al. , Automatic eye detection and its validation , IEEE Conf. Computer Vision and Pattern Recognition ( 2005 ) . Google Scholar
J. Whitehill et al. , Developing a practical smile detector , IEEE Int. Conf. Automatic Face and Gesture Recognition ( 2008 ) . Google Scholar
J. Whitehill and J. R. Movellan , A discriminative approach to frame-by-frame head pose estimation , Int. Conf. Automatic Face and Gesture Recognition ( 2008 ) . Google Scholar
L. Wiskottet al., IEEE Trans. Patt. Anal. Machine Intelligence 19(7), 775 (1997), DOI: 10.1109/34.598235. Crossref, Web of Science, Google Scholar
The XM2VTS Database. http://www.ee.surrey.ac.uk/Research/VSSP/xm2vtsdb . Google Scholar
S. Lucey , Y. Wang and J. Cohn , Enforcing convexity for improved alignment with constrained local models , IEEE Conf. Computer Vision and Pattern Recognition (CVPR) ( 2008 ) . Google Scholar
A. L. Yuille and H. H. Bulthoff, Bayesian decision theory and psychophysics, Technical Report 2, Max Planck Institut fur Biologische Kybernetik, Arbeitsgruppe Bulthoff (1993) . Google Scholar
Z. H. Zhou and Y. Jiang, Patt. Recogn. J. (2004). Google Scholar

Vol. 23, No. 03

Metrics

Downloaded 56 times

History

Keywords

PDF download

System Upgrade on Tue, May 28th, 2024 at 2am (EDT)

TOWARDS PRACTICAL FACIAL FEATURE DETECTION

Abstract

Recommended