Face Processing and Applications to Distance Learning

The following sections are included:

• Dedication
• Preface
• Contents

Human faces are among the most important subjects of image processing, computer vision and graphics. Facial visual signal processing has been one of the top important research topics in the computer vision community. Research on face signal analysis and synthesis spans a broad range of modalities and methodologies including static frames and dynamic sequences of color images, depth images and LIDAR data. The applications of facial visual signal processing are also widespread including image enhancement, compression, recognition and animation. Recently, with the breakthroughs of computing infrastructure and social computing platforms, facial visual signal processing techniques are having tremendous opportunities in contributing to virtual reality, social network and remote sensing applications. The combination of facial processing techniques in graphics — such as face animation, and vision — such as expression recognition enables the unprecedented opportunity for remote and virtual interactive services…

The following sections are included:

• Introduction
• Related Work
• Image Features
  • Mid-Level Features
• Supervised Image Descriptor Encoding
  • Supervised Soft Vector Quantization (SSVQ)
  • Multi-class SSVQ
  • Supervised Super-Vector Encoding (SSE)
• Databases
  • Binghamton University 3D Facial Expression (BU-3DFE) Database
  • CMU Multi-PIE
• Experiments and Discussion
• Concluding Remarks

The following sections are included:

• Introduction
• 3D Face Model Reconstruction from 2D Images
  • Related Work
  • 3D Reconstruction from a Single Image of Arbitrary View
  • 3D Reconstruction from Stereo Images
  • Experiments and Evaluation
• 3D Face Model Tracking from 2D Videos
  • Introduction
  • Literature Review
  • Real Time 3D Face Tracking from 2D Videos
  • Experimental Results
• 3D Face Modeling from RGB-D Images
  • Introduction
  • 3D Face Model Fitting with RGB-D Signal
  • 3D Face Model Tracking with RGB-D Signal
• Conclusions

The following sections are included:

• Introduction
• Previous Work
  • Feature-based Methods
  • Appearance-based Methods
  • Geometric Model-based Methods
  • Visible Light Methods
• Eye Gaze Estimation Using 3D Models
  • 3D Face Model Tracking
  • Gaze Direction Estimation
• Experiments
• Conclusions

The following sections are included:

• Introduction
• Related Work
  • Expressive Speech Synthesis
  • 3D Face Modeling and Animation
  • Co-articulation of Lip Motion and Facial Expressions
• System Framework and Methods
  • System Framework
  • 3D Face Modeling
  • 3D Face Animation
  • Expressive Speech Synthesis
• Evaluations
• Conclusions and Future Work

The following sections are included:

• Introduction
• Animation Model Construction
• Performance-driven Animations
• 3D Model-based Video Coding
• Experimental Results

The following sections are included:

• Introduction
• Related Work
• System Overview
• Engagement Estimation
  • Gaze Direction
  • Emotion Recognition
• Experiments
  • Qualitative Evaluation
  • Quantitative Evaluation
• Conclusions and Future Work

In this book, we have investigated a collection of facial processing techniques for analyzing and synthesizing static and dynamic geometry of human faces. The collection includes appearance based expression recognition, feature based 3D morphable model fitting, 3D motion tracking, avatar playing and eye gaze recognition. The quantitative evaluation of the experiments shows that the algorithms and based-upon systems are competent for state-of-the-art quality for human faces and facial behaviors analysis. The efficiency of the algorithms has been demonstrated to be suitable for real time applications…

The following sections are included:

• Bibliography
• Index