No Access

HUMAN MOTION PERCEPTION THROUGH VIDEO MODEL-BASED TRACKING

JEAN-BAPTISTE DE LA RIVIÈRE

Immersion SAS, 12 rue Feaugas, 33100 Bordeaux Bastide, France

Search for more papers by this author

and

PASCAL GUITTON

LaBRI – INRIA Futurs, Université Bordeaux 1, 351 cours de la Libération, 33405 Talence Cedex, France

Search for more papers by this author

https://doi.org/10.1142/S0219843606000813Cited by:0 (Source: Crossref)

Abstract

As computer vision enables the robot to be aware of its human counterpart, such algorithms could help machines to achieve human-like interaction. However, many video tracking algorithms are not able to cope with some robot vision requirements. The articulated tracking system we develop solves some of those issues. It relies on model-based algorithms, which we believe are more suitable to robot vision than appearance-based ones. Indeed, as they update all the relevant parameters of a surrounding world model, results include some knowledge of the camera and objects relative positions. Our system relies on 3D model silhouette matching and runs in real time. We increase the algorithm robustness by introducing a pre-processing step based on image moments. This allows the iteration refinement to start in a better position by roughly estimating the body motion from one frame to the next.

Keywords:

References

J. Davis and A. Bobick, The representation and recognition of action using temporal templates, Proc. IEEE Conf. Computer Vision and Pattern Recognition (IEEE Computer Society, 1997) pp. 928–934. Google Scholar
J. Davis and A. Bobick, Sideshow: A silhouette–based interactive dual-screen environment, Technical Report 457, MIT Media Lab Perceptual Computing Group (1998) . Google Scholar
W. Freemanet al., Computer vision for computer games, FG'96 (IEEE Computer Society, 1996) pp. 100–105. Google Scholar
G. Hager and N. Belhumeur, IEEE Trans. PAMI 20(10), 1025 (1998). Crossref, Google Scholar
T. Heap and D. Hogg, Towards 3D hand tracking using a deformable model, Conf. Automatic Face and Gesture Recognition (IEEE Computer Society, 1996) pp. 140–145. Google Scholar
L. Herda, R. Urtasun and P. Fua, Comput. Vision Image Understanding 2, 189 (2005). Google Scholar
J. Rehg and T. Kanade, Digiteyes: Vision-based hand tracking for human computer interaction, Proc. Workshop on Motion of Non-Rigid and Articulated Objects (IEEE Computer Society, 1994) pp. 16–22. Google Scholar
K. Sato and J. K. Aggarwal, Comput. Vision Image Understanding 2, 100 (2004). Google Scholar
Y. Sato, M. Saito and H. Koike, Real-time input of 3D hand pose and gestures of a user's hand and its applications for HCI, Proc. Virtual Reality Conference (IEEE Computer Society, 2001) p. 79. Google Scholar
J. Segen and S. Kumar, Shadow gestures: 3D hand pose estimation using a single camera, Proc. IEEE Conf. Computer Vision and Pattern Recognition (IEEE Computer Society, 1999) pp. 479–485. Google Scholar
B. Stenger, P. Mendonca and R. Cipolla, Model-based hand tracking using an unscented kalman filter, Proc. Br. Mach. Vision Conf.1 (2001) pp. 65–72. Google Scholar
Y. Wu, J. Lin and T. Huang, IEEE Trans. PAMI 27(12), 1910 (2005). Google Scholar