No Access

A NOVEL VISION-BASED FINGER-WRITING CHARACTER RECOGNITION SYSTEM

School of Electronic and Information, South China University of Technology, 381 WuShan Road, GuangZhou, 510640/GuangDong, P. R. China

Search for more papers by this author

DUANDUAN YANG

School of Electronic and Information, South China University of Technology, 381 WuShan Road, GuangZhou, 510640/GuangDong, P. R. China

Search for more papers by this author

LI-XIN ZHEN

Motorola China Research Center, ShangHai, 200002/ShangHai, P. R. China

Search for more papers by this author

, and

JIAN-CHENG HUANG

Motorola China Research Center, ShangHai, 200002/ShangHai, P. R. China

Search for more papers by this author

https://doi.org/10.1142/S0218126607003757Cited by:27 (Source: Crossref)

Abstract

A novel video-based finger writing virtual character recognition system (FVCRS) is described in this paper. With this FVCR system, one can enter characters into a computer by just using the movement of fingertip, without any additional device such as a keyboard or a digital pen. This provides a new wireless character-inputting method. A simple but effective background model is built for segmenting human-finger movements from cluttered background. A robust fingertip detection algorithm based on feature matching is given, and recognition of the finger-writing character is by a DTW-based classifier. Experiments show that the FVCRS can successfully recognize finger-writing uppercase and lowercase English alphabet with the accuracy of 95.3% and 98.7%, respectively.

Keywords:

References

V. Pavlovic, R. Sharma and T. S. Huang, IEEE Trans. PAMI 19, 677 (1997). Crossref, Google Scholar
K. Oka, Y. Sato and H. Koike, IEEE Comput. Graphics Appl. 22, 64 (2002), DOI: 10.1109/MCG.2002.1046630. Crossref, Web of Science, Google Scholar
K. Imagawa, S. Lu and S. Igi, Color-based hands tracking system for sign language recognition, Proc. Int. Conf. Automatic Face and Gesture Recognition (1998) pp. 462–467. Google Scholar
F. Quek, T. Mysliwiec and M. Zhao, Finger mouse: A freehand pointing interface, Proc. Int. Workshop on Automatic Face and Gesture Recognition (1995) pp. 372–377. Google Scholar
C. von Hardenberg and F. Bérad, Bare-hand human–computer interaction, Proc. ACM Workshop on Perceptive User Interfaces (2001) pp. 1–8. Google Scholar
J. Crowley, F. Bérard and J. Coutaz, Finger tracking as an input device for augmented reality, Proc. Int. Conf. Automatic Face and Gesture Recognition (1995) pp. 195–200. Google Scholar
K. Dorfmuller-Ulhaas and D. Schmalstieg, Finger tracking for interaction in augmented environments, Proc. IEEE and ACM Int. Symp. Augmented Reality (2001) pp. 55–64. Google Scholar
T. Brown and R. C. Thomas, Finger tracking for the digital desk, Proc. First Australasian User Interface Conf. (2000) pp. 11–16. Google Scholar
K. Oka, Y. Sato and H. Koike, Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems, Proc. IEEE Int. Conf. Automatic Face and Gesture Recognition (FG 2002) (2002) pp. 429–434. Google Scholar
M. S. Leeet al., A computer vision system for on-screen item selection by finger pointing, Proc. IEEE Conf. Computer Vision and Pattern Recognition (1997) pp. 1027–1033. Google Scholar
R. Plamondon and S. N. Srihari, IEEE Trans. Pattern Anal. Machine Intell. 22, 63 (2000), DOI: 10.1109/34.824821. Crossref, Web of Science, Google Scholar
M. E. Munich and P. Perona, IEEE Trans. Pattern Anal. Machine Intell. 24, 313 (2002), DOI: 10.1109/34.990134. Crossref, Web of Science, Google Scholar
C. R. Wrenet al., IEEE Trans. Pattern Anal. Machine Intell. 19, 780 (1997), DOI: 10.1109/34.598236. Crossref, Web of Science, Google Scholar
N. Friedman and S. Russell , Image segmentation in video sequences: A probabilistic approach , Proc. Thirteenth Conf. Uncertainty in Artificial Intelligence ( 1997 ) . Google Scholar
A. Elgammalet al., Proc. IEEE 90, 1152 (2002), DOI: 10.1109/JPROC.2002.801448. Google Scholar
I. Haritaoglu, D. Harwood and L. S. Davis, IEEE Trans. Pattern Anal. Machine Intell. 22, 809 (2000), DOI: 10.1109/34.868683. Crossref, Web of Science, Google Scholar
K. Toyamaet al., Wallflower: Principles and practice of background, maintenance, Proc. ICCV (1999) pp. 225–261. Google Scholar
J. Davis and M. Shah, IEE Proc. Vision, Image and Signal Processing 141, 101 (1994), DOI: 10.1049/ip-vis:19941058. Crossref, Web of Science, Google Scholar
A. Tomita and R. Ishii Jr., Hand shape extraction from a sequence of digitized gray-scale images, 20th Int. Conf. Industrial Electronics, Control and Instrumentation (IECON '94)3 (1994) pp. 1925–1930. Google Scholar
L. Rabiner and B. H. Juang , Fundamentals of Speech Recognition ( Prentice-Hall, Inc. , NJ, USA , 1993 ) . Google Scholar
T. Longet al., Proc. IEEE ICASSP 449 (2005). Google Scholar
C. C. Tappert, C. Y. Suen and T. Wakahara, Online handwriting recognition — A survey, Proc. 9th Int. Conf. Pattern Recognition2 (1998) pp. 1123–1132. Google Scholar