Sign language recognition (SLR) has got wide applicability. SLR system is considered to be a challenging one. This paper presents empirical analysis of different mathematical models for Pakistan SLR (PSLR). The proposed method is using the parameterization of sign signature. Each sign is represented with a mathematical function and then coefficients of these functions are used as the feature vector. This approach is based on exhaustive experimentation and analysis for getting the best suitable mathematical representation for each sign. This extensive empirical analysis, results in a very small feature vector and hence to a very efficient system. The robust proposed method has got general applicability as it just need a new training set and it can work equally good for any other dataset. Sign set used is quite complex in the sense that intersign similarity distance is very small but even then proposed methodology has given quite promising results.

Keywords:

References

1. R. Akmeliawati, M. Po-Leen Ooi and Y. C. Kuang, Real-time Malaysian sign language translation using colour segmentation and neural network, IMTC 2007-Instrumentation and Measurement Technology Conference, 1–3 May 2007, Warsaw, Poland. Google Scholar
2. A. K. Alvi, M. Yousuf Bin Azhar, M. Usman, S. Mumtaz, S. Rafiq, R. Rehman and I. Ahmed, Pakistan sign language recognition using statistical template matching, World Academy of Science, Engineering and Technology, 3, (2005). Google Scholar
3. T. Aujeszky and M. Eid, A gesture recogintion architecture for Arabic sign language communication system, Multimedia Tools and Applications (2015) 1–19. Web of Science, Google Scholar
4. J. Cheng, X. Chen, A. Liu and H. Peng, A novel phonology-and radical-coded chinese sign language recognition framework using accelerometer and surface electromyography sensors, Sensors 15 (9) (2015) 23303–23324. Crossref, Web of Science, Google Scholar
5. H. Cooper, Ong Eng-Jon, N. Pugeault and R. Bowden, Sign language recognition using sub-units, J. Mach. Learn Res. Vol. 13 (2012), 2205–2231, JMLR. Web of Science, Google Scholar
6. P. Dreuw, P. Steingrube, T. Deselaers and H. Ney, Smoothed disparity maps for continuous american sign language recognition, Pattern Recognition and Image Analysis, Lect. Notes Comput. Sci. (Springer, 2009), Vol. 5524: pp. 24–31 . Crossref, Google Scholar
7. N. Efford, Digital image processing: A practical introduction using Java, Chapter 11 Morphological Image Processing (Pearson Education, 2000). Google Scholar
8. Ershaed, I. Al-Alali, N. Khasawneh and M. Fraiwan, An arabic sign language computer interface using the xbox kinect, Annual Undergraduate Research Conf. on Applied Computing, May 4–5, 2011, Dubai, UAE. Google Scholar
9. J. A. Hartigan and M. A. Wong, Algorithm AS 136: A k-means clustering algorithm, J. R. Stat. Soc. Series C 28(1) (1979) 100–108. JSTOR 2346830. Crossref, Google Scholar
10. E. G. Hintz, M. Jones, J. Lawler and N. Bench, Recognition of American sign language (ASL) classifiers in a planetarium using a head-mounted display, American Astronomical Society Meeting Abstracts (AA5, 2015) Vol. 225. Google Scholar
11. S. Kausar, M. Younus Javed and S. Sohail, Recognition of gestures in Pakistani sign language using fuzzy classifier, 8th Conference on Signal Processing, Computational Geometry and Artificial Vision 2008 (Rhodes, Greece), pp. 101–105. Google Scholar
12. S. Kausar, M. Younus Javed, A survey on sign language recognition, 9th International conference on Frontiers of Information Technology, 19–21 December 2011, Islamabad, Pakistan, pp. 95–98. Google Scholar
13. S. Kausar, M. Y. Javed and S. Tehsin, Empirical analysis of signature-based sign language recognition, The Imaging Science Journal, submitted (17th July 2013). Google Scholar
14. Y. Li, X. Chen, X. Zhang, K. Wang and Z. Jane Wang, A sign-component-based framework for chinese sign language recognition using accelerometer and sEMG data, in IEEE T. Bio-Med. Eng., Vol. 59 (IEEE, 2012). Google Scholar
15. D. MacKay, Chapter 20, An example inference task: Clustering, Information Theory, Inference and Learning Algorithms, (Cambridge University Press, 2003), pp. 284–292, ISBN 0-521-64298-1. MR 2012999. Google Scholar
16. M. Mohandes, S. Aliyu and M. Deriche, Prototype arabic sign language recognition using multi-sensor data fusion of two leap motion controllers, 2015 12th International Multi-Conference on Systems, Signals & Devices (SSD) (IEEE, (2015), pp. 1–6. Google Scholar
17. S. P. Priyal and P. K. Bora, A robust static hand gesture recognition system using geometry based normalizations and Krawtchouk moments, Pattern Recognition Lect. Notes Comput. Sci 46 (2013) 2202–2219. Crossref, Web of Science, Google Scholar
18. A. Samir Elons, M. Abull-ela and M. F. Tolba, A proposed PCNN features quality optimization technique for pose-invariant 3D Arabic sign language recognition, in Appl. Soft Comput., Vol. 13 (Elsevier, 2013), pp. 1646–1660. Google Scholar
19. X. Shijian, X. Jie, T. Yijun and S. Likai, Design of the portable gloves for sign language recognition, in Advances in Computer Science and Education Applications Communications in Computer and Information Science, Vol. 202 (Springer, 2011), pp. 171–177. Google Scholar
20. T. T. Swee, A. K. Ariff, S.-H. Salleh, S. K. Seng and L. S. Huat, Wireless data gloves Malay sign language recognition system, Proceeding of 6th International Conference on Information, Communications & Signal Processing, IEEE (2007), pp. 171–177. Google Scholar
21. J. Wu, Z. Tian, L. Sun, L. Estevez and R. Jafari, Real-time American sign language recognition using wrist-worn motion and surface EMG sensors, 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN), IEEE, (2015), pp. 1–6. Google Scholar
22. F. Yin, X. Chai, Y. Zhou and X. Chen, Semantics constrained dictionary learning for signer-independent sign language recognition, 2015 IEEE International Conference on Image Processing (ICIP), IEEE, (2015), pp. 3310–3314. Google Scholar
23. Zafrulla, H. Brashear, T. Starner, H. Hamilton and P. Presti, American sign language recognition with the kinect, Proceedings of the 13th International Conference on Multimodal Interfaces, ICMI '11, (New York, NY, USA, 2011), pp. 279–286. Google Scholar