Narrow Results

Sign language recognition (SLR) has got wide applicability. SLR system is considered to be a challenging one. This paper presents empirical analysis of different mathematical models for Pakistan SLR (PSLR). The proposed method is using the parameterization of sign signature. Each sign is represented with a mathematical function and then coefficients of these functions are used as the feature vector. This approach is based on exhaustive experimentation and analysis for getting the best suitable mathematical representation for each sign. This extensive empirical analysis, results in a very small feature vector and hence to a very efficient system. The robust proposed method has got general applicability as it just need a new training set and it can work equally good for any other dataset. Sign set used is quite complex in the sense that intersign similarity distance is very small but even then proposed methodology has given quite promising results.

This paper investigates the role of interaction and communication kinesics in human–robot interaction. This study is part of a novel research project on sign language (SL) tutoring through interaction games with humanoid robots. The main goal is to motivate the children with communication problems to understand and imitate the signs implemented by the robot using basic upper torso gestures and sound. We present an empirical and exploratory study investigating the effect of basic nonverbal gestures consisting of hand movements, body and face gestures expressed by a humanoid robot, and having comprehended the word, the participants will give relevant feedback in SL. This way the participant is both a passive observer and an active imitator throughout the learning process in different phases of the game. A five-fingered R3 robot platform and a three-fingered Nao H-25 robot are employed within the games. Vision-, sound-, touch- and motion-based cues are used for multimodal communication between the robot, child and therapist/parent within the study. This paper presents the preliminary results of the proposed game tested with adult participants. The aim is to evaluate the SL learning ability of participants from a robot, and compare different robot platforms within this setup.