Narrow Results

Emotion estimation systems based on brain and physiological signals such as electro encephalography (EEG), blood-volume pressure (BVP), and galvanic skin response (GSR) are gaining special attention in recent years due to the possibilities they offer. The field of human–robot interactions (HRIs) could benefit from a broadened understanding of the brain and physiological emotion encoding, together with the use of lightweight software and cheap wearable devices, and thus improve the capabilities of robots to fully engage with the users emotional reactions. In this paper, a previously developed methodology for real-time emotion estimation aimed for its use in the field of HRI is tested under realistic circumstances using a self-generated database created using dynamically evoked emotions. Other state-of-the-art, real-time approaches address emotion estimation using constant stimuli to facilitate the analysis of the evoked responses, remaining far from real scenarios since emotions are dynamically evoked. The proposed approach studies the feasibility of the emotion estimation methodology previously developed, under an experimentation paradigm that imitates a more realistic scenario involving dynamically evoked emotions by using a dramatic film as the experimental paradigm. The emotion estimation methodology has proved to perform on real-time constraints while maintaining high accuracy on emotion estimation when using the self-produced dynamically evoked emotions multi-signal database.

In the future manned lunar exploration mission, astronauts would work with the lunar robots, which has a high requirement for human–robot interaction (HRI). As the accuracy of gesture recognition interaction does not fulfill the requirement for human–robot joint exploration missions, we propose the DMS-SK/BLSTM-CTC hybrid network to improve the performance of HRI. For gesture recognition, considering VGG-SK has low accuracy and complex architecture, we delete the fourth convolution module, optimize the last global pooling layer, introduce dilated convolution block and multiscale convolution block in VGG-SK, and get the DMS-SK-based gesture recognition sub-network. Compared with the traditional recognition methods, the accuracy and performance of DMS-SK improve. For speech recognition, considering that Bidirectional long–short-term memory unit (BLSTM) has the advantages of processing temporal information, and the Connectionist Temporal Classification (CTC) algorithm can simplify speech data preprocessing, we use BLSTM based on CTC as the speech recognition sub-network. Finally, we combine DMS-SK with BLSTM-CTC, and propose the DMS-SK/BLSTM-CTC hybrid network as the gesture/speech hybrid network. In addition, we use 10 gestures in the American Sign Language (ASL) dataset and 10 speech commands to construct the gesture/speech hybrid dataset. Experimental results show that compared with the pure gesture or pure speech networks, the recognition accuracy of the gesture-speech hybrid network improves by 2% and 12%, respectively, its accuracy reaches 97.38%, which fulfills the requirement of astronauts for HRI.

Compliance control is highly relevant to human safety in human–robot interaction (HRI). This paper presents a review of various compliance control techniques. The paper is aimed to provide a good background knowledge for new researchers and highlight the current hot issues in compliance control research. Active compliance, passive compliance, adaptive and reinforcement learning-based compliance control techniques are discussed. This paper provides a comprehensive literature survey of compliance control keeping in view physical human robot interaction (pHRI) e.g., passing an object, such as a cup, between a human and a robot. Compliance control may eventually provide an immediate and effective layer of safety by avoiding pushing, pulling or clamping in pHRI. Emerging areas such as soft robotics, which exploit the deformability of biomaterial as well as hybrid approaches which combine active and passive compliance are also highlighted.

Compliance control is highly relevant to human safety in human–robot interaction (HRI). This paper presents multi-dimensional compliance control of a humanoid robot arm. A dynamic model-free adaptive controller with an anti-windup compensator is implemented on four degrees of freedom (DOF) of a humanoid robot arm. The paper is aimed to compliment the associated review paper on compliance control. This is a model reference adaptive compliance scheme which employs end-effector forces (measured via joint torque sensors) as a feedback. The robot's body-own torques are separated from external torques via a simple but effective algorithm. In addition, an experiment of physical human robot interaction is conducted employing the above mentioned adaptive compliance control along with a speech interface. The experiment is focused on passing an object (a cup) between a human and a robot. Compliance is providing an immediate layer of safety for this HRI scenario by avoiding pushing, pulling or clamping and minimizing the effect of collisions with the environment.

Cognitive psychology is a science of human knowledge, which means that people perceive, acquire, memorize, think, and comprehend intellectual capabilities. The psychological strategy involves controlling every action and status of the human body. The problematic states of psychological facts include mental disorders like depression, stress, anxiety, and inferiority complex, leading to memory loss. The emerged technique of cognitive psychological managing framework using artificial intelligence (CPMF-AI) is introduced. The proposed framework is extended to forecast the psychological standards of the human brain for practical well-being. There are four methods to monitor memory power, stress, and other human mental disorders. They are distant neural systems (DNS), convolutional psychology tracking systems (CPTS), intelligent neural systems (INS), and memory-building strategies (MBS). Besides language aspects, physical aspects play a vital part in human–robot interaction (HRI) and make the difference compared to the more limited HRI communication. These methodologies are integrated into four case studies to detect neural passage systems for monitoring mental issues. The simulation analysis helps enhance the framework’s accuracy and minimize the error rate. Thus, the proposed system of cognitive technology is comparatively better than the existing methods.

We present a novel qualitative, dynamic length sliding window method which enables a mobile robot to temporally segment activities taking place in live RGB-D video. We demonstrate how activities can be learned from observations by encoding qualitative spatio-temporal relationships between entities in the scene. We also show how a Nearest Neighbour model can recognise activities taking place even if they temporally co-occur. Our system is validated on a challenging dataset of daily living activities.