Special Issue on Biomedical Engineering and Applied ComputingNo Access

EMOTIONAL STRESS RECOGNITION SYSTEM FOR AFFECTIVE COMPUTING BASED ON BIO-SIGNALS

Seyyed Abed Hosseini

Faculty of Engineering / Islamic Azad University Mashhad Branch, Mashhad, Iran

Search for more papers by this author

Mohammad Ali Khalilzadeh

Faculty of Engineering / Islamic Azad University Mashhad Branch, Mashhad, Iran

Search for more papers by this author

, and

Sahar Changiz

Islamic Art, Tabriz Islamic Art University, Tabriz, Iran

M.Sc. Student in Islamic Art.

Search for more papers by this author

https://doi.org/10.1142/S0218339010003640Cited by:44 (Source: Crossref)

Abstract

In this paper, we propose a new approach to classify emotional stress in the two main areas of the valance-arousal space by using bio-signals. Since electroencephalogram (EEG) is widely used in biomedical research, it is used as the main signal. We designed an efficient acquisition protocol to acquire the EEG and psychophysiological. Two specific areas of the valence-arousal emotional stress space are defined, corresponding to negatively excited and calm-neutral states. Qualitative and quantitative evaluation of psychophysiological signals have been used to select suitable segments of EEG signal for improving efficiency and performance of emotional stress recognition system. After pre-processing the EEG signals, wavelet coefficients and chaotic invariants like fractal dimension, correlation dimension and wavelet entropy were used to extract the features of the signal. So, by using independent-sample T-Test and Linear Discriminate Analysis (LDA), effective features are selected. The results show that, the average classification accuracy were 80.1% and 84.9% for two categories of emotional stress states using the LDA and Support Vector Machine (SVM) classifiers respectively. We achieved an improvement in accuracy, in compared to our previous studies in the similar field. Therefore, this new fusion link between EEG and psychophysiological signals are more robust in comparison to the separate signals.

Keywords:

References

S. Reisman, Measurement of Physiological Stress, Proceedings of the IEEE, 23rd Northeast Bioengineering Conference (1997) pp. 21–23. Google Scholar
T. V. Sagaret al., Characterization and Incorporation of Emotions in Speech, Annual India Conference of the IEEE (2006) pp. 1–5. Google Scholar
Horlings R, Emotion recognition using brain activity, Delft University of Technology, Faculty of Electrical Engineering, Mathematics, and Computer Science, Man-Machine Interaction Group, March 2008 . Google Scholar
R. R. Cornelius , Theoretical approaches to emotion , Proceedings of the International Speech Communication Association (ISCA) Workshop on Speech and Emotion ( 2000 ) . Google Scholar
Savran A, Ciftci K, Chanel G, Mota JC, Viet LH, Sankur B, Akarun L, Caplier A, and Rombaut M, Emotion Detection in the Loop from Brain Signals and Facial Images, Final Project Report, eNTERFACE'06, Dubrovnik, Croatia, 2006 . Google Scholar
Hosseini SA, Quantification of EEG signals for evaluation of emotional stress level, M.Sc. thesis, Biomedical Department, Faculty of Engineering, Islamic Azad University Mashhad Branch, November 2009 . Google Scholar
G. Chanel, K. Ansari-Asl and T. Pun, Valence-arousal evaluation using physiological signals in an emotion recall paradigm, IEEE International Conference on Systems, Man and Cybernetics ISIC (2007) pp. 2662–2667. Google Scholar
S. A. Hosseini , M. B. Naghibi-Sistani and S. Rahati-quchani , dissection and analysis of psychophysiological and EEG signals for emotional stress evaluation , 12th Iranian Students Conference on Electrical Engineering ( 2009 ) . Google Scholar
S. A. Hosseini and M. A. Khalilzadeh, Emotional stress recognition system using EEG and psychophysiological signals: Using new labeling process of EEG signals in emotional stress state, Proceedings of the IEEE, The International Conference on Biomedical Engineering and Computer Science (2010) pp. 90–95. Google Scholar
Nasrabadi AM, Quantitative and qualitative evaluation of consciousness variation and depth of hypnosis through intelligent processing of EEG signal, Ph.D. thesis, Amirkabir University of Technology, 1382 . Google Scholar
S. A. Hosseini et al. , Higher Order Spectra Analysis of EEG Signals in Emotional Stress States , The 2nd International Conference on Information Technology and Computer Science ( 2010 ) . Google Scholar
Hosseini SA, Khalilzadeh MA, Homam SM, and Azarnoosh M, Emotional stress detection using nonlinear and higher order spectra features in EEG signal, Journal of Electrical Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, 1388. (Article in Persian) . Google Scholar
G. Chanelet al., International Journal Human-Computer Studies 67, 607 (2009). Crossref, Web of Science, Google Scholar
K. H. Kim, S. W. Bang and S. R. Kim, Medical & Biological engineering & Computing 42, 419 (2004). Crossref, Web of Science, Google Scholar
K. Takahashi , Remarks on Emotion Recognition from Bio-Potential Signals , Proceedings of the 2nd International Conference on Autonomous Robots and Agents ( 2004 ) . Google Scholar
J. Zhaiet al., Realization of Stress Detection using Psychophysiological Signals for Improvement of Human-Computer Interactions, Proceedings of the IEEE Southeast Conference (2005) pp. 415–420. Google Scholar
M. Soleymani et al. , Affective Characterization of Movie Scenes Based on Multimedia Content Analysis and User's Physiological Emotional Responses , Tenth IEEE International Symposium on Multimedia ( 2008 ) . Google Scholar
Dharmawan Z, Analysis of Computer Games Player Stress Level Using EEG Data, M.Sc. thesis, Delft University of Technology, Netherlands, August 2007 . Google Scholar
Lang PJ, Bradley MM, and Cuthbert BN, International affective Picture System (IAPS): Affective ratings of pictures and instruction manual, Technical Report A-6, University of Florida, Gainesville, FL, 2005 . Google Scholar
http://www.unifesp.br/dpsicobio/adap/exemplos_fotos.htm . Google Scholar
B. J. Sadock, H. Kaplan and V. A. Sadock, Synopsis of Psychiatry: Behavioral Sciences/Clinical Psychiatry, 8th edn. (Lippincott Williams & Wilkins, 1998). Google Scholar
http://www.thoughttechnology.com/flexinf.htm . Google Scholar
S. A. Hosseiniet al., Journal of Advances in Cognitive Science 12(1), 1 (2010). Web of Science, Google Scholar
R. D. Wan and L. J. Woo, Computing and Technology 2, 317 (2004). Web of Science, Google Scholar
C. J. C. Burges, Data Mining and Knowledge Discovery 2, 121 (1998). Crossref, Web of Science, Google Scholar
http://www.kernel-machines.org/software.html . Google Scholar
Chang CC and Lin CJ, LIBSVM: a Library for Support Vector Machines, 2009. Software available at URL http://www.csie.ntu.edu.tw/~cjlin/libsvm/ . Google Scholar
O. Chapello, P. Haffner and V. Vapnik, IEEE Transactions on Neural Networks 10(5), 1055 (1999). Crossref, Web of Science, Google Scholar
N. Kannathal, K. S. Puthusserypady and L. C. Min, Complex Dynamics of Epileptic EEG, Proceedings of the IEEE, The 26th Annual International Conference of the EMBS (2004) pp. 604–607. Google Scholar
M. Murugappanet al., International Journal of Biomedical Soft Computing and Human Sciences 14(2), 35 (2009). Google Scholar
A. Konar , Artificial Intelligence and Soft Computing: Behavioral and Cognitive Modeling of the Human Brain ( CRC Press , Boca Raton, Florida , 2000 ) . Google Scholar