Design of Prototype-Based Emotion Recognizer Using Physiological Signals

ETRI Journal

关键词: particle swarm optimization;    feature selection;    prototypes;    physiological signal;    Emotion recognition;   

Others  :  1193708
DOI  :  10.4218/etrij.13.0112.0751

【 摘 要 】

This study is related to the acquisition of physiological signals of human emotions and the recognition of human emotions using such physiological signals. To acquire physiological signals, seven emotions are evoked through stimuli. Regarding the induced emotions, the results of skin temperature, photoplethysmography, electrodermal activity, and an electrocardiogram are recorded and analyzed as physiological signals. The suitability and effectiveness of the stimuli are evaluated by the subjects themselves. To address the problem of the emotions not being recognized, we introduce a methodology for a recognizer using prototype-based learning and particle swarm optimization (PSO). The design involves two main phases: i) PSO selects the P% of the patterns to be treated as prototypes of the seven emotions; ii) PSO is instrumental in the formation of the core set of features. The experiments show that a suitable selection of prototypes and a substantial reduction of the feature space can be accomplished, and the recognizer formed in this manner is characterized by high recognition accuracy for the seven emotions using physiological signals.

   

【 参考文献 】

• [1]J. Wagner, J. Kim, and E. Andre, "From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification," IEEE Int. Conf. Multimedia Expo, Amsterdam, July 2005, pp. 940-943.
• [2]N. Sebe, I. Cohen, and T.S. Huang, "Multimodal Emotion Recognition," Handbook of Pattern Recognition and Computer Vision, Amsterdam: Publications of the Universiteit van Amsterdam, 2005.
• [3]L. Li and J. Chen, "Emotion Recognition Using Physiological Signals," ICAT, 2006, pp. 437-446.
• [4]E.L. Meerwijk and S.J. Weiss, "Toward a Unifying Definition of Psychological Pain," J. Loss Trauma, vol. 16, no. 5, 2011, pp. 402-412.
• [5]S.D. Kreibig, "Autonomic Nervous System Activity in Emotion: A Review," Bio. Psychology, vol. 84, 2010, pp. 394-421.
• [6]T. Verhoef et al., "Bio-sensing for Emotional Characterization without Word Labels," 13th Int. Conf. Human-Comput. Interaction: Ambient, Ubiquitous, Intell. Interaction, San Diego, CA, USA, July 2009, pp. 693-702.
• [7]C. Maaoui and A. Pruski, "Emotion Recognition through Physiological Signals for Human-Machine Communication," Cutting Edge Robotics 2010, Vedran Kordic, Ed., 2010, pp. 317-322.
• [8]C.L. Stephens, I.C. Christie, and B.H. Friedman, "Autonomic Specificity of Basic Emotions: Evidence from Pattern Classification and Cluster Analysis," Bio. Psychology, vol. 84, 2010, pp. 463-473.
• [9]E.-H. Jang et al., "Emotion Recognition by Machine Learning Algorithms Using Psychophysiological Signals," Int. J. Eng. Industries, vol. 3, no. 1, 2012, pp. 55-66.
• [10]B.-J. Park et al., "Seven Emotion Recognition by Means of Particle Swarm Optimization on Physiological Signals," Proc. 9th IEEE Int. Conf. Netw., Sensing, Control, 2012, pp. 277-282.
• [11]C.M. Bishop, Neural Networks for Pattern Recognition, New York: Oxford University Press Inc., 1995.
• [12]J. Kennedy, "The Particle Swarm: Social Adaptation of Knowledge," Proc. IEEE Int. Conf. Evolutionary Comput., 1997, pp. 303-308.
• [13]K.E. Parsopoulos and M.N. Vrahatis, "On the Computation of All Global Minimizers through Particle Swarm Optimization," IEEE Trans. Evolutionary Comput., vol. 8, 2004, pp. 211-224.
• [14]C.L. Huang and C.J. Wang, "A GA-Based Feature Selection and Parameters Optimization for Support Vector Machines," Expert Syst. Appl., vol. 31, 2006, pp. 231-240.
• [15]H. Cheng et al., "Conditional Mutual Information-Based Feature Selection Analyzing for Synergy and Redundancy," ETRI J., vol. 33, no. 2, Apr. 2011, pp. 210-218.
• [16]J.X. Huang et al., "Feature-Based Relation Classification Using Quantified Relatedness Information," ETRI J., vol. 32, no. 3, June 2010, pp. 482-485.
• [17]D.W. Aha, D. Kibler, and M.K. Albert, "Instance-Based Learning Algorithms," Machine Learning, vol. 6, 1991, pp. 37-66.
• [18]C. Gonzalez and V. Dutt, "Instance-Based Learning: Integrating Sampling and Repeated Decisions from Experience," Psychological Rev., vol. 118, 2011, pp. 523-551.
• [19]D. Palomba et al., "Cardiac Responses Associated with Affective Processing of Unpleasant Film Stimului," Int. J. Psychophysiology, vol. 36, 2000, pp. 45-57.
• [20]J.J. Gross and R.W. Levenson, "Emotion Elicitation Using Films," Cognition Emotion, vol. 9, 1995, pp. 87-108.
• [21]A. Gorini and G. Riva, "The Potential of Virtual Reality as Anxiety Management Tool: A Randomized Controlled Study in a Sample of Patients Affected by Generalized Anxiety Disorder," Trials, vol. 9, 2008, pp. 1-9.
• [22]J. Arroyo-Palacios and D.M. Romano, "Towards a Standardization in the Use of Physiological Signals for Affective Recognition Systems," Proc. Meas. Behavior, Aug. 2008, pp. 121-124.
• [23]M. Toichi et al., "The Influence of Psychotic States on the Autonomic Nervous System in Schizophrenia," Int. J. Psychophysiology, vol. 31, 1999, pp. 147-154.
• [24]M.A. Abido, "Optimal Design of Power-System Stabilizers Using Particle Swarm Optimization," IEEE Trans. Energy Conversion, vol. 17, 2002, pp. 406-413.
• [25]B. Liu et al., "Improved Particle Swarm Optimization Combined with Chaos," Chaos, Solitons, Fractals, vol. 25, 2005, pp. 1261-1271.
• [26]A.E. Yilmaz and M. Kuzuoglu, "Calculation of Optimized Parameters of Rectangular Microstrip Patch Antenna Using Particle Swarm Optimization," Microw. Opt. Technol. Lett., vol. 49, 2007, pp. 2905-2907.
• [27]Z.L. Gaing, "A Particle Swarm Optimization Approach for Optimum Design of PID Controller in AVR System," IEEE Trans. Energy Conversion, vol. 19, 2004, pp. 384-391.
• [28]R. Eberhart and Y. Shi, "Particle Swarm Optimization: Developments, Applications and Resources," Proc. IEEE Int. Conf. Evolutionary Comput., 2001, pp. 81-86.
• [29]W.-Y. Loh, "Classification and Regression Trees," Wiley Interdisciplinary Rev: Data Mining Knowl. Discovery, vol. 1, 2011, pp. 14-23.
• [30]J.R. Quinlan, C4.5: Programs for Machine Learning, San Mateo, CA: Morgan Kaufmann, 1992.
• [31]R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, 2nd ed., New York: Wiley-Interscience, 2000.
• [32]J.M. Keller, M.R. Gray, and J.A. Givens, Jr., "A Fuzzy K-Nearest Neighbor Algorithm," IEEE Trans. Syst., Man, Cybern., vol. 15, no. 4, 1985, pp. 580-585.
• [33]M.M Van Hulle, "Self-Organizing Maps," Handbook of Natural Computing: Theory, Experiments, and Applications, Springer-Verlag, 2010.