Emotion Extraction From Video Fragments Using Gaze Tracking and Adaboost Classifier

The application of communication between human and computer has been emerging as an important matter in communication with the surrounding environment. if the computer could sense the human’s emotion, it would be easier to establish a connection between the computer and human. therefore, the extraction of emotions is an important topic in communication between them. for extracting an emotion, which is absolutely undeniable, various biological signals are used. one of the simple and high-precision methods to acquire data from these signals is to implement the eye tracking and the concentration on the screen technique. in this paper, the eye tracking technique is used to extract emotions for the communication between the human and computer. according to the acquired data from the persons and videos, some of the characteristics of signals, including focus areas, pupil diameter, statistical features, and features of videos are extracted. in addition, in order to improve the results, combining the features are proposed. afterwards, based on two distinct outputs i.e. arousal and valence, and employing a linear combination and reducing the dimension, some features are selected separately. finally, to classify the two-axes associated with the arousal and valence in the range of 0 to 9, which is divided into three equal parts; special types of knn and svm methods combined with adaboost classifier are used. the numerical studies have shown that the average extraction accuracy is 68.66% for arousal axis, and 74.66% for valence axis. as a result, the overall accuracy is improved 5.5% compared to the previous works, respectively.