Manuscript received April 4, 2022; revised August 5, 2022; accepted September 7, 2022.

Abstract—One of the popular methods for the recognition of human emotions such as happiness, sadness and shock is based on the movement of facial features. Motion vectors that show these movements can be calculated by using optical flow algorithms. In this method, for detecting emotions, the resulted set of motion vectors is compared with a standard facial movement template caused by human emotional changes. In this paper, a new method is introduced to compute the quantity of likeness towards a particular emotion to make decisions based on the importance of obtained vectors from an optical flow approach. The current study uses a feature point tracking technique separately applied to the five facial image regions (eyebrows, eyes, and mouth) to identify basic emotions. Primarily, this research will be focusing on eye movement regions. For finding the vectors, one of the efficient optical flow methods is using the pre-experiment as explained further below.

Keywords—human emotion, eye movement features, optical flow, motion vectors

Cite: Tuan Khalisah Tan Zizi, Suzaimah Ramli, Muslihah Wook, and Mohd Afizi Mohd Shukran, "Optical Flow-Based Algorithm Analysis to Detect Human Emotion from Eye Movement-Image Data," Journal of Image and Graphics, Vol. 11, No. 1, pp. 53-60, March 2023.

Copyright © 2023 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.