Original Article

A New Approach for Lie Detection Using Non-Linear and Dynamic Analysis of Video-Based Eye Movement

Abstract

Purpose: This study aimed to evaluate a lie-detection system by non-linear analysis of video-based eye movement.

Materials and Methods: The physiological signals, as well as video-based eye movement in horizontal and vertical channels, were recorded based on a Control Question Test (CQT). The dynamics of eye movement signals were then analyzed by Recurrence Quantification Analysis (RQA). Statistical analysis was performed by ANOVA and Linear Discriminate Analysis (LDA).

Results: In this study, 40 subjects participated. The statistical analysis results of vertical eye movement indicated that ENT measures increased significantly for relevant questions in comparison to other questions. Moreover, a significant increase was observed in all RQA parameters except Lmax and DET for horizontal eye movement. The results of LDA using psychophysiology features. The accuracy percentage of 78.4% and 81.86% were obtained for lie detection using physiological signals and optimal RQA parameters of video-based eye movements, respectively.

Conclusion: The accuracy of lie detection by significant RQA parameters was more than the accuracy of physiological signals. So, the results of this study illustrate that the dynamic technique is well suited to analyze eye movement signals under stress and it could be recommended as a useful method in lie detection.

1- Kyosuke Fukuda, "Eye blinks: new indices for the detection of deception." International Journal of Psychophysiology, Vol. 40 (No. 3), pp. 239-45, (2001).
2- David Thoreson Lykken, A tremor in the blood: Uses and abuses of the lie detector. Plenum Press, (1998).
3- Matthias Gamer, Hans-Georg Rill, Gerhard Vossel, and Heinz Werner Gödert, "Psychophysiological and vocal measures in the detection of guilty knowledge." International Journal of Psychophysiology, Vol. 60 (No. 1), pp. 76-87, (2006).
4- David Carmel, Eran Dayan, Ayelet Naveh, Ori Raveh, and Gershon Ben-Shakhar, "Estimating the validity of the guilty knowledge test from simulated experiments: the external validity of mock crime studies." Journal of Experimental Psychology: Applied, Vol. 9 (No. 4), p. 261, (2003).
5- RE Lubow and Ofer Fein, "Pupillary size in response to a visual guilty knowledge test: New technique for the detection of deception." Journal of Experimental Psychology: Applied, Vol. 2 (No. 2), p. 164, (1996).
6- John A Podlesny and David C Raskin, "Physiological measures and the detection of deception." Psychological bulletin, Vol. 84 (No. 4), p. 782, (1977).
7- Vahid Abootalebi, Mohammad Hassan Moradi, and Mohammad Ali Khalilzadeh, "A comparison of methods for ERP assessment in a P300-based GKT." International Journal of Psychophysiology, Vol. 62 (No. 2), pp. 309-20, (2006).
8- Anders Eriksson and Francisco Lacerda, "Charlatanry in forensic speech science: A problem to be taken seriously." International Journal of Speech, Language and the Law, Vol. 14 (No. 2), pp. 169-93, (2007).
9- Kevin K Park, Hye Won Suk, Heungsun Hwang, and Jang-Han Lee, "A functional analysis of deception detection of a mock crime using infrared thermal imaging and the Concealed Information Test." Frontiers in human neuroscience, Vol. 7, p. 70, (2013).
10- Ioannis Pavlidis and James Levine, "Thermal image analysis for polygraph testing." IEEE Engineering in Medicine and Biology Magazine, Vol. 21 (No. 6), pp. 56-64, (2002).
11- K Luan Phan, Alvaro Magalhaes, Timothy J Ziemlewicz, Daniel A Fitzgerald, Christopher Green, and Wilbur Smith, "Neural correlates of telling lies: A functional magnetic resonance imaging study at 4 Tesla1." Academic radiology, Vol. 12 (No. 2), pp. 164-72, (2005).
12- Tatia MC Lee et al., "Lie detection by functional magnetic resonance imaging." Human brain mapping, Vol. 15 (No. 3), pp. 157-64, (2002).
13- J Peter Rosenfeld, Joel Ellwanger, and Jerry Sweet, "Detecting simulated amnesia with event-related brain potentials." International Journal of Psychophysiology, Vol. 19 (No. 1), pp. 1-11, (1995).
14- Frank M Marchak, Tanner L Keil, Jennifer E McMillan, and Pamela S Westphal, "Ocular-based measures of malintent." in Psychophysiology, (2011), Vol. 48: WILEY-BLACKWELL COMMERCE PLACE, 350 MAIN ST, MALDEN 02148, MA USA, pp. S10-S10.
15- Anne E Cook et al., "Lyin'eyes: ocular-motor measures of reading reveal deception." Journal of Experimental Psychology: Applied, Vol. 18 (No. 3), p. 301, (2012).
16- Gershon Ben-Shakhar, "A critical review of the Control Questions Test (CQT)." Handbook of polygraph testing, Vol. 103(2002).
17- Mohamad Amin Younessi Heravi, Morteza Pishghadam, Hosnieh Raoufian, and Akram Gazerani, "Recurrence quantification analysis of electrooculography signal to a control question test: A new approach for the detection of deception." Biomedical Engineering: Applications, Basis and Communications, Vol. 32 (No. 04), p. 2050029, (2020).
18- Jason Geller, Matthew B Winn, Tristian Mahr, and Daniel Mirman, "GazeR: A package for processing gaze position and pupil size data." Behavior research methods, Vol. 52 (No. 5), pp. 2232-55, (2020).
19- John Daugman, "How iris recognition works." in The essential guide to image processing: Elsevier, (2009), pp. 715-39.
20- Norbert Marwan, Encounters with neighbours: current developments of concepts based on recurrence plots and their applications. Norbert Marwan, (2003).
21- Charles L Webber Jr and Joseph P Zbilut, "Recurrence quantification analysis of nonlinear dynamical systems." Tutorials in contemporary nonlinear methods for the behavioral sciences, Vol. 94 (No. 2005), pp. 26-94, (2005).
22- Rui Guo, Yiqin Wang, Jianjun Yan, and Hanxia Yan, "Recurrence quantification analysis on pulse morphological changes in patients with coronary heart disease." Journal of Traditional Chinese Medicine, Vol. 32 (No. 4), pp. 571-77, (2012).
23- Elio Conte, "Methods and Applications of Non-Linear Analysis in Neurology and Psycho-physiology." Journal of Consciousness Exploration and Research, Vol. 1 (No. 9), (2012).
24- National Research Council, "Committee to review the scientific evidence on the polygraph." The polygraph and lie detection, (2003).
Files
IssueVol 10 No 1 (2023) QRcode
SectionOriginal Article(s)
DOI https://doi.org/10.18502/fbt.v10i1.11516
Keywords
Recurrence Quantification Analysis Eye Movement Physiological Signals Control Question Test
Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
1.
Younessi Heravi MA, Pishghadam M, Khoshdel E, Zibaei S. A New Approach for Lie Detection Using Non-Linear and Dynamic Analysis of Video-Based Eye Movement. Frontiers Biomed Technol. 2022;10(1):88-95.