Improving the Classification of Real-World SSVEP Data in Brain-Computer Interface Speller Systems Using Deep Convolutional Neural Networks
,
Abstract
Purpose: Brain-Computer Interface (BCI) Speller systems help people with mobility impairments improve their cognitive and physical abilities. Steady-State Visual Evoked Potential (SSVEP) signals have been used to build high-speed BCI speller systems. SSVEP signals are a subtype of Visual Evoked Potential (VEP), a form of co-frequency, and the harmonics response elicited by a specific frequency stimulus. Noise and artifacts are critical issues for target detection in SSVEP-based BCI systems.
Materials and Methods: Thus, it is essential to provide target detection techniques that operate well in the presence of noises. One solution for overcoming the noise impact is to employ approaches that automatically extract the appropriate features for target detection from the training data. Deep Convolutional Neural Network (DCNN) was utilized in this study to automatically extract features from SSVEP data in noisy conditions. Moreover, the BETA database, which contains SSVEP data from 70 individuals collected outside of the electromagnetic shielding room, was used. In this regard, a suitable DCNN structure for target stimulus frequency identification was first designed. The network was pre-trained with part of the data from the BETA database. Finally, at the single-subject level, this pre-trained network was retrained and evaluated.
Results: The results showed that after retraining, the accuracy and Information Transfer Rate (ITR) increased (p-value < 0.01) for all participants.
Conclusion:.The enhancement in accuracy and ITR are 25.72% and 43.10 bpm, respectively.
2- Shakib Sara Sepehri and Ghassemi Farnaz, "Investigating the Effect of Stimulus Type on Electroencephalogram Signal in a Brain-Computer Interface System with Interaction Error." Frontiers in Biomedical Technologies, Vol. 9 (No. 2), 03/04 (2022).
3- Kang-min Choi, Seonghun Park, and Chang-Hwan Im, "Comparison of Visual Stimuli for Steady-State Visual Evoked Potential-Based Brain-Computer Interfaces in Virtual Reality Environment in terms of Classification Accuracy and Visual Comfort." Computational Intelligence and Neuroscience, Vol. 2019p. 9680697, 2019/07/01 (2019).
4- Aya Rezeika, Mihaly Benda, Piotr Stawicki, Felix Gembler, Abdul Saboor, and Ivan Volosyak, "Brain–Computer Interface Spellers: A Review." Brain Sciences, Vol. 8 (No. 4), (2018).
5- Aung Aung Phyo Wai et al., "Towards a Fast Steady-State Visual Evoked Potentials (SSVEP) Brain-Computer Interface (BCI)." ArXiv, Vol. abs/2002.01171(2020).
6- Elham Rostami and Farnaz Ghassemi, "Investigation of the Effect of Attention in BCI systems based on Steady_State Visually Evoked Potential." Presented at the Conference: 8th Basic and Clinical Neuroscience Congress, Iran University of Medical., (1398).
7- No-Sang Kwak, Klaus-Robert Müller, and Seong-Whan Lee, "A convolutional neural network for steady state visual evoked potential classification under ambulatory environment." PLOS ONE, Vol. 12 (No. 2), p. e0172578, (2017).
8- Eisuke Hanada and Takato Kudou, "Electromagnetic noise in the clinical environment." Peoceedings of ISMICT2009, 02/25 (2009).
9- Zhonglin Lin, Changshui Zhang, Wei Wu, and Xiaorong Gao, "Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs." IEEE transactions on biomedical engineering, Vol. 53 (No. 12), pp. 2610-14, (2006).
10- Xiaogang Chen, Yijun Wang, Shangkai Gao, Tzyy-Ping Jung, and Xiaorong Gao, "Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface." Journal of Neural Engineering, Vol. 12 (No. 4), p. 046008, 2015/06/02 (2015).
11- M. Nakanishi, Y. Wang, X. Chen, Y. T. Wang, X. Gao, and T. P. Jung, "Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis." (in eng), IEEE transactions on bio-medical engineering, Vol. 65 (No. 1), pp. 104-12, Jan (2018).
12- Elham Rostami, Farnaz Ghassemi, and Zahra Tabanfar, "Canonical Correlation Analysis of Task Related Components as a noise-resistant method in Brain-Computer Interface Speller Systems based on Steady-State Visual Evoked Potential." Biomedical Signal Processing and Control, Vol. 73p. 103449, 2022/03/01/ (2022).
13- Nik Aznan, Stephen Bonner, Jason Connolly, Noura Al Moubayed, and Toby Breckon, On the Classification of SSVEP-Based Dry-EEG Signals via Convolutional Neural Networks. (2018).
14- Nicholas Waytowich et al., "Compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials." Journal of Neural Engineering, Vol. 15 (No. 6), p. 066031, 2018/10/31 (2018).
15- Nouri Ali and Azizi Kyanoosh, "Introducing a Convolutional Neural Network and Visualization of its Filters for Classification of EEG Signal for SSVEP Task." Frontiers in Biomedical Technologies, Vol. 7 (No. 3), 09/30 (2020).
16- Joshua Podmore, Toby Breckon, Nik Aznan, and Jason Connolly, "On the Relative Contribution of Deep Convolutional Neural Networks for SSVEP-based Bio-Signal Decoding in BCI Speller Applications." IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. PPpp. 1-1, 03/13 (2019).
17- Osman Berke Guney, Muhtasham Oblokulov, and Huseyin Ozkan, "A Deep Neural Network for SSVEP-based Brain-Computer Interfaces." (in eng), IEEE transactions on bio-medical engineering, Vol. PP2021/09// (2021).
18- Saffari Farzad and Khadem Ali, "Single-Channel Selection for Detecting Steady-State Visual Evoked Potentials in a Brain-Computer Interface Speller." Frontiers in Biomedical Technologies, Vol. 8 (No. 3), 09/01 (2021).
19- Bingchuan Liu, Xiaoshan Huang, Yijun Wang, Xiaogang Chen, and Xiaorong Gao, BETA: A Large Benchmark Database Toward SSVEP-BCI Application. (2019).
20- Robin Tibor Schirrmeister et al., "Deep learning with convolutional neural networks for EEG decoding and visualization." Human Brain Mapping, https://doi.org/10.1002/hbm.23730 Vol. 38 (No. 11), pp. 5391-420, 2017/11/01 (2017).
| Files | ||
| Issue | Vol 9 No 4 (2022) | |
| Section | Original Article(s) | |
| DOI | https://doi.org/10.18502/fbt.v9i4.10382 | |
| Keywords | ||
| Brain Computer Interface Speller Steady State Visual Evoked Potentials Deep Convolutional Neural Network Electroencephalogram | ||
| Rights and permissions | |
|
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
