Original Article

AS3-SAE: Automatic Sleep Stages Scoring using Stacked Autoencoders

Abstract

Purpose: Sleep is a subconscious state, and the brain is active during it. Automatic classification of sleep stages can help identify various diseases. In recent years, automatic sleep monitoring using deep learning networks has attracted the attention of researchers.

Materials and Methods: In this paper, a deep learning type neural network called Stacked Autoencoders (SAEs) is used for automatically classifying sleep stages. SAEs are a kind of neural network with encoder and decoder blocks. The function of these networks is similar to the human brain and is capable of automatically processing signals; also SAEs are robust to noise. To prove the efficiency of this network, in addition to examining the effect of various biological signals such as Electrocardiogram (ECG) and Electroencephalogram (EEG) on the performance of sleep stage classification, Sleep Heart Health Study (SHHS) and ISRUC standard databases have been used, which include night recordings of 30 and 10 healthy humans, respectively.  

Results: The accuracy of classifying 2 to 6 classes by SHHS database are 0.995, 0.983, 0.9780, 0.9688, 0.961, and on ISRUC database accuracies are 0.996, 0.994, 0.9511, and 0.9431. Moreover, the proposed network can classify wake, deep sleep, and light sleep using the ECG signal (acc = 0.75, kappa = 0.69).

Conclusion: In the review of the results, it is concluded that sleep stages classification based on EEG signal has better results, still acquisition of ECG signal and its acceptable results can be a good alternative to use. In addition to its high ability of the proposed method to detect sleep stages, this network is robust to noise, which is very necessary and important for the clinical processing of sleep signals.

1- Mahtab Vaezi and Mehdi Nasri, "Sleep Scoring based on Biomedical Signals: A survey and a New Algorithm." in Advances in Signal Processing: Reviews', Book Series, Vol. 2, Sergey Y. Turish, Ed.: International Frequency Sensor Association Publishing, (2021), pp. 265-306.
2- Maria Katsifaraki et al., "The association of sleepiness, insomnia, sleep disturbance and pain: a study amongst shiftworking nurses." Sleep Biological Rhythms, Vol. 16 (No. 1), pp. 133-40, (2018).
3- Stefania Evangelisti et al., "Brain functional connectivity in sleep-related hypermotor epilepsy." NeuroImage: Clinical, Vol. 17pp. 873-81, (2018).
4- Heide Klumpp, Tony Cunningham, Kerry Kinney, and Helen Burgess, "F92. Identification of Biotype in Anxiety and Depression Using Amygdala Response to Threat and Objective and Subjective Measures of Sleep." Biological Psychiatry, Vol. 83 (No. 9), p. S273, (2018).
5- Matheus Araujo, Rahul Bhojwani, Jaideep Srivastava, Louis Kazaglis, and Conrad Iber, "ML Approach for Early Detection of Sleep Apnea Treatment Abandonment: A Case Study." in Proceedings of the 2018 International Conference on Digital Health, (2018): ACM, pp. 75-79.
6- Asghar Zarei and Babak Mohammadzadeh Asl, "Performance evaluation of the spectral autocorrelation function and autoregressive models for automated sleep apnea detection using single-lead ECG signal." Computer methods programs in biomedicine, Vol. 195p. 105626, (2020).
7- Huei-Chen Lin et al., "Pulse oximetry monitor feasible for early screening of obstructive sleep apnea (OSA)." Journal of Medical Biological Engineering, Vol. 40 (No. 1), pp. 62-70, (2020).
8- Cheng-Han Wu, Jui-Hsuan Lee, Terry BJ Kuo, Chun-Ting Lai, Lieber PH Li, and Cheryl CH Yang, "Improving the Diagnostic Ability of the Sleep Apnea Screening System Based on Oximetry by Using Physical Activity Data." Journal of Medical Biological Engineering, Vol. 40 (No. 6), pp. 858-67, (2020).
9- Henri Korkalainen et al., "Deep learning enables sleep staging from photoplethysmogram for patients with suspected sleep apnea." Sleep, Vol. 43 (No. 11), p. zsaa098, (2020).
10- Mohammed Diykh, Yan Li, and Shahab Abdulla, "EEG sleep stages identification based on weighted undirected complex networks." Computer methods and programs in biomedicine, Vol. 184p. 105116, (2020).
11- Susanne MM de Mooij, Tessa F Blanken, Raoul PPP Grasman, Jennifer R Ramautar, Eus JW Van Someren, and Han LJ van der Maas, "Dynamics of sleep: Exploring critical transitions and early warning signals." Computer methods programs in biomedicine, Vol. 193p. 105448, (2020).
12- Wu Huang et al., "Sleep staging algorithm based on multichannel data adding and multifeature screening." Computer methods programs in biomedicine, Vol. 187p. 105253, (2020).
13- Saeid Sanei and Jonathon A Chambers, EEG signal processing. England: John Wiley & Sons, (2007), p. 289.
14- A Rechtschaffen, "A manual of standardized terminology, techniques and scoring system for sleep of human subjects." J Brain Information Service, (1968).
15- Conrad Iber, The AASM manual for the scoring of sleep and associated events: rules, terminology and technical specifications. American Academy of Sleep Medicine Westchester, IL, (2007).
16- Rajeev Sharma, Ram Bilas Pachori, and Abhay Upadhyay, "Automatic sleep stages classification based on iterative filtering of electroencephalogram signals." Neural Computing Applications, Vol. 28 (No. 10), pp. 2959-78, (2017).
17- Mehmet Dursun et al., "A new approach to eliminating EOG artifacts from the sleep EEG signals for the automatic sleep stage classification." Neural Computing Applications, Vol. 28 (No. 10), pp. 3095-112, (2017).
18- S Sheykhivand, T Yousefi Rezaii, Z Mousavi, and S Meshgini, "Automatic Stage Scoring of Single-Channel Sleep EEG using CEEMD of Genetic Algorithm and Neural Network." (2018).
19- Pejman Memar and Farhad Faradji, "A novel multi-class EEG-based sleep stage classification system." EEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. 26 (No. 1), pp. 84-95, (2018).
20- Fumiya Kinoshita, Masumi Takada, and Meiho Nakayama, "Polysomnography." in Bio-information for Hygiene: Springer, (2021), pp. 81-92.
21- Behrouz Jafari and Vahid Mohsenin, "Polysomnography." Clinics in chest medicine, Vol. 31 (No. 2), pp. 287-97, (2010).
22- Oliver Faust, Hajar Razaghi, Ragab Barika, Edward J Ciaccio, and U Rajendra Acharya, "A review of automated sleep stage scoring based on physiological signals for the new millennia." Computer methods and programs in biomedicine, Vol. 176pp. 81-91, (2019).
23- Mustafa Radha et al., "Sleep stage classification from heart-rate variability using long short-term memory neural networks." Scientific reports, Vol. 9 (No. 1), pp. 1-11, (2019).
24- Qiao Li, Qichen Li, Chengyu Liu, Supreeth P Shashikumar, Shamim Nemati, and Gari D Clifford, "Deep learning in the cross-time frequency domain for sleep staging from a single-lead electrocardiogram." Physiological measurement, Vol. 39 (No. 12), p. 124005, (2018).
25- Şule Yücelbaş, Cüneyt Yücelbaş, Gülay Tezel, Seral Özşen, and Şebnem Yosunkaya, "Automatic sleep staging based on SVD, VMD, HHT and morphological features of single-lead ECG signal." Expert Systems with Applications, Vol. 102pp. 193-206, (2018).
26- Sarun Paisarnsrisomsuk, Carolina Ruiz, and Sergio Alvarez, "Improved deep learning classification of human sleep stages." in 2020 IEEE 33rd international symposium on computer-based medical systems (CBMS), (2020): IEEE, pp. 338-43.
27- Haoqi Sun et al., "Sleep staging from electrocardiography and respiration with deep learning." Sleep, Vol. 43 (No. 7), p. zsz306, (2020).
28- Urtnasan Erdenebayar, Yeewoong Kim, Joung-Uk Park, SooYong Lee, and Kyoung-Joung Lee, "Automatic Classification of Sleep Stage from an ECG Signal Using a Gated-Recurrent Unit." International Journal of Fuzzy Logic Intelligent Systems, Vol. 20 (No. 3), pp. 181-87, (2020).
29- Niranjan Sridhar et al., "Deep learning for automated sleep staging using instantaneous heart rate." NPJ digital medicine, Vol. 3 (No. 1), pp. 1-10, (2020).
30- Jose Gallardo, Giannina Bellone, Santiago Plano, Daniel Vigo, Marcelo %J Journal of Medical Risk, and Biological Engineering, "Heart Rate Variability: Influence of Pre-processing Methods in Identifying Single-Night Sleep-Deprived Subjects." Journal of Medical Biological Engineering, Vol. 41 (No. 2), pp. 224-30, (2021).
31- Mahtab Vaezi and Mehdi Nasri, "Sleep Stage Classification using Laplacian Score Feature Selection Method by Single Channel EEG." Majlesi Journal of Electrical Engineering, Vol. 14 (No. 4), pp. 11-19, (2020).
32- Akara Supratak, Hao Dong, Chao Wu, and Yike Guo, "DeepSleepNet: a model for automatic sleep stage scoring based on raw single-channel EEG." IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol. 25 (No. 11), pp. 1998-2008, (2017).
33- Junming Zhang and Yan Wu, "Complex-valued unsupervised convolutional neural networks for sleep stage classification." Computer methods and programs in biomedicine, Vol. 164pp. 181-91, (2018).
34- Ahnaf Rashik Hassan and Abdulhamit Subasi, "A decision support system for automated identification of sleep stages from single-channel EEG signals." Knowledge-Based Systems, Vol. 128pp. 115-24, (2017).
35- Saman Seifpour, Hamid Niknazar, Mohammad Mikaeili, and Ali Motie Nasrabadi, "A new automatic sleep staging system based on statistical behavior of local extrema using single channel EEG signal." Expert Systems with Applications, Vol. 104pp. 277-93, (2018).
36- Mahtab Vaezi and Mehdi Nasri, "Application of Heuristic Feature Selection in EEG based Sleep Stages Classification." in 2020 6th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS), (2020): IEEE, pp. 1-6.
37- Shivani Dhok, Varad Pimpalkhute, Ambarish Chandurkar, Ankit A Bhurane, Manish Sharma, and U Rajendra Acharya, "Automated phase classification in cyclic alternating patterns in sleep stages using Wigner-Ville Distribution based features." Computers in Biology Medicine, p. 103691, (2020).
38- Vijay Vasudevan, Barret Zoph, Jonathon Shlens, and Quoc V Le, "Neural architecture search for convolutional neural networks." ed: Google Patents, (2019).
39- Nicola Michielli, U Rajendra Acharya, and Filippo Molinari, "Cascaded LSTM recurrent neural network for automated sleep stage classification using single-channel EEG signals." Computers in biology medicine, Vol. 106pp. 71-81, (2019).
40- Junming Zhang and Yan Wu, "A new method for automatic sleep stage classification." IEEE transactions on biomedical circuits and systems, Vol. 11 (No. 5), pp. 1097-110, (2017).
41- Ran Wei, Xinghua Zhang, Jinhai Wang, and Xin %J Biomedical engineering letters Dang, "The research of sleep staging based on single-lead electrocardiogram and deep neural network." Biomedical engineering letters, Vol. 8 (No. 1), pp. 87-93, (2018).
42- Arnaud Sors, Stéphane Bonnet, Sébastien Mirek, Laurent Vercueil, and Jean-François Payen, "A convolutional neural network for sleep stage scoring from raw single-channel eeg." Biomedical Signal Processing and Control, Vol. 42pp. 107-14, (2018).
43- Xiaofeng Yuan, Biao Huang, Yalin Wang, Chunhua Yang, and Weihua Gui, "Deep learning-based feature representation and its application for soft sensor modeling with variable-wise weighted SAE." IEEE Transactions on Industrial Informatics, Vol. 14 (No. 7), pp. 3235-43, (2018).
44- Xiaofeng Yuan, Chen Ou, Yalin Wang, Chunhua Yang, and Weihua Gui, "A layer-wise data augmentation strategy for deep learning networks and its soft sensor application in an industrial hydrocracking process." IEEE transactions on neural networks learning systems, (2019).
45- Dinggang Shen, Guorong Wu, and Heung-Il %J Annual review of biomedical engineering Suk, "Deep learning in medical image analysis." Annual review of biomedical, Vol. 19pp. 221-48, (2017).
46- Ke Li et al., "Multi-label spacecraft electrical signal classification method based on DBN and random forest." PLoS One, Vol. 12 (No. 5), p. e0176614, (2017).
47- Debjani Bhowick, Deepak K Gupta, Saumen Maiti, and Uma Shankar, "Stacked autoencoders based machine learning for noise reduction and signal reconstruction in geophysical data." arXiv preprint arXiv:.03278, (2019).
48- Stuart F Quan et al., "The sleep heart health study: design, rationale, and methods." Sleep, Vol. 20 (No. 12), pp. 1077-85, (1997).
49- Guo-Qiang Zhang et al., "The National Sleep Research Resource: towards a sleep data commons." Journal of the American Medical Informatics Association, Vol. 25 (No. 10), pp. 1351-58, (2018).
50- Sirvan Khalighi, Teresa Sousa, José Moutinho Santos, and Urbano Nunes, "ISRUC-Sleep: a comprehensive public dataset for sleep researchers." Computer methods programs in biomedicine, Vol. 124pp. 180-92, (2016).
51- Ian Goodfellow, Yoshua Bengio, and Aaron Courville, Deep learning. MIT press, (2016).
52- Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol, "Extracting and composing robust features with denoising autoencoders." in Proceedings of the 25th international conference on Machine learning, (2008): ACM, pp. 1096-103.
53- Meriem Bahi and Mohamed Batouche, "Deep semi-supervised learning for DTI prediction using large datasets and H2O-spark platform." in 2018 International Conference on Intelligent Systems and Computer Vision (ISCV), (2018): IEEE, pp. 1-7.
54- Yoshua Bengio, Pascal Lamblin, Dan Popovici, and Hugo Larochelle, "Greedy layer-wise training of deep networks." in Advances in neural information processing systems, (2007), pp. 153-60.
55- Ian Goodfellow, Honglak Lee, Quoc V Le, Andrew Saxe, and Andrew Y Ng, "Measuring invariances in deep networks." in Advances in neural information processing systems, (2009), pp. 646-54.
56- Yann %J Proceedings of Cognitiva 85 LeCun, "Une procedure d'apprentissage ponr reseau a seuil asymetrique." Proceedings of Cognitiva 85, pp. 599-604, (1985).
57- Paul %J Ph. D. dissertation Werbos, Harvard University, "Beyond Regression:" New Tools for Prediction and Analysis in the Behavioral Sciences." harvard university, (1974).
58- Tayyip Ozcan and Alper Basturk, "Human action recognition with deep learning and structural optimization using a hybrid heuristic algorithm." Cluster Computing, Vol. 23 (No. 4), pp. 2847-60, (2020).
59- Sergio Saponara, Abdussalam Elhanashi, and Alessio Gagliardi, "Reconstruct fingerprint images using deep learning and sparse autoencoder algorithms." in Real-Time Image Processing and Deep Learning 2021, (2021), Vol. 11736: SPIE, pp. 9-18.
60- Raman Arora, Parvinder Kaur, and Er Deepinder Kaur, "Age Invariant Face Recogntion Using Stacked Autoencoder Deep Neural Network." in 2020 International Conference on Intelligent Engineering and Management (ICIEM), (2020): IEEE, pp. 358-63.
61- Mohamed Bouchou, Hua Wang, and Mohammed El Hadi Lakhdari, "Automatic digital modulation recognition based on stacked sparse autoencoder." in 2017 IEEE 17th International Conference on Communication Technology (ICCT), (2017): IEEE, pp. 28-32.
62- Chathurdara Sri Nadith Pathirage, Jun Li, Ling Li, Hong Hao, Wanquan Liu, and Pinghe Ni, "Structural damage identification based on autoencoder neural networks and deep learning." Engineering structures, Vol. 172pp. 13-28, (2018).
63- Guomin Luo et al., "Stacked auto-encoder-based transients recognition in VSC-HVDC." IEEE Access, Vol. 8pp. 14223-33, (2020).
64- Omer Deperlioglu, "Heart sound classification with signal instant energy and stacked autoencoder network." Biomedical Signal Processing Control, Vol. 64p. 102211, (2021).
65- Casimiro A Curbelo Montañez et al., "SAERMA: stacked autoencoder rule mining algorithm for the interpretation of epistatic interactions in GWAS for extreme obesity." IEEE Access, Vol. 8pp. 112379-92, (2020).
66- Yifeng Li, Chih-Yu Chen, and Wyeth W Wasserman, "Deep feature selection: theory and application to identify enhancers and promoters." Journal of Computational Biology, Vol. 23 (No. 5), pp. 322-36, (2016).
67- Mohammad Fasahat and Mohammad Manthouri, "State of charge estimation of lithium-ion batteries using hybrid autoencoder and long short term memory neural networks." Journal of Power Sources, Vol. 469p. 228375, (2020).
68- Jonas Gehring, Yajie Miao, Florian Metze, and Alex Waibel, "Extracting deep bottleneck features using stacked auto-encoders." in 2013 IEEE international conference on acoustics, speech and signal processing, (2013): IEEE, pp. 3377-81.
69- Solomon Kullback and Richard A %J The annals of mathematical statistics Leibler, "On information and sufficiency." The annals of mathematical statistics, Vol. 22 (No. 1), pp. 79-86, (1951).
70- Kenneth J Berry and Paul W Mielke Jr, "A generalization of Cohen's kappa agreement measure to interval measurement and multiple raters." Educational Psychological Measurement, Vol. 48 (No. 4), pp. 921-33, (1988).
71- Jacob Cohen, "A coefficient of agreement for nominal scales." Educational Psychological Measurement, Vol. 20 (No. 1), pp. 37-46, (1960).
72- Zhihong Cui, Xiangwei Zheng, Xuexiao Shao, and Lizhen Cui, "Automatic sleep stage classification based on convolutional neural network and fine-grained segments." Complexity, Vol. 2018(2018).
73- Irfan Al-Hussaini, Cao Xiao, M Brandon Westover, and Jimeng Sun, "SLEEPER: interpretable Sleep staging via Prototypes from Expert Rules." arXiv preprint arXiv:.06100, (2019).
74- Diego Alvarez-Estevez and Isaac Fernández-Varela, "Dealing with the database variability problem in learning from medical data: An ensemble-based approach using convolutional neural networks and a case of study applied to automatic sleep scoring." Computers in Biology Medicine, p. 103697, (2020).
75- Cong Liu et al., "Automatic sleep staging with a single-channel EEG based on ensemble empirical mode decomposition." Physica A: Statistical Mechanics its Applications, Vol. 567p. 125685, (2021).
76- Enrique Fernandez-Blanco, Carlos Fernandez-Lozano, Alejandro Pazos, and Daniel Rivero, "Ensemble of Convolution Neural Networks on Heterogeneous Signals for Sleep Stage Scoring." arXiv preprint arXiv:.11045, (2021).
77- Dongdong Zhou et al., "SingleChannelNet: A model for Automatic Sleep Stage Classification with Raw Single-Channel EEG." bioRxiv, (2020).
78- Miriam Goldammer, Sebastian Zaunseder, Moritz D Brandt, Hagen Malberg, and Felix Gräßer, "Investigation of automated sleep staging from cardiorespiratory signals regarding clinical applicability and robustness." Biomedical Signal Processing Control, Vol. 71p. 103047, (2022).
79- Qiao Li et al., "Transfer learning from ECG to PPG for improved sleep staging from wrist-worn wearables." Physiological measurement, Vol. 42 (No. 4), p. 044004, (2021).
80- Z Mousavi, T Yousefi Rezaii, S Sheykhivand, A Farzamnia, and SN Razavi, "Deep convolutional neural network for classification of sleep stages from single-channel EEG signals." journal of neuroscience methods, Vol. 324p. 108312, (2019).
81- Bohan Yu et al., "WiFi-Sleep: sleep stage monitoring using commodity Wi-Fi devices." IEEE internet of things journal, Vol. 8 (No. 18), pp. 13900-13, (2021).
82- Spyros Gidaris and Nikos Komodakis, "Generating classification weights with gnn denoising autoencoders for few-shot learning." in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2019), pp. 21-30.
Files
IssueVol 10 No 4 (2023) QRcode
SectionOriginal Article(s)
DOI https://doi.org/10.18502/fbt.v10i4.13722
Keywords
Sleep Stages Stacked Autoencoder Single Channel Electroencephalogram Deep Learning Electrocardiogram

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
1.
Vaezi M, Nasri M. AS3-SAE: Automatic Sleep Stages Scoring using Stacked Autoencoders. Frontiers Biomed Technol. 2023;10(4):400-416.