EVALUATION OF FATIGUE LEVEL BY SAFE ENTRY STATION USING NOVEL DEEP LEARNING TECHNIQUE

Main Article Content

RAHUL KUSHWAH
RAJIV MURADIA
ANKUR SINGH BIST

Abstract

Fatigue is an important component for screening for “Fit for Duty” at work place. The main objective of this research paper is to identify a novel deep learning technique that can be used to screen fatigue in workplace setting. In order to achieve personal and professional goals, enhance the structure of the organization and to sustain one’s living conditions in an appropriate manner, it is necessary to take into consideration the aspects of health and safety of the employees. This research paper outlines our work on the importance of detecting health, safety and fatigue in the workplace with state-of-art technology before even starting a job.

This paper proposes a real-time comprehensive employee fatigue detection algorithm based on different facial landmarks to improve the detection accuracy, which detects the employee’s fatigue status by using facial video sequences without equipping them with sensor devices. The facial area is analyzed including detection of left and right eye along with the mouth region.

In this paper we are proposing a novel deep learning technique to classify high, mid and low levels of fatigue. We are performing this activity at a safe entry station (SES) which also measures other vital parameters such as Body Temperature, Eye Redness, Heart Rate and Respiration Rate. The focus of the current study is on fatigue detection and our AI pipeline achieved 91% accuracy on data points collected at various sites in identification of fatigue levels.

Keywords:
Fatigue, employees, deep learning technique, respiration rate, technology

Article Details

How to Cite
KUSHWAH, R., MURADIA, R., & BIST, A. S. (2022). EVALUATION OF FATIGUE LEVEL BY SAFE ENTRY STATION USING NOVEL DEEP LEARNING TECHNIQUE. Journal of Basic and Applied Research International, 28(6), 48-53. https://doi.org/10.56557/jobari/2022/v28i67985
Section
Original Research Article

References

Ansari S, Naghdy F, Du H, Pahnwar YN. Driver mental fatigue detection based on head posture using new modified reLU-BiLSTM deep neural network. IEEE Transactions on Intelligent Transportation Systems; 2021.

McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer's disease Report of the NINCDS‐ADRDA Work Group* under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease. Neurology. 1984;34(7): 939-939.

Cui Z, Sun HM, Yin RN, Gao L, Sun HB, Jia RS. Real-time detection method of driver fatigue state based on deep learning of face video. Multimedia Tools and Applications. 2021;80(17):25495-25515.

Wang J, Shi J, Xu Y, Zhong H, Li G, Tian J, Tang C. A New Strategy for Mental Fatigue Detection Based on Deep Learning and Respiratory Signal. In Proceedings of the 11th International Conference on Computer Engineering and Networks. Springer, Singapore. 2022:543-552.

Wu EQ, Lin CT, Zhu LM, Tang ZR, Jie YW, Zhou GR. Fatigue Detection of Pilots' Brain Through Brains Cognitive Map and Multilayer Latent Incremental Learning Model. IEEE Transactions on Cybernetics; 2021.

Lin Z, Qiu T, Liu P, Zhang L, Zhang S, Mu Z. Fatigue driving recognition based on deep learning and graph neural network. Biomedical Signal Processing and Control. 2021;68: 102598.

Savaş BK, Becerikli Y. A Deep Learning Approach to Driver Fatigue Detection via Mouth State Analyses and Yawning Detection.

Ayachi R, Afif M, Said Y, Abdelali AB. Drivers Fatigue Detection Using EfficientDet In Advanced Driver Assistance Systems. In 2021 18th International Multi-Conference on Systems, Signals & Devices (SSD). IEEE. 2021;738-742

Lopez MB, del-Blanco CR, Garcia N. Detecting exercise-induced fatigue using thermal imaging and deep learning. In 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA). IEEE. 2017:1-6.

Cardone D, Filippini C, Mancini L, Pomante A, Tritto M, Nocco S, Merla A. Driver drowsiness evaluation by means of thermal infrared imaging: preliminary results. In Infrared Sensors, Devices, and Applications XI. SPIE. 2021;11831:111-121.

Cardone D, Perpetuini D, Filippini C, Spadolini E, Mancini L, Chiarelli AM, Merla A. (). Driver stress state evaluation by means of thermal imaging: A supervised machine learning approach based on ECG signal. Applied Sciences. 2020;10(16):5673.

Kajiwara S. Driver-condition detection using a thermal imaging camera and neural networks. International Journal of Automotive Technology. 2021;22(6):1505-1515.

Elbarawy YM, Ghali NI, El-Sayed RS. Facial expressions recognition in thermal images based on deep learning techniques. International Journal of Image, Graphics and Signal Processing (IJIGSP). 2019;11(10):1-7.