Human Fatigue Evaluation by Face's Image Analysis Based upon Convolutional Neural Networks

Main Article Content

Bairamov Azat Ilgizovich
Faskhutdinov Timur Ruslanovich
Timergalin Denis Marselevich
Yamikov Rustem Raficovich
Murtazin Vitaly Rudolfovich
Nikita Alekseevich Tumanov

Abstract

This article presents solutions to the person's fatigue recognition problem by the face's image analysis based on convolutional neural networks. In the present paper, existing algorithms were considered. A new model's architecture was proposed and implemented. Resultant metrics of the model were evaluated.

Article Details

References

Hüllermeier E., Rifqi M. A Fuzzy Variant of the Rand Index for Comparing Clustering Structures. 2009. P. 1294–1298.
2. Levashov S.P. Monitoring i analiz professional'nykh riskov v Rossii i za rubezhom. Kurganskii gosudarstvennyi universitet.
3. Phillips R.O. et al. Fatigue in transport: a review of exposure, risks, checks and controls // Transport Reviews. Routledge, 2017. Vol. 37, No. 6. P. 742–766.
4. Qiang Ji, Zhiwei Zhu, Lan P. Real-time nonintrusive monitoring and prediction of driver fatigue // IEEE Transactions on Vehicular Technology. 2004. Vol. 53, No. 4. P. 1052–1068.
5. Sharafutdinova A.F. Sistema opredeleniya ustalosti voditelya // Vestnik Sov-remennykh Issledovanii. 2018. № 7.1 (22).
6. Singh S., Papanikolopoulos N.P. Monitoring driver fatigue using facial analysis techniques // Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No. 99TH8383). Tokyo, Japan: IEEE, 1999. P. 314–318.
7. Wen-Bing Horng et al. Driver fatigue detection based on eye tracking and dy-namic template matching // IEEE International Conference on Networking, Sensing and Control, 2004. Taipei, Taiwan: IEEE, 2004. P. 7–12.
8. Sklonnost' k neschastnym sluchayam i faktory, ee obuslavlivayushchie | Ekstremal'na ta krizova psikhologіya [Electronic resource]. URL: http://extrpsy.nuczu.edu.ua/statya18 (accessed: 31.03.2021).
9. Prichiny neschastnykh sluchaev – Okhrana truda [Electronic resource]. URL: http://okhrana-truda.com/neschastnye-sluchai-i-professionalnye-zabolevaniya/prichiny-neschastnykh-sluchaev.html (accessed: 31.03.2021).
10. Chelovecheskii faktor kak prichina proizvodstvennogo travmatizma | Inter-aktivnyi portal Departamenta truda i zanyatosti naseleniya Tyumenskoi oblasti [Elec-tronic resource]. URL: https://czn.admtyumen.ru/News/Detail/7efb0823-7fee-4366-836e-5f4affa7f6d5 (accessed: 12.04.2021).
11. Obyazan li rabotodatel' vyplachivat' kompensatsiyu rabotniku, poluchivshemu travmu na proizvodstve? // Upravlenie personalom [Electronic resource]. URL: https://www.top-personal.ru/lawissue.html?2294 (accessed: 31.03.2021).
12. Evija.Feierabende. Glavnaya prichina travm na rabote – legkomyslennoe otnoshenie k bezopasnosti [Electronic resource]: Text // www.balta.lv. 2017. URL: https://www.balta.lv/ru/content/glavnaya-prichina-travm-na-rabote-–-legkomyslennoe-otnoshenie-k-bezopasnosti (accessed: 31.03.2021).
13. Sikander G., Anwar S. Driver Fatigue Detection Systems: A Review // IEEE Trans. Intell. Transport. Syst. 2019. Vol. 20, No. 6. P. 2339–2352.
14. David F. Dinges, Richard Grace. PERCLOS: A Valid Psychophysiological Meas-ure of Alertness As Assessed by Psychomotor Vigilance. P. 4.
15. Yadav N., Banerjee K., Bali V. A Survey on Fatigue Detection of Workers Using Machine Learning // International Journal of E-Health and Medical Communications. 2020. Vol. 11, No. 3. P. 1–8.
16. Bengio Y., Lecun Y. Convolutional Networks for Images, Speech, and Time-Series. 1997.
17. He K. et al. Deep Residual Learning for Image Recognition // arXiv:1512.03385 [cs]. 2015.
18. Realizuem i sravnivaem optimizatory modelei v glubokom obuchenii [Electron-ic resource]. URL: https://habr.com/ru/company/skillfactory/blog/525214/ (accessed: 10.05.2021).
19. Global Z. Brutalk – Funktsiya aktivatsii Softmax s Python [Electronic resource] // URL: https://www.brutalk.com/ru/brutalk-blog/view/funkciya-aktivacii-softmax-s-python-6046b4a524b71 (accessed: 10.05.2021).
18. Fatigue_detection (Dataset) [Electronic resource]. URL: https://kaggle.com/timmjy/fatigue-detection (accessed: 05.04.2021).
19. Colaboratory – Google [Electronic resource]. URL: https://research.google.com/colaboratory/faq.html (accessed: 11.05.2021).
20. Keras: the Python deep learning API [Electronic resource]. URL: https://keras.io/ (accessed: 10.05.2021).
21. TensorFlow [Electronic resource]. URL: https://www.tensorflow.org/ (ac-cessed: 10.05.2021).
22. Fatigure-detection [Electronic resource]. URL: https://github.com/bairamovazat/fatigure-detection (accessed: 10.05.2021).
23. Advances in Face Detection and Facial Image Analysis / ed. Kawulok M., Celebi M.E., Smolka B. Cham: Springer International Publishing, 2016.
24. NeuralSetStorage [Electronic resource]. URL: https://github.com/bairamovazat/NeuralSetStorage (accessed: 10.05.2021).


Most read articles by the same author(s)