A Real-Time Vision-Based System for Driver Fatigue and Distraction Monitoring Using a Single In-Cabin RGB Camera
DOI:
https://doi.org/10.59992/IJCI.2026.v5n1p4الكلمات المفتاحية:
Driver Fatigue Detection، Driver Distraction Monitoring، Vision-based Driver Monitoring، Real-Time Systems، In-Cabin RGB Camera، Multi-Cue Fusion، Intelligent Transportation Systemsالملخص
Driver fatigue and distraction are among the leading causes of road accidents worldwide, posing a critical challenge for intelligent transportation systems (ITS). Vision-based driver monitoring has emerged as a promising solution due to its non-intrusive nature and compatibility with in-vehicle environments. However, many existing approaches rely on isolated behavioural cues, lack real-time capability, or require specialized sensing hardware, which limits their practical deployment. This paper presents a real-time vision-based framework for monitoring driver fatigue and distraction using a single in-cabin RGB camera. The proposed framework integrates complementary behavioural indicators, including eye closure analysis based on PERCLOS, yawning detection, and head pose estimation, through a decision-level fusion strategy. The framework is evaluated on two widely adopted public benchmark datasets, namely the NTHU Drowsy Driver Detection dataset and the YAWDD dataset. Experimental results show that the proposed approach achieves detection accuracies of 92.6% on NTHU and 93.0% on YAWDD, with average processing latencies below 120 ms, satisfying real-time operational requirements. These results demonstrate that multi-cue visual analysis significantly improves detection robustness compared to single-cue methods while maintaining practical deployability. The proposed framework therefore provides an effective and scalable solution for real-time driver state monitoring and contributes to enhanced road safety in intelligent transportation systems.
المراجع
World Health Organization, Global Status Report on Road Safety, Geneva, Switzerland: WHO Press, 2018.
[2] Selim Kaplan, Murat Guvensan, Ahmet Yavuz, and Yilmaz Karalurt, “Driver behavior analysis for safe driving: A survey,” IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 6, pp. 3017–3032, 2015.
[3] National Highway Traffic Safety Administration, Drowsy Driving and Automobile Crashes, Washington, DC, USA: U.S. Department of Transportation, Technical Report, 2017.
[4] Ankit Tawari and Mohan Manubhai Trivedi, “Robust and continuous estimation of driver gaze zone by dynamic analysis of head pose,” IEEE Transactions on Intelligent Transportation Systems, vol. 15, no. 6, pp. 2499–2512, 2014.
[5] Mohan Manubhai Trivedi, Tarak Gandhi, and Joel McCall, “Looking-in and looking-out of a vehicle: Computer-vision-based enhanced vehicle safety,” IEEE Signal Processing Magazine, vol. 24, no. 6, pp. 82–93, 2011.
[6] Yulong Liang and John D. Lee, “Combining cognitive and visual distraction: Less obvious but more risky,” IEEE Transactions on Intelligent Transportation Systems, vol. 12, no. 4, pp. 1263–1272, 2011.
[7] Ricardo Vicente, Fernando Fdez-Riverola, Manuel J. Hornos, and Juan Carlos Vallejo, “Driver monitoring systems: A review,” Sensors, vol. 16, no. 12, Art. no. 2228, 2016.
[8] Zhihong Zhang, Jiebo Luo, and Ramakant Nevatia, “Detection and tracking of driver eye state for fatigue monitoring,” Pattern Recognition, vol. 45, no. 1, pp. 273–283, 2012.
[9] Arturo de la Escalera, Luis María Bergasa, Jesús Nuevo, Miguel A. Sotelo, and Rafael Barea, “Real-time system for monitoring driver vigilance,” IEEE Transactions on Intelligent Transportation Systems, vol. 7, no. 1, pp. 63–77, 2006.
[10] Martin Eriksson and Nikolaos Papanikotopoulos, “Eye-tracking for detection of driver fatigue,” in Proceedings of the IEEE Intelligent Transportation Systems Conference, 1997, pp. 314–319.
[11] John W. Dinges and Roger Grace, “PERCLOS: A valid psychophysiological measure of alertness,” Federal Highway Administration Report FHWA-MCRT-98-006, 1998.
[12] Tereza Soukupová and Jan Čech, “Real-time eye blink detection using facial landmarks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2016.
[13] Zhihong Zhang and Jiebo Luo, “Yawning detection for monitoring driver fatigue,” Pattern Recognition Letters, vol. 31, no. 10, pp. 1123–1130, 2010.
[14] Amir Abtahi, Behnoosh Hariri, and Shervin Shirmohammadi, “YawDD: A yawning detection dataset,” in Proceedings of the ACM Multimedia Systems Conference, 2014.
[15] Simon Murphy-Chutorian and Mohan Manubhai Trivedi, “Head pose estimation in computer vision: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 4, pp. 607–626, 2009.
[16] Miguel Flores, José María Armingol, and Arturo de la Escalera, “Driver drowsiness detection using visual cues and artificial neural networks,” IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 4, pp. 1230–1241, 2018.
[17] Yifan Guo, Yifan Yuan, and Qi Wang, “Vision-based driver fatigue detection with convolutional neural networks,” IEEE Access, vol. 8, pp. 1915–1926, 2020.
[18] Jun Yang, Xiaofeng Zhao, and Yu Li, “Decision-level fusion of multi-feature information for driver fatigue detection,” Sensors, vol. 19, no. 8, Art. no. 1826, 2019.
[19] Wei-Chih Hsu, Chia-Chun Wang, and Chien-Cheng Lin, “NTHU drowsy driver detection dataset,” in Proceedings of the IEEE Intelligent Transportation Systems Conference, 2016.
[20] Xiaobo Wang, Liang Zhang, and Yu Chen, “Real-time in-cabin driver monitoring using deep learning,” IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 6, pp. 3456–3467, 2021.
[21] Chao Dong, Yufeng Shao, and Zhiqiang Yang, “Vision-based driver fatigue detection using facial landmarks and temporal analysis,” IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 11, pp. 7124–7136, 2021.
[22] Shijie Fu, Yifan Liu, Hao Zhang, and Liang Chen, “Advancements in intelligent detection of driver fatigue and distraction: A comprehensive review,” Applied Sciences, vol. 14, no. 7, 2024.
[23] Mohammed Saad Al-Quraishi, Ahmed H. Al-Hilali, and Hassan K. Kareem, “Technologies for detecting and monitoring drivers’ states: A systematic review,” Heliyon, vol. 10, no. 20, 2024.
[24] Yasir Albadawi, Mohammed Al-Saadi, and Ahmed Al-Dulaimi, “Real-time machine learning-based driver drowsiness detection using visual features,” Journal of Imaging, vol. 9, no. 5, 2023.
[25] Abdullah A. Almazroi, Fahad S. Alshahrani, and Mohammed A. Alqahtani, “Real-time CNN-based driver distraction and drowsiness detection system,” Intelligent Automation & Soft Computing, vol. 37, no. 2, 2023.
[26] Muhammad A. H. Akhtar, Ahmed E. Hassanien, and Aboul Ella Hassanien, “Data fusion for driver drowsiness recognition,” Egyptian Informatics Journal, 2024.
[27] Hao Wang, Jian Li, and Peng Zhou, “Driver distraction and fatigue detection using ME-YOLOv8,” IET Intelligent Transportation Systems, 2024.
[28] Syed Muhammad Shah, Ali Raza, and Muhammad Imran, “AI-enabled driver assistance through head and gaze monitoring,” Complex & Intelligent Systems, 2025.
[29] Jian Lei, Haoran Liu, and Wei Zhang, “Driver distraction monitoring using RES-SE-CNN,” Scientific Reports, vol. 15, 2025.
[30] Daniel Dontoh, Michael S. Regan, and Thomas Victor, “Visual dominance and multimodal approaches in distracted driving detection,” arXiv preprint, arXiv:2505.01973, 2025.
[31] Xin Zhao, Lei Chen, and Ming Zhang, “YOLO11-CR: A lightweight framework for fatigue driving detection,” arXiv preprint, arXiv:25
