TY - JOUR
T1 - AI Innovations in rPPG Systems for Driver Monitoring
T2 - Comprehensive Systematic Review and Future Prospects
AU - Ahmed, Soha G.
AU - Verbert, Katrien
AU - Zaki, Nazar
AU - Khalil, Ashraf
AU - Aljassmi, Hamad
AU - Alnajjar, Fady
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Advanced technologies, notably camera-based systems using remote photoplethysmography (rPPG), are increasingly used in automotive safety to non-invasively monitor driver well-being and fatigue by measuring physiological metrics like heart and respiration rates. This review examines recent advancements in machine learning algorithms and signal processing for rPPG in driver monitoring. A literature search up to April 2, 2024, across major databases, identified 344 studies; 29 were analyzed in depth, focusing on: 1) rPPG signal extraction and heart rate estimation, where deep learning improved accuracy; 2) fatigue detection, showing benefits of multimodal data fusion; 3) mental state monitoring, with machine learning classifying cognitive load and distraction; and 4) emotional state monitoring and dataset development, indicating a trend toward holistic driver assessment. While deep learning has improved rPPG signal extraction, challenges remain in consistent physiological metric detection under dynamic conditions. There is also a lack of diverse population representation, especially female drivers, in datasets. The review underscores the potential of AI-enhanced camera systems to improve road safety, emphasizing the need for diverse, multimodal data integration for comprehensive monitoring.
AB - Advanced technologies, notably camera-based systems using remote photoplethysmography (rPPG), are increasingly used in automotive safety to non-invasively monitor driver well-being and fatigue by measuring physiological metrics like heart and respiration rates. This review examines recent advancements in machine learning algorithms and signal processing for rPPG in driver monitoring. A literature search up to April 2, 2024, across major databases, identified 344 studies; 29 were analyzed in depth, focusing on: 1) rPPG signal extraction and heart rate estimation, where deep learning improved accuracy; 2) fatigue detection, showing benefits of multimodal data fusion; 3) mental state monitoring, with machine learning classifying cognitive load and distraction; and 4) emotional state monitoring and dataset development, indicating a trend toward holistic driver assessment. While deep learning has improved rPPG signal extraction, challenges remain in consistent physiological metric detection under dynamic conditions. There is also a lack of diverse population representation, especially female drivers, in datasets. The review underscores the potential of AI-enhanced camera systems to improve road safety, emphasizing the need for diverse, multimodal data integration for comprehensive monitoring.
KW - Automotive safety
KW - deep learning
KW - driver monitoring
KW - machine learning
KW - physiological signals
KW - rPPG
KW - signal processing
UR - http://www.scopus.com/inward/record.url?scp=85216950747&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85216950747&partnerID=8YFLogxK
U2 - 10.1109/ACCESS.2025.3535540
DO - 10.1109/ACCESS.2025.3535540
M3 - Article
AN - SCOPUS:85216950747
SN - 2169-3536
VL - 13
SP - 22893
EP - 22918
JO - IEEE Access
JF - IEEE Access
ER -