AI Innovations in rPPG Systems for Driver Monitoring: Comprehensive Systematic Review and Future Prospects

Soha G. Ahmed, Katrien Verbert, Nazar Zaki, Ashraf Khalil, Hamad Aljassmi, Fady Alnajjar

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Advanced technologies, notably camera-based systems using remote photoplethysmography (rPPG), are increasingly used in automotive safety to non-invasively monitor driver well-being and fatigue by measuring physiological metrics like heart and respiration rates. This review examines recent advancements in machine learning algorithms and signal processing for rPPG in driver monitoring. A literature search up to April 2, 2024, across major databases, identified 344 studies; 29 were analyzed in depth, focusing on: 1) rPPG signal extraction and heart rate estimation, where deep learning improved accuracy; 2) fatigue detection, showing benefits of multimodal data fusion; 3) mental state monitoring, with machine learning classifying cognitive load and distraction; and 4) emotional state monitoring and dataset development, indicating a trend toward holistic driver assessment. While deep learning has improved rPPG signal extraction, challenges remain in consistent physiological metric detection under dynamic conditions. There is also a lack of diverse population representation, especially female drivers, in datasets. The review underscores the potential of AI-enhanced camera systems to improve road safety, emphasizing the need for diverse, multimodal data integration for comprehensive monitoring.

Original languageEnglish
Pages (from-to)22893-22918
Number of pages26
JournalIEEE Access
Volume13
DOIs
Publication statusPublished - 2025

Keywords

  • Automotive safety
  • deep learning
  • driver monitoring
  • machine learning
  • physiological signals
  • rPPG
  • signal processing

ASJC Scopus subject areas

  • General Computer Science
  • General Materials Science
  • General Engineering

Fingerprint

Dive into the research topics of 'AI Innovations in rPPG Systems for Driver Monitoring: Comprehensive Systematic Review and Future Prospects'. Together they form a unique fingerprint.

Cite this