Title Enhancing driver monitoring systems based on novel multi-task fusion algorithm
Authors Vijeikis, Romas ; Dada, Ibidapo Dare ; Abayomi-Alli, Adebayo A ; Raudonis, Vidas
DOI 10.3390/s25216799
Full Text Download
Is Part of Sensors.. Basel : MDPI. 2025, vol. 25, iss. 21, art. no. 6799, p. 1-25.. ISSN 1424-8220
Keywords [eng] computer vision ; deep learning ; driver activity recognition ; driver attention analysis ; driver monitoring ; multi-perspective learning ; multi-task fusion ; road safety ; video classification
Abstract [eng] Distracted driving continues to be a major contributor to road accidents, highlighting the growing research interest in advanced driver monitoring systems for enhanced safety. This paper seeks to improve the overall performance and effectiveness of such systems by highlighting the importance of recognizing the driver’s activity. This paper introduces a novel methodology for assessing driver attention by using multi-perspective information using videos that capture the full driver body, hands, and face and focusing on three driver tasks: distracted actions, gaze direction, and hands-on-wheel monitoring. The experimental evaluation was conducted in two phases: first, assessing driver distracted activities, gaze direction, and hands-on-wheel using a CNN-based model and videos from three cameras that were placed inside the vehicle, and second, evaluating the multi-task fusion algorithm, considering the aggregated danger score, which was introduced in this paper, as a representation of the driver’s attentiveness based on the multi-task data fusion algorithm. The proposed methodology was built and evaluated using a DMD dataset; additionally, model robustness was tested on the AUC_V2 and SAMDD driver distraction datasets. The proposed algorithm effectively combines multi-task information from different perspectives and evaluates the attention level of the driver.
Published Basel : MDPI
Type Journal article
Language English
Publication date 2025
CC license CC license description