Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality

Kweku F. Bram-Larbi; Vassilis Charissis; Ramesh Lagoo; Shu Wang; Soheeb Khan; Samar Altarteer; David K. Harrison; Dimitris Drikakis

doi:10.1007/978-3-030-90966-6_17

Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality

Kweku F. Bram-Larbi
, Vassilis Charissis
, Ramesh Lagoo
, Shu Wang
, Soheeb Khan
, Samar Altarteer
, David K. Harrison
, Dimitris Drikakis

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

Multiple infotainment sources can significantly overload the driver’s cognitive load and increase the collision probabilities. Current solutions provided have at-tempted to alleviate this issue with the centralization of infotainment devices to single touchscreen devices in the dashboard area. Yet this solution still requires the driver to take the eyes from the road and concentrate on operating the secondary tasks unrelated to the driving process. The paper presents a prototype Augmented Reality Head-Up Display (AR HUD) system that superimposes a selected number of infotainment data on the vehicle’s windshield only when this is safe for the driver. The selection of infotainment data and projection timing is calculated by a prototype Artificial Intelligence (AI) Co-Driver that aims to reduce the driver’s cognitive load. The proposed system was evaluated by 50 users against a typical touchscreen dashboard system. This work presents and discusses the subjective feedback related to the cognitive load that the users perceived during the trials. The paper concludes with a future plan for improving both the AI and AR HUD elements to perform in an urban environment.

Original language	English
Title of host publication	HCI International 2021 - Late Breaking Papers: HCI Applications in Health, Transport, and Industry
Subtitle of host publication	23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021 Proceedings
Editors	Constantine Stephanidis, Vincent G. Duffy, Heidi Krömker, Fiona Fui-Hoon Nah, Keng Siau, Gavriel Salvendy, June Wei
Place of Publication	Cham
Publisher	Springer Cham
Pages	235-245
Number of pages	11
ISBN (Electronic)	9783030909666
ISBN (Print)	9783030909659
DOIs	https://doi.org/10.1007/978-3-030-90966-6_17
Publication status	Published - 20 Nov 2021
Externally published	Yes

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Cham
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 11 Sustainable Cities and Communities

Keywords

cognitive load
augmented reality
virtual reality
driver distraction
head-up display
artificial intelligence
simulation

Access to Document

10.1007/978-3-030-90966-6_17

Cite this

Bram-Larbi, K. F., Charissis, V., Lagoo, R., Wang, S., Khan, S., Altarteer, S., Harrison, D. K., & Drikakis, D. (2021). Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality. In C. Stephanidis, V. G. Duffy, H. Krömker, F. Fui-Hoon Nah, K. Siau, G. Salvendy, & J. Wei (Eds.), HCI International 2021 - Late Breaking Papers: HCI Applications in Health, Transport, and Industry: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021 Proceedings (pp. 235-245). (Lecture Notes in Computer Science). Springer Cham. https://doi.org/10.1007/978-3-030-90966-6_17

Bram-Larbi, Kweku F. ; Charissis, Vassilis ; Lagoo, Ramesh et al. / Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality. HCI International 2021 - Late Breaking Papers: HCI Applications in Health, Transport, and Industry: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021 Proceedings. editor / Constantine Stephanidis ; Vincent G. Duffy ; Heidi Krömker ; Fiona Fui-Hoon Nah ; Keng Siau ; Gavriel Salvendy ; June Wei. Cham : Springer Cham, 2021. pp. 235-245 (Lecture Notes in Computer Science).

@inproceedings{6b6c544b2e3a468387f1b189b3c7c281,

title = "Reducing driver{\textquoteright}s cognitive load with the use of artificial intelligence and augmented reality",

abstract = "Multiple infotainment sources can significantly overload the driver{\textquoteright}s cognitive load and increase the collision probabilities. Current solutions provided have at-tempted to alleviate this issue with the centralization of infotainment devices to single touchscreen devices in the dashboard area. Yet this solution still requires the driver to take the eyes from the road and concentrate on operating the secondary tasks unrelated to the driving process. The paper presents a prototype Augmented Reality Head-Up Display (AR HUD) system that superimposes a selected number of infotainment data on the vehicle{\textquoteright}s windshield only when this is safe for the driver. The selection of infotainment data and projection timing is calculated by a prototype Artificial Intelligence (AI) Co-Driver that aims to reduce the driver{\textquoteright}s cognitive load. The proposed system was evaluated by 50 users against a typical touchscreen dashboard system. This work presents and discusses the subjective feedback related to the cognitive load that the users perceived during the trials. The paper concludes with a future plan for improving both the AI and AR HUD elements to perform in an urban environment.",

keywords = "cognitive load, augmented reality, virtual reality, driver distraction, head-up display, artificial intelligence, simulation",

author = "Bram-Larbi, \{Kweku F.\} and Vassilis Charissis and Ramesh Lagoo and Shu Wang and Soheeb Khan and Samar Altarteer and Harrison, \{David K.\} and Dimitris Drikakis",

note = "Acceptance in SharePoint AAM: no embargo",

year = "2021",

month = nov,

day = "20",

doi = "10.1007/978-3-030-90966-6\_17",

language = "English",

isbn = "9783030909659",

series = "Lecture Notes in Computer Science",

publisher = "Springer Cham",

pages = "235--245",

editor = "Constantine Stephanidis and Duffy, \{Vincent G.\} and Heidi Kr{\"o}mker and \{Fui-Hoon Nah\}, Fiona and Keng Siau and Gavriel Salvendy and June Wei",

booktitle = "HCI International 2021 - Late Breaking Papers: HCI Applications in Health, Transport, and Industry",

}

Bram-Larbi, KF, Charissis, V, Lagoo, R, Wang, S, Khan, S, Altarteer, S, Harrison, DK & Drikakis, D 2021, Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality. in C Stephanidis, VG Duffy, H Krömker, F Fui-Hoon Nah, K Siau, G Salvendy & J Wei (eds), HCI International 2021 - Late Breaking Papers: HCI Applications in Health, Transport, and Industry: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021 Proceedings. Lecture Notes in Computer Science, Springer Cham, Cham, pp. 235-245. https://doi.org/10.1007/978-3-030-90966-6_17

Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality. / Bram-Larbi, Kweku F.; Charissis, Vassilis; Lagoo, Ramesh et al.
HCI International 2021 - Late Breaking Papers: HCI Applications in Health, Transport, and Industry: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021 Proceedings. ed. / Constantine Stephanidis; Vincent G. Duffy; Heidi Krömker; Fiona Fui-Hoon Nah; Keng Siau; Gavriel Salvendy; June Wei. Cham: Springer Cham, 2021. p. 235-245 (Lecture Notes in Computer Science).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality

AU - Bram-Larbi, Kweku F.

AU - Charissis, Vassilis

AU - Lagoo, Ramesh

AU - Wang, Shu

AU - Khan, Soheeb

AU - Altarteer, Samar

AU - Harrison, David K.

AU - Drikakis, Dimitris

N1 - Acceptance in SharePoint AAM: no embargo

PY - 2021/11/20

Y1 - 2021/11/20

N2 - Multiple infotainment sources can significantly overload the driver’s cognitive load and increase the collision probabilities. Current solutions provided have at-tempted to alleviate this issue with the centralization of infotainment devices to single touchscreen devices in the dashboard area. Yet this solution still requires the driver to take the eyes from the road and concentrate on operating the secondary tasks unrelated to the driving process. The paper presents a prototype Augmented Reality Head-Up Display (AR HUD) system that superimposes a selected number of infotainment data on the vehicle’s windshield only when this is safe for the driver. The selection of infotainment data and projection timing is calculated by a prototype Artificial Intelligence (AI) Co-Driver that aims to reduce the driver’s cognitive load. The proposed system was evaluated by 50 users against a typical touchscreen dashboard system. This work presents and discusses the subjective feedback related to the cognitive load that the users perceived during the trials. The paper concludes with a future plan for improving both the AI and AR HUD elements to perform in an urban environment.

AB - Multiple infotainment sources can significantly overload the driver’s cognitive load and increase the collision probabilities. Current solutions provided have at-tempted to alleviate this issue with the centralization of infotainment devices to single touchscreen devices in the dashboard area. Yet this solution still requires the driver to take the eyes from the road and concentrate on operating the secondary tasks unrelated to the driving process. The paper presents a prototype Augmented Reality Head-Up Display (AR HUD) system that superimposes a selected number of infotainment data on the vehicle’s windshield only when this is safe for the driver. The selection of infotainment data and projection timing is calculated by a prototype Artificial Intelligence (AI) Co-Driver that aims to reduce the driver’s cognitive load. The proposed system was evaluated by 50 users against a typical touchscreen dashboard system. This work presents and discusses the subjective feedback related to the cognitive load that the users perceived during the trials. The paper concludes with a future plan for improving both the AI and AR HUD elements to perform in an urban environment.

KW - cognitive load

KW - augmented reality

KW - virtual reality

KW - driver distraction

KW - head-up display

KW - artificial intelligence

KW - simulation

U2 - 10.1007/978-3-030-90966-6_17

DO - 10.1007/978-3-030-90966-6_17

M3 - Conference contribution

SN - 9783030909659

T3 - Lecture Notes in Computer Science

SP - 235

EP - 245

BT - HCI International 2021 - Late Breaking Papers: HCI Applications in Health, Transport, and Industry

A2 - Stephanidis, Constantine

A2 - Duffy, Vincent G.

A2 - Krömker, Heidi

A2 - Fui-Hoon Nah, Fiona

A2 - Siau, Keng

A2 - Salvendy, Gavriel

A2 - Wei, June

PB - Springer Cham

CY - Cham

ER -

Bram-Larbi KF, Charissis V, Lagoo R, Wang S, Khan S, Altarteer S et al. Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality. In Stephanidis C, Duffy VG, Krömker H, Fui-Hoon Nah F, Siau K, Salvendy G, Wei J, editors, HCI International 2021 - Late Breaking Papers: HCI Applications in Health, Transport, and Industry: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021 Proceedings. Cham: Springer Cham. 2021. p. 235-245. (Lecture Notes in Computer Science). Epub 2021 Nov 20. doi: 10.1007/978-3-030-90966-6_17

Reducing driver’s cognitive load with the use of artificial intelligence and augmented reality

Abstract

Publication series

UN SDGs

Keywords

Access to Document

Fingerprint

Cite this