Image-based localization for an indoor VR/AR construction training system

Ludovico Carozza, Frédéric Bosché, Mohamed Abdel-Wahab

Research output: Contribution to conferenceOther

Abstract

Virtual /Augmented Reality (VR/AR) technologies have been increasingly used in recent years to support different areas of the construction industry. Its simulation capabilities can enable different construction stakeholders to evaluate the impact of their choices not only on the built environment, but also with regard to the correct execution of operational procedures. Training providers, such as Further Education (FE) colleges, can
also enhance their trainee’s experience through the simulation of realistic construction contexts whilst eliminating health and safety risks. Current approaches for the simulation of learning environments in Construction, such as Virtual Learning Environment (VLEs), provide limited degree of interactivity during the execution of real working tasks. Whilst immersive approaches (e.g. CAVE-based) can provide enhanced visualization of simulated environments, they require complex and expensive set-up with limited practical interaction in real construction
projects context.

This paper outlines a localization approach employed in the development of an Immersive Environment (IE) for Construction training, cheaper than CAVE-based approaches and with the potential to be rolled-out widely across the FE sector for maximizing the benefit to the construction industry. Pose estimation of the trainee is achieved by processing images acquired by a monocular camera integral with his head while performing tasks in a virtual construction environment. Realistic perception of the working environment and its potentially hazardous conditions can thus be consistently delivered to the trainee through immersive display devices (e.g. goggles).

Preliminary performance of the localization approach is reported in the context of working at heights (which has a wide applicability to a range of construction trades, such as scaffolders and roofers), whilst highlighting the potential benefits for trainees. Current limitations of the localization approach are also discussed suggesting directions for future development.
Original languageEnglish
Pages363-372
Number of pages10
Publication statusPublished - 2013
Externally publishedYes
Event13th International Conference on Construction Applications of Virtual Reality - Millennium Conference Centre, London, United Kingdom
Duration: 30 Oct 201331 Oct 2013
http://www.convr2013.com/

Conference

Conference13th International Conference on Construction Applications of Virtual Reality
Abbreviated titleCONVR 2013
CountryUnited Kingdom
CityLondon
Period30/10/1331/10/13
Internet address

Fingerprint

Augmented reality
Construction industry
Education
Goggles
Image processing
Visualization
Cameras
Display devices
Health

Keywords

  • image-based
  • localization
  • VR/AR
  • construction training

Cite this

Carozza, L., Bosché, F., & Abdel-Wahab, M. (2013). Image-based localization for an indoor VR/AR construction training system. 363-372. 13th International Conference on Construction Applications of Virtual Reality, London, United Kingdom.
Carozza, Ludovico ; Bosché, Frédéric ; Abdel-Wahab, Mohamed. / Image-based localization for an indoor VR/AR construction training system. 13th International Conference on Construction Applications of Virtual Reality, London, United Kingdom.10 p.
@conference{62383d5b1bf745f39090f37c98e7db5c,
title = "Image-based localization for an indoor VR/AR construction training system",
abstract = "Virtual /Augmented Reality (VR/AR) technologies have been increasingly used in recent years to support different areas of the construction industry. Its simulation capabilities can enable different construction stakeholders to evaluate the impact of their choices not only on the built environment, but also with regard to the correct execution of operational procedures. Training providers, such as Further Education (FE) colleges, canalso enhance their trainee’s experience through the simulation of realistic construction contexts whilst eliminating health and safety risks. Current approaches for the simulation of learning environments in Construction, such as Virtual Learning Environment (VLEs), provide limited degree of interactivity during the execution of real working tasks. Whilst immersive approaches (e.g. CAVE-based) can provide enhanced visualization of simulated environments, they require complex and expensive set-up with limited practical interaction in real constructionprojects context.This paper outlines a localization approach employed in the development of an Immersive Environment (IE) for Construction training, cheaper than CAVE-based approaches and with the potential to be rolled-out widely across the FE sector for maximizing the benefit to the construction industry. Pose estimation of the trainee is achieved by processing images acquired by a monocular camera integral with his head while performing tasks in a virtual construction environment. Realistic perception of the working environment and its potentially hazardous conditions can thus be consistently delivered to the trainee through immersive display devices (e.g. goggles).Preliminary performance of the localization approach is reported in the context of working at heights (which has a wide applicability to a range of construction trades, such as scaffolders and roofers), whilst highlighting the potential benefits for trainees. Current limitations of the localization approach are also discussed suggesting directions for future development.",
keywords = "image-based, localization, VR/AR, construction training",
author = "Ludovico Carozza and Fr{\'e}d{\'e}ric Bosch{\'e} and Mohamed Abdel-Wahab",
year = "2013",
language = "English",
pages = "363--372",
note = "13th International Conference on Construction Applications of Virtual Reality, CONVR 2013 ; Conference date: 30-10-2013 Through 31-10-2013",
url = "http://www.convr2013.com/",

}

Carozza, L, Bosché, F & Abdel-Wahab, M 2013, 'Image-based localization for an indoor VR/AR construction training system' 13th International Conference on Construction Applications of Virtual Reality, London, United Kingdom, 30/10/13 - 31/10/13, pp. 363-372.

Image-based localization for an indoor VR/AR construction training system. / Carozza, Ludovico; Bosché, Frédéric; Abdel-Wahab, Mohamed.

2013. 363-372 13th International Conference on Construction Applications of Virtual Reality, London, United Kingdom.

Research output: Contribution to conferenceOther

TY - CONF

T1 - Image-based localization for an indoor VR/AR construction training system

AU - Carozza, Ludovico

AU - Bosché, Frédéric

AU - Abdel-Wahab, Mohamed

PY - 2013

Y1 - 2013

N2 - Virtual /Augmented Reality (VR/AR) technologies have been increasingly used in recent years to support different areas of the construction industry. Its simulation capabilities can enable different construction stakeholders to evaluate the impact of their choices not only on the built environment, but also with regard to the correct execution of operational procedures. Training providers, such as Further Education (FE) colleges, canalso enhance their trainee’s experience through the simulation of realistic construction contexts whilst eliminating health and safety risks. Current approaches for the simulation of learning environments in Construction, such as Virtual Learning Environment (VLEs), provide limited degree of interactivity during the execution of real working tasks. Whilst immersive approaches (e.g. CAVE-based) can provide enhanced visualization of simulated environments, they require complex and expensive set-up with limited practical interaction in real constructionprojects context.This paper outlines a localization approach employed in the development of an Immersive Environment (IE) for Construction training, cheaper than CAVE-based approaches and with the potential to be rolled-out widely across the FE sector for maximizing the benefit to the construction industry. Pose estimation of the trainee is achieved by processing images acquired by a monocular camera integral with his head while performing tasks in a virtual construction environment. Realistic perception of the working environment and its potentially hazardous conditions can thus be consistently delivered to the trainee through immersive display devices (e.g. goggles).Preliminary performance of the localization approach is reported in the context of working at heights (which has a wide applicability to a range of construction trades, such as scaffolders and roofers), whilst highlighting the potential benefits for trainees. Current limitations of the localization approach are also discussed suggesting directions for future development.

AB - Virtual /Augmented Reality (VR/AR) technologies have been increasingly used in recent years to support different areas of the construction industry. Its simulation capabilities can enable different construction stakeholders to evaluate the impact of their choices not only on the built environment, but also with regard to the correct execution of operational procedures. Training providers, such as Further Education (FE) colleges, canalso enhance their trainee’s experience through the simulation of realistic construction contexts whilst eliminating health and safety risks. Current approaches for the simulation of learning environments in Construction, such as Virtual Learning Environment (VLEs), provide limited degree of interactivity during the execution of real working tasks. Whilst immersive approaches (e.g. CAVE-based) can provide enhanced visualization of simulated environments, they require complex and expensive set-up with limited practical interaction in real constructionprojects context.This paper outlines a localization approach employed in the development of an Immersive Environment (IE) for Construction training, cheaper than CAVE-based approaches and with the potential to be rolled-out widely across the FE sector for maximizing the benefit to the construction industry. Pose estimation of the trainee is achieved by processing images acquired by a monocular camera integral with his head while performing tasks in a virtual construction environment. Realistic perception of the working environment and its potentially hazardous conditions can thus be consistently delivered to the trainee through immersive display devices (e.g. goggles).Preliminary performance of the localization approach is reported in the context of working at heights (which has a wide applicability to a range of construction trades, such as scaffolders and roofers), whilst highlighting the potential benefits for trainees. Current limitations of the localization approach are also discussed suggesting directions for future development.

KW - image-based

KW - localization

KW - VR/AR

KW - construction training

M3 - Other

SP - 363

EP - 372

ER -

Carozza L, Bosché F, Abdel-Wahab M. Image-based localization for an indoor VR/AR construction training system. 2013. 13th International Conference on Construction Applications of Virtual Reality, London, United Kingdom.