An immersive hybrid reality system for construction training

Ludovico Carozza, Frederic Bosche, Mohamed Abdel-Wahab

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review


Mixed Reality (MR) technologies are inspiring a wide range of applications in the Construction industry, such as visual simulation for urban and construction planning and services’ maintenance. Current MR systems offer only limited interaction modalities between the user (the trainee), the real surrounding world (including working tools and materials) and the virtual environment. Such interactions are essential for construction training applications.

Current approaches aim at providing such capabilities through the virtualization of real world to be fused with
the virtual one, and usually require the complex set-up and integration of external marker-based tracking
systems, immersive displays (e.g. CAVEs) and haptic devices. Moreover such approaches, being based on prefetched avatar models of the real objects, often result in a lack of realism and flexibility.

In this paper we present the concept of an immersive Hybrid Reality (iHR) system which allows the trainee to
experience in real time a realistic perception of self-embodiment within the virtual worksite as well as realistic interaction with both real and virtual objects. Our system fuses in real time the visual and structural information of the real world, acquired by an egocentric RGB-D camera integral with a wearable immersive head mounted display, within the virtual representation of a work environment. The system is based on a recently developed commodity hardware, which is affordable and easily set-up, and therefore it has the potential for supporting a wider application across vocational training courses.

The paper outlines the implementation of the main components of the system and the benefits achieved in terms of enhanced simulation capabilities. Promising preliminary results within the context of a training scenario are discussed, together with limitations of the current implementation and directions for further improvement.
Original languageEnglish
Title of host publicationCONVR 15
Subtitle of host publicationProceedings of the 15th International Conference on Construction Applications of Virtual Reality, October 5-7, 2015, Banff, Alberta, Canada
EditorsSangUk Han, Ming Lu, Yasser Mohamed
Number of pages10
Publication statusPublished - 1 Oct 2015
Externally publishedYes
Event15th International Conference on Construction Applications of Virtual Reality - Banff, Canada
Duration: 5 Oct 20157 Oct 2015


Conference15th International Conference on Construction Applications of Virtual Reality
Abbreviated titleCONVR 2015


  • immersive experience
  • mixed reality
  • construction training
  • self-embodiment


Dive into the research topics of 'An immersive hybrid reality system for construction training'. Together they form a unique fingerprint.

Cite this