Towards a cyber-physical gaming system for training in the construction and engineering industry

Aparajithan Sivanathan, Mohamed Abdel-Wahab, Frédéric Bosché, Theodore Lim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Introducing serious gaming systems (SGS) has the potential to enhance trainee experience and performance across the construction industry and its supply chain, such as mechanical engineering services. SGS as an ‘enabler’ in architectural engineering has received limited research in its role to assess and enhance the performance of its workforce. In a personnel high-risk environment, improving training standards to eliminate or reduce health and safety risks, in addition to providing an understanding of workers’ ergonomics, ensures sustainability of both the project and its workforce.

This paper presents an activity tracking and feedback system that captures the physical activity of a construction worker climbing a ladder. Climbing is captured with a 3D motion capture system and processed in real-time to identify potential areas of underperformance. A simple and representative scoring method was established as a reporting method (game statistics) for giving feedback about the correctness of the activity. It can nonetheless be tuned to characterise and adjust to various complexity levels in-line with the required training standards. Furthermore, the motion data and feedback information are fed into a virtual gaming environment enabling the real-time visualisation of the trainee’s motion and experiential learning of the performance through visual and audio feedback. The gaming concepts are employed here with multiple purposes, particularly for accelerating and facilitating the learning process of the trainee. In addition to the 3D motion capturing system, this paper outlines and tests a proposed serious cyber-physical gaming system that incorporates wearable technologies that has the potential to support both construction training and practice.
Original languageEnglish
Title of host publicationProceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
Subtitle of host publicationVolume 1B: 34th Computers and Information in Engineering Conference Buffalo, New York, USA, August 17–20, 2014
PublisherAmerican Society of Mechanical Engineers
Pages1-9
Number of pages9
ISBN (Print)9780791846292
DOIs
Publication statusPublished - 1 Aug 2014
Externally publishedYes

Publication series

NameInternational Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE)
PublisherASME

Fingerprint

Feedback
Industry
Ladders
Mechanical engineering
Construction industry
Ergonomics
Virtual reality
Supply chains
Sustainable development
Visualization
Health
Statistics
Personnel
Cyber Physical System
Problem-Based Learning
Wearable technology

Keywords

  • Serious games
  • Construction industry
  • Health and safety
  • Learning systems
  • cyber-physical gaming system
  • Serious gaming systems

Cite this

Sivanathan, A., Abdel-Wahab, M., Bosché, F., & Lim, T. (2014). Towards a cyber-physical gaming system for training in the construction and engineering industry. In Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference: Volume 1B: 34th Computers and Information in Engineering Conference Buffalo, New York, USA, August 17–20, 2014 (pp. 1-9). (International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE)). American Society of Mechanical Engineers. https://doi.org/10.1115/DETC2014-34930
Sivanathan, Aparajithan ; Abdel-Wahab, Mohamed ; Bosché, Frédéric ; Lim, Theodore. / Towards a cyber-physical gaming system for training in the construction and engineering industry. Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference: Volume 1B: 34th Computers and Information in Engineering Conference Buffalo, New York, USA, August 17–20, 2014. American Society of Mechanical Engineers, 2014. pp. 1-9 (International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE)).
@inproceedings{90e66297155946bb90348160fa0f50db,
title = "Towards a cyber-physical gaming system for training in the construction and engineering industry",
abstract = "Introducing serious gaming systems (SGS) has the potential to enhance trainee experience and performance across the construction industry and its supply chain, such as mechanical engineering services. SGS as an ‘enabler’ in architectural engineering has received limited research in its role to assess and enhance the performance of its workforce. In a personnel high-risk environment, improving training standards to eliminate or reduce health and safety risks, in addition to providing an understanding of workers’ ergonomics, ensures sustainability of both the project and its workforce.This paper presents an activity tracking and feedback system that captures the physical activity of a construction worker climbing a ladder. Climbing is captured with a 3D motion capture system and processed in real-time to identify potential areas of underperformance. A simple and representative scoring method was established as a reporting method (game statistics) for giving feedback about the correctness of the activity. It can nonetheless be tuned to characterise and adjust to various complexity levels in-line with the required training standards. Furthermore, the motion data and feedback information are fed into a virtual gaming environment enabling the real-time visualisation of the trainee’s motion and experiential learning of the performance through visual and audio feedback. The gaming concepts are employed here with multiple purposes, particularly for accelerating and facilitating the learning process of the trainee. In addition to the 3D motion capturing system, this paper outlines and tests a proposed serious cyber-physical gaming system that incorporates wearable technologies that has the potential to support both construction training and practice.",
keywords = "Serious games, Construction industry, Health and safety, Learning systems, cyber-physical gaming system, Serious gaming systems",
author = "Aparajithan Sivanathan and Mohamed Abdel-Wahab and Fr{\'e}d{\'e}ric Bosch{\'e} and Theodore Lim",
year = "2014",
month = "8",
day = "1",
doi = "10.1115/DETC2014-34930",
language = "English",
isbn = "9780791846292",
series = "International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE)",
publisher = "American Society of Mechanical Engineers",
pages = "1--9",
booktitle = "Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference",

}

Sivanathan, A, Abdel-Wahab, M, Bosché, F & Lim, T 2014, Towards a cyber-physical gaming system for training in the construction and engineering industry. in Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference: Volume 1B: 34th Computers and Information in Engineering Conference Buffalo, New York, USA, August 17–20, 2014. International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE), American Society of Mechanical Engineers, pp. 1-9. https://doi.org/10.1115/DETC2014-34930

Towards a cyber-physical gaming system for training in the construction and engineering industry. / Sivanathan, Aparajithan; Abdel-Wahab, Mohamed; Bosché, Frédéric; Lim, Theodore.

Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference: Volume 1B: 34th Computers and Information in Engineering Conference Buffalo, New York, USA, August 17–20, 2014. American Society of Mechanical Engineers, 2014. p. 1-9 (International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE)).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Towards a cyber-physical gaming system for training in the construction and engineering industry

AU - Sivanathan, Aparajithan

AU - Abdel-Wahab, Mohamed

AU - Bosché, Frédéric

AU - Lim, Theodore

PY - 2014/8/1

Y1 - 2014/8/1

N2 - Introducing serious gaming systems (SGS) has the potential to enhance trainee experience and performance across the construction industry and its supply chain, such as mechanical engineering services. SGS as an ‘enabler’ in architectural engineering has received limited research in its role to assess and enhance the performance of its workforce. In a personnel high-risk environment, improving training standards to eliminate or reduce health and safety risks, in addition to providing an understanding of workers’ ergonomics, ensures sustainability of both the project and its workforce.This paper presents an activity tracking and feedback system that captures the physical activity of a construction worker climbing a ladder. Climbing is captured with a 3D motion capture system and processed in real-time to identify potential areas of underperformance. A simple and representative scoring method was established as a reporting method (game statistics) for giving feedback about the correctness of the activity. It can nonetheless be tuned to characterise and adjust to various complexity levels in-line with the required training standards. Furthermore, the motion data and feedback information are fed into a virtual gaming environment enabling the real-time visualisation of the trainee’s motion and experiential learning of the performance through visual and audio feedback. The gaming concepts are employed here with multiple purposes, particularly for accelerating and facilitating the learning process of the trainee. In addition to the 3D motion capturing system, this paper outlines and tests a proposed serious cyber-physical gaming system that incorporates wearable technologies that has the potential to support both construction training and practice.

AB - Introducing serious gaming systems (SGS) has the potential to enhance trainee experience and performance across the construction industry and its supply chain, such as mechanical engineering services. SGS as an ‘enabler’ in architectural engineering has received limited research in its role to assess and enhance the performance of its workforce. In a personnel high-risk environment, improving training standards to eliminate or reduce health and safety risks, in addition to providing an understanding of workers’ ergonomics, ensures sustainability of both the project and its workforce.This paper presents an activity tracking and feedback system that captures the physical activity of a construction worker climbing a ladder. Climbing is captured with a 3D motion capture system and processed in real-time to identify potential areas of underperformance. A simple and representative scoring method was established as a reporting method (game statistics) for giving feedback about the correctness of the activity. It can nonetheless be tuned to characterise and adjust to various complexity levels in-line with the required training standards. Furthermore, the motion data and feedback information are fed into a virtual gaming environment enabling the real-time visualisation of the trainee’s motion and experiential learning of the performance through visual and audio feedback. The gaming concepts are employed here with multiple purposes, particularly for accelerating and facilitating the learning process of the trainee. In addition to the 3D motion capturing system, this paper outlines and tests a proposed serious cyber-physical gaming system that incorporates wearable technologies that has the potential to support both construction training and practice.

KW - Serious games

KW - Construction industry

KW - Health and safety

KW - Learning systems

KW - cyber-physical gaming system

KW - Serious gaming systems

U2 - 10.1115/DETC2014-34930

DO - 10.1115/DETC2014-34930

M3 - Conference contribution

SN - 9780791846292

T3 - International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE)

SP - 1

EP - 9

BT - Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference

PB - American Society of Mechanical Engineers

ER -

Sivanathan A, Abdel-Wahab M, Bosché F, Lim T. Towards a cyber-physical gaming system for training in the construction and engineering industry. In Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference: Volume 1B: 34th Computers and Information in Engineering Conference Buffalo, New York, USA, August 17–20, 2014. American Society of Mechanical Engineers. 2014. p. 1-9. (International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE)). https://doi.org/10.1115/DETC2014-34930