Specification and evaluation of an assessment engine for educational games: integrating learning analytics and providing an assessment authoring tool

Yaelle Chaudy, Thomas Connolly

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)
170 Downloads (Pure)

Abstract

Educational games are highly engaging, motivating and they offer many advantages as a supplementary tool for education. However, the development of educational games is very complex, essentially because of its multidisciplinary aspect. Fully integrating assessment is challenging and the games created are too often distributed as blackboxes; unmodifiable by the teachers and not providing much insight about the gameplays. We propose an assessment engine, EngAGe, to overcome these issues. EngAGe is used by both developers and educators. It is designed to separate game and assessment. Developers use it to easily integrate assessment into educational games and teachers can then modify the assessment and visualise learning analytics via an online interface. This paper focuses on EngAGe’s benefits for games developers. It presents a quantitative evaluation carried out with 36 developers (7 experienced and 29 students). Findings were very positive: every feature of the engine was rated useful and EngAGe received a usability score of 64 using the System Usability Scale. A Mann-Whitney U test showed a significant difference in usability (Z=-3.34, p<0.002) between novice developers (mean=56) and experienced developers (mean=71) but none in terms of usefulness. This paper concludes that developers can use EngAGe effectively to integrate assessment and learning analytics in educational games.
Original languageEnglish
Article number100294
Number of pages16
JournalEntertainment Computing
Volume30
Early online date16 Feb 2019
DOIs
Publication statusPublished - 31 May 2019

Keywords

  • Educational games
  • Serious games
  • Games-based learning
  • Assessment
  • Feedback
  • Framework
  • Assessment engine
  • Learning analytics
  • Game development

Fingerprint

Dive into the research topics of 'Specification and evaluation of an assessment engine for educational games: integrating learning analytics and providing an assessment authoring tool'. Together they form a unique fingerprint.

Cite this