EmojiHeroVR: a virtual reality game for collecting partially occluded emotional faces

Thorben Ortmann; Mirco Hülsemann; Qi Wang; Larissa Putzar

doi:10.1109/ACIIW63320.2024.00024

EmojiHeroVR: a virtual reality game for collecting partially occluded emotional faces

Thorben Ortmann, Mirco Hülsemann, Qi Wang, Larissa Putzar

School of Computing, Engineering and Physical Sciences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

12 Downloads (Pure)

Abstract

We present EmojiHeroVR, a Virtual Reality (VR) high-score game in which players reenact facial expressions to earn points. It provides an engaging method to collect emotional faces partially occluded by Head-Mounted Displays (HMDs), thereby promoting Facial Expression Recognition (FER) in VR settings. Developed using the Unity3D game engine, EmojiHeroVR integrates face detection and FER models via the Unity Sentis package. Results from a study with 37 participants who completed the Game Experience Questionnaire (GEQ) and Virtual Reality Sickness Questionnaire (VRSQ) indicate that EmojiHeroVR is an effective tool for data collection and offers an engaging experience for players.

Original language	English
Title of host publication	2024 12th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)
Publisher	IEEE
Pages	119-121
Number of pages	3
ISBN (Electronic)	9798331516451
ISBN (Print)	9798331516468
DOIs	https://doi.org/10.1109/ACIIW63320.2024.00024
Publication status	E-pub ahead of print - 24 Apr 2025

Keywords

facial expressions
emotion recognition
virtual reality
affective game

Access to Document

10.1109/ACIIW63320.2024.00024

2024 07 08 Ortmann et al EmojiHeroVR accepted - for PureAccepted author manuscript, 1.47 MBLicence: CC BY 4.0

Cite this

@inproceedings{7c567b0407cc4a4fa9b84bfa36bceb24,

title = "EmojiHeroVR: a virtual reality game for collecting partially occluded emotional faces",

abstract = "We present EmojiHeroVR, a Virtual Reality (VR) high-score game in which players reenact facial expressions to earn points. It provides an engaging method to collect emotional faces partially occluded by Head-Mounted Displays (HMDs), thereby promoting Facial Expression Recognition (FER) in VR settings. Developed using the Unity3D game engine, EmojiHeroVR integrates face detection and FER models via the Unity Sentis package. Results from a study with 37 participants who completed the Game Experience Questionnaire (GEQ) and Virtual Reality Sickness Questionnaire (VRSQ) indicate that EmojiHeroVR is an effective tool for data collection and offers an engaging experience for players.",

keywords = "facial expressions, emotion recognition, virtual reality, affective game",

author = "Thorben Ortmann and Mirco H{\"u}lsemann and Qi Wang and Larissa Putzar",

year = "2025",

month = apr,

day = "24",

doi = "10.1109/ACIIW63320.2024.00024",

language = "English",

isbn = "9798331516468",

pages = "119--121",

booktitle = "2024 12th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)",

publisher = "IEEE",

address = "United States",

}

EmojiHeroVR: a virtual reality game for collecting partially occluded emotional faces. / Ortmann, Thorben; Hülsemann, Mirco; Wang, Qi et al.
2024 12th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW). IEEE, 2025. p. 119-121.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - EmojiHeroVR

T2 - a virtual reality game for collecting partially occluded emotional faces

AU - Ortmann, Thorben

AU - Hülsemann, Mirco

AU - Wang, Qi

AU - Putzar, Larissa

PY - 2025/4/24

Y1 - 2025/4/24

N2 - We present EmojiHeroVR, a Virtual Reality (VR) high-score game in which players reenact facial expressions to earn points. It provides an engaging method to collect emotional faces partially occluded by Head-Mounted Displays (HMDs), thereby promoting Facial Expression Recognition (FER) in VR settings. Developed using the Unity3D game engine, EmojiHeroVR integrates face detection and FER models via the Unity Sentis package. Results from a study with 37 participants who completed the Game Experience Questionnaire (GEQ) and Virtual Reality Sickness Questionnaire (VRSQ) indicate that EmojiHeroVR is an effective tool for data collection and offers an engaging experience for players.

AB - We present EmojiHeroVR, a Virtual Reality (VR) high-score game in which players reenact facial expressions to earn points. It provides an engaging method to collect emotional faces partially occluded by Head-Mounted Displays (HMDs), thereby promoting Facial Expression Recognition (FER) in VR settings. Developed using the Unity3D game engine, EmojiHeroVR integrates face detection and FER models via the Unity Sentis package. Results from a study with 37 participants who completed the Game Experience Questionnaire (GEQ) and Virtual Reality Sickness Questionnaire (VRSQ) indicate that EmojiHeroVR is an effective tool for data collection and offers an engaging experience for players.

KW - facial expressions

KW - emotion recognition

KW - virtual reality

KW - affective game

U2 - 10.1109/ACIIW63320.2024.00024

DO - 10.1109/ACIIW63320.2024.00024

M3 - Conference contribution

SN - 9798331516468

SP - 119

EP - 121

BT - 2024 12th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)

PB - IEEE

ER -

EmojiHeroVR: a virtual reality game for collecting partially occluded emotional faces

Abstract

Keywords

Access to Document

Fingerprint

Cite this