Visual-inertial 6-DOF localization for a wearable immersive VR/AR system

L. Carozza, F. Bosché, M. Abdel-Wahab

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a real-time visual-inertial localization approach directly integrable in a wearable immersive system for simulation and training. In this context, while CAVE systems typically require complex and expensive set-up, our approach relies on visual and inertial information provided by consumer monocular camera and Inertial Measurement Unit, embedded in a wearable stereoscopic HMD. 6-DOF localization is achieved through image registration with respect to a 3D map of descriptors of the training room and robust tracking of visual features. We propose a novel efficient and robust pipeline based on state-of-the-art image-based localization and sensor fusion approaches, which makes use of robust orientation information from FMU, to cope with camera fast motion and limit motion jitters. The proposed system runs at 30 fps on a standard PC and requires very limited set-up for its intended application.
Original languageEnglish
Title of host publication2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
PublisherIEEE
Pages257-258
Number of pages2
ISBN (Electronic)9781479961849
DOIs
Publication statusPublished - 6 Nov 2014
Externally publishedYes
Event2014 IEEE International Symposium on Mixed and Augmented Reality - Munich, Germany
Duration: 10 Sep 201412 Sep 2014

Conference

Conference2014 IEEE International Symposium on Mixed and Augmented Reality
Abbreviated titleISMAR
CountryGermany
CityMunich
Period10/09/1412/09/14

Fingerprint

Cameras
Helmet mounted displays
Units of measurement
Image registration
Jitter
Fusion reactions
Pipelines
Sensors

Keywords

  • augmented reality

Cite this

Carozza, L., Bosché, F., & Abdel-Wahab, M. (2014). Visual-inertial 6-DOF localization for a wearable immersive VR/AR system. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 257-258). IEEE. https://doi.org/10.1109/ISMAR.2014.6948438
Carozza, L. ; Bosché, F. ; Abdel-Wahab, M. / Visual-inertial 6-DOF localization for a wearable immersive VR/AR system. 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 2014. pp. 257-258
@inproceedings{9d0279514e48469db2c3b2213cd589aa,
title = "Visual-inertial 6-DOF localization for a wearable immersive VR/AR system",
abstract = "We present a real-time visual-inertial localization approach directly integrable in a wearable immersive system for simulation and training. In this context, while CAVE systems typically require complex and expensive set-up, our approach relies on visual and inertial information provided by consumer monocular camera and Inertial Measurement Unit, embedded in a wearable stereoscopic HMD. 6-DOF localization is achieved through image registration with respect to a 3D map of descriptors of the training room and robust tracking of visual features. We propose a novel efficient and robust pipeline based on state-of-the-art image-based localization and sensor fusion approaches, which makes use of robust orientation information from FMU, to cope with camera fast motion and limit motion jitters. The proposed system runs at 30 fps on a standard PC and requires very limited set-up for its intended application.",
keywords = "augmented reality",
author = "L. Carozza and F. Bosch{\'e} and M. Abdel-Wahab",
year = "2014",
month = "11",
day = "6",
doi = "10.1109/ISMAR.2014.6948438",
language = "English",
pages = "257--258",
booktitle = "2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)",
publisher = "IEEE",
address = "United States",

}

Carozza, L, Bosché, F & Abdel-Wahab, M 2014, Visual-inertial 6-DOF localization for a wearable immersive VR/AR system. in 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, pp. 257-258, 2014 IEEE International Symposium on Mixed and Augmented Reality, Munich, Germany, 10/09/14. https://doi.org/10.1109/ISMAR.2014.6948438

Visual-inertial 6-DOF localization for a wearable immersive VR/AR system. / Carozza, L.; Bosché, F.; Abdel-Wahab, M.

2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 2014. p. 257-258.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Visual-inertial 6-DOF localization for a wearable immersive VR/AR system

AU - Carozza, L.

AU - Bosché, F.

AU - Abdel-Wahab, M.

PY - 2014/11/6

Y1 - 2014/11/6

N2 - We present a real-time visual-inertial localization approach directly integrable in a wearable immersive system for simulation and training. In this context, while CAVE systems typically require complex and expensive set-up, our approach relies on visual and inertial information provided by consumer monocular camera and Inertial Measurement Unit, embedded in a wearable stereoscopic HMD. 6-DOF localization is achieved through image registration with respect to a 3D map of descriptors of the training room and robust tracking of visual features. We propose a novel efficient and robust pipeline based on state-of-the-art image-based localization and sensor fusion approaches, which makes use of robust orientation information from FMU, to cope with camera fast motion and limit motion jitters. The proposed system runs at 30 fps on a standard PC and requires very limited set-up for its intended application.

AB - We present a real-time visual-inertial localization approach directly integrable in a wearable immersive system for simulation and training. In this context, while CAVE systems typically require complex and expensive set-up, our approach relies on visual and inertial information provided by consumer monocular camera and Inertial Measurement Unit, embedded in a wearable stereoscopic HMD. 6-DOF localization is achieved through image registration with respect to a 3D map of descriptors of the training room and robust tracking of visual features. We propose a novel efficient and robust pipeline based on state-of-the-art image-based localization and sensor fusion approaches, which makes use of robust orientation information from FMU, to cope with camera fast motion and limit motion jitters. The proposed system runs at 30 fps on a standard PC and requires very limited set-up for its intended application.

KW - augmented reality

U2 - 10.1109/ISMAR.2014.6948438

DO - 10.1109/ISMAR.2014.6948438

M3 - Conference contribution

SP - 257

EP - 258

BT - 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

PB - IEEE

ER -

Carozza L, Bosché F, Abdel-Wahab M. Visual-inertial 6-DOF localization for a wearable immersive VR/AR system. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE. 2014. p. 257-258 https://doi.org/10.1109/ISMAR.2014.6948438