Ontology-coupled active contours for dynamic video scene understanding

Joanna I. Olszewska, Thomas L. McCluskey

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

21 Citations (Scopus)

Abstract

In this paper, we present an innovative approach coupling active contours with an ontological representation of knowledge, in order to understand scenes acquired by a moving camera and containing multiple non-rigid objects evolving over space and time. The developed active contours enable both segmentation and tracking of multiple targets in each captured scene over a video sequence with unknown camera calibration. Hence, this active contour technique provides information on the objects of interest as well as on parts of them (e.g. shape and position), and contains simultaneously low-level characteristics such as intensity or color features. The ontology we propose consists of concepts whose hierarchical levels map the granularity of the studied scene and of a set of inter- and intra-object spatial and temporal relations defined for this framework, object and sub-object characteristics e.g. shape, and visual concepts like color. The system obtained by coupling this ontology with active contours can study dynamic scenes at different levels of granularity, both numerically and semantically characterize each scene and its components i.e. objects of interest, and reason about spatiotemporal relations between them or parts of them. This resulting knowledge-based vision system was demonstrated on real-world video sequences containing multiple mobile highly-deformable objects.
Original languageEnglish
Title of host publication2011 15th IEEE International Conference on Intelligent Engineering Systems
PublisherIEEE
Pages369-374
Number of pages6
ISBN (Electronic)9781424489565
ISBN (Print)9781424489541
DOIs
Publication statusPublished - 14 Jul 2011
Externally publishedYes

Keywords

  • ontologies
  • active contours
  • visualization
  • cameras
  • image color analysis
  • semantics

Fingerprint

Dive into the research topics of 'Ontology-coupled active contours for dynamic video scene understanding'. Together they form a unique fingerprint.

Cite this