A novel infrared video surveillance system using deep learning based techniques

Huaizhong Zhang, Chunbo Luo, Qi Wang, Matthew Kitchin, Andrew Parmley, Jesus Monge-Alvarez, Juan Pablo Casaseca

    Research output: Contribution to journalArticlepeer-review

    33 Citations (Scopus)
    141 Downloads (Pure)

    Abstract

    This paper presents a new, practical infrared video based surveillance system, consisting of a resolution-enhanced, automatic target detection/recognition (ATD/R) system that is widely applicable in civilian and military applications. To deal with the issue of small numbers of pixel on target in the developed ATD/R system, as are encountered in long range imagery, a super-resolution method is employed to increase target signature resolution and optimise the baseline quality of inputs for object recognition. To tackle the challenge of detecting extremely low-resolution targets, we train a sophisticated and powerful convolutional neural network (CNN) based faster-RCNN using long wave infrared imagery datasets that were prepared and marked in-house. The system was tested under different weather conditions, using two datasets featuring target types comprising pedestrians and 6 different types of ground vehicles. The developed ATD/R system can detect extremely low-resolution targets with superior performance by effectively addressing the low small number of pixels on target, encountered in long range applications. A comparison with traditional methods confirms this superiority both qualitatively and quantitatively.
    Original languageEnglish
    Pages (from-to)26657-26676
    Number of pages20
    JournalMultimedia Tools and Applications
    Volume77
    Issue number20
    Early online date11 Apr 2018
    DOIs
    Publication statusE-pub ahead of print - 11 Apr 2018

    Keywords

    • Video surveillance
    • CNN
    • Object detection
    • ATD/R
    • Super-resolution

    Fingerprint

    Dive into the research topics of 'A novel infrared video surveillance system using deep learning based techniques'. Together they form a unique fingerprint.

    Cite this