Illumination-aware image fusion for around-the-clock human detection in adverse environments from unmanned aerial vehicle

Research output: Contribution to journalArticlepeer-review

Abstract

This study proposes a novel illumination-aware image fusion technique and a Convolutional Neural Network (CNN) called BlendNet to significantly enhance the robustness and real-time performance of small human objects detection from Unmanned Aerial Vehicles (UAVs) in harsh and adverse operation environments. The proposed solution is particular useful for mission-critical public safety applications such as search and rescue operations in rural areas. The operation environments of such missions are featured with poor illumination condition and complex background such as dense vegetation and undergrowth in diverse weather conditions, and the missions have to address the challenges of detecting humans from UAVs at high altitudes, with a moving platform and from various viewing angles. To overcome these challenges, the proposed solution register and fuse the images using Enhanced Correlation Coefficient (ECC) and arithmetic image addition with customised weights techniques. The result of this fusion is fuelled with our new BlendNet AI model achieving 95.01 % of accuracy with 42.2 Frames Per Second (FPS) on Titan X GPU with input size of 608 pixels. The effectiveness of the proposed fusion method has been evaluated and compared with other methods using the KAIST public dataset. The experimental results show competitive performance of BlendNet in terms of both visual quality as well as quantitative assessment of high detection accuracy at high speed.

Original languageEnglish
Article number117413
JournalExpert Systems with Applications
Volume204
Early online date6 May 2022
DOIs
Publication statusE-pub ahead of print - 6 May 2022

Keywords

  • human detection
  • UAV
  • deep machine learning
  • image fusion
  • image registration

Fingerprint

Dive into the research topics of 'Illumination-aware image fusion for around-the-clock human detection in adverse environments from unmanned aerial vehicle'. Together they form a unique fingerprint.

Cite this