Smartphone-based real-time object recognition architecture for portable and constrained systems

Research output: Contribution to journalArticlepeer-review

4 Downloads (Pure)

Abstract

Machine learning algorithms based on Convolutional Neural Networks (CNNs) have recently been explored in a myriad of object detection applications. Nonetheless, many devices with limited computation resources and strict power consumption constraints are not suitable to run such algorithms designed for high-performance computers. Hence, a novel smartphone-based architecture intended for portable and constrained systems is designed and implemented to run CNN-based object recognition in real-time and with high efficiency. The system is designed and optimised by leveraging the integration of the best of its kind from the state-of-the-art machine learning platforms including OpenCV, TensorFlow Lite, and Qualcomm Snapdragon informed by empirical testing and evaluation of each candidate framework in a comparable scenario with a high demanding neural network. The final system has been prototyped combining the strengths from these frameworks and led to a new machine learning-based object recognition execution environment embedded in a smartphone with advantageous performance compared with the previous frameworks.
Original languageEnglish
Number of pages13
JournalJournal of Real-Time Image Processing
Early online date1 Sep 2021
DOIs
Publication statusE-pub ahead of print - 1 Sep 2021

Keywords

  • machine learning
  • object recognition
  • deep learning platforms
  • CNN
  • YOLOv3
  • embedded systems

Fingerprint

Dive into the research topics of 'Smartphone-based real-time object recognition architecture for portable and constrained systems'. Together they form a unique fingerprint.

Cite this