Real-time Detection of Hogweed: UAV Platform Empowered by Deep Learning

Alexander Menshchikov, Dmitry Shadrin, Viktor Prutyanov, Daniil Lopatkin, Sergey Sosnin, Evgeny Tsykunov, Evgeny Iakovlev, Andrey Somov

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)

Abstract

The Hogweed of Sosnowskyi (lat. Heracleum sosnówskyi) is poisonous for humans, dangerous for farming crops, and local ecosystems. This plant is fast-growing and has already spread all over Eurasia: from Germany to the Siberian part of Russia, and its distribution expands year-by-year. In-situ detection of this harmful plant is a tremendous challenge for many countries. Meanwhile, there are no automatic systems for detection and localization of hogweed. In this article, we report on an approach for fast and accurate detection of hogweed. The approach includes the Unmanned Aerial Vehicle (UAV) with an embedded system on board running various Fully Convolutional Neural Networks (FCNN). We propose the optimal architecture of FCNN for the embedded system relying on the trade-off between the detection quality and frame rate. We propose a model that achieves ROC AUC 0.96 in the hogweed segmentation task, which can process 4K frames at 0.46 FPS on NVIDIA Jetson Nano. The developed system can recognize the hogweed on the scale of individual plants and leaves. This system opens up a wide vista for obtaining comprehensive and relevant data about the spreading of harmful plants allowing for the elimination of their expansion.

Original languageEnglish
Article number9359491
Pages (from-to)1175-1188
Number of pages14
JournalIEEE Transactions on Computers
Volume70
Issue number8
DOIs
Publication statusPublished - 1 Aug 2021

Keywords

  • Deep learning
  • aerial imagery
  • edge computing
  • plant phenotype
  • precision agriculture
  • unmanned aerial vehicles

Fingerprint

Dive into the research topics of 'Real-time Detection of Hogweed: UAV Platform Empowered by Deep Learning'. Together they form a unique fingerprint.

Cite this