Active thermal imaging for immature citrus fruit detection

Abstract

Yield mapping for citrus fruit is a challenging task due to factors such as varying illumination conditions, clustering, and occlusions. Mapping the yield for immature citrus fruit presents an additional challenge that is the colours of fruit and leaves are almost identical. Commonly used machine vision techniques using colour cameras become less effective for immature citrus fruit detection. This study explores a novel active thermal imaging method to tackle the problem of colour similarity between immature citrus fruit and leaves. In this study, a thermal camera was combined with a water spray system that applied water mist to citrus trees. The water mist caused temperatures of both the fruit and leaf surfaces to change but at different rates. Multiple parameters of the spray system were experimented with the goal to induce as much temperature differences as possible between fruit and leaf surfaces. The combined system was tested in a citrus grove for fruit detections. Deep learning models were built based on the active thermal imaging system and tracking and fruit counting algorithms were created to count fruit in thermal videos. A mean average precision of 87.2% was achieved by the models and an accuracy of 96% was achieved when comparing the number of fruit counted by the algorithms with the true number of fruit counted manually in the field.

Plant phenotyping relevance

未熟果実を対象に、散水と熱画像を組み合わせた検出・計数手法を開発し、現地で性能検証している。果実数という植物器官の形質取得が中心である。

Code and data availability

公開本文の所在を確認できませんでした。非公開または購読が必要な可能性があります。

No evidence-backed public reproduction asset is currently recorded.