Discriminative feature representations and heterogeneous fusion for plant leaf recognition

Abstract

Effective feature representation and heterogeneous fusion are essential for plant leaf recognition. However, existing methods have several limitations, such as insufficient comprehensiveness and distinctiveness in feature representation, as well as a lack of full consideration for the compatibility and complementarity in heterogeneous fusion. In the end, we propose a discriminative shape representation named the bag of multiscale curvature angle cuts (BMCAC) to capture fine curvature and spatial distribution characteristics, an advanced deep representation called the progressive salient deep representation (PSDR) to fully exploit deep convolutional features, and an effective fusion framework termed the K-weighted shape and deep feature fusion (KWFF) to aggregate the local context and global importance of heterogeneous features. Specifically, BMCAC is derived from the curvature angle cuts (CAC), multiscale analysis, and the bag of visual words (BoVW) model; PSDR is constructed by applying progressive downsampling and hierarchical pooling operations to deep convolutional features; and KWFF is developed by encoding neighboring information using homogeneous distance measures while incorporating globally weighted contributions from heterogeneous distance measures. Extensive experiments on four well-known benchmark leaf datasets demonstrate that the proposed shape and deep representations can efficiently extract leaf image features, and the fusion framework can effectively integrate heterogeneous features, outperforming state-of-the-art methods. The source code is available at https://github.com/Mumuxi1123/BMCAC_PSDR_KWFF.

Plant phenotyping relevance

植物葉画像から形状・深層特徴を抽出し、認識のために融合する新規手法を開発・評価しており、葉の画像ベース表現抽出が研究の中心である。

Code and data availability

公開状態または取得可能な本文経路を確認できませんでした。

No evidence-backed public reproduction asset is currently recorded.