Parallel Fusion Neural Network Considering Local and Global Semantic Information for Citrus Tree Canopy Segmentation

Abstract

Existing convolutional neural network (CNN)-based methods usually tend to ignore the contextual information for citrus tree canopy segmentation. Although popular Transformer models are helpful in extracting global semantic information, they ignore the edge details between citrus tree canopies and the background. To address these issues, we propose a parallel fusion neural network considering both local and global semantic information for citrus tree canopy segmentation from 3D data, which are derived by unmanned aerial vehicle (UAV) mapping. In the feature extraction stage, a parallel architecture, concatenated by EfficientNet-V2 and CSwin Transformer, is used to extract local and global information of citrus trees. In the feature fusion stage, we design a coordinate attention-based fusion module to retain the contextual information and local edge details of citrus tree canopies. Additionally, to exaggerate the exclusivity between tree canopies and complex backgrounds, 3D data incorporating RGB imagery and canopy height model derived by UAV photogrammetry are generated for citrus tree canopy segmentation. Experimental results indicate that the proposed method performs considerably better than methods based only on CNN or Transformer models, and is superior to state-of-the-art methods (e.g., the highest mIoU score of 93.46%).

Plant phenotyping relevance

柑橘樹冠を対象とする3D画像セグメンテーション手法の開発・比較が中心であり、樹冠という植物形態状態を抽出するため、植物フェノタイピング手法として適格。

Code and data availability

The supplied blocks describe the citrus tree canopy segmentation method, UAV data collection, and experiments, but contain no data availability statement, public dataset deposit, or author code/model release with a URL. The only URL present is the CC BY-NC-ND license notice, which is not a paper-specific asset.

No evidence-backed public reproduction asset is currently recorded.