A Robust Deep Learning Approach for the Quantitative Characterization and Clustering of Peach Tree Crowns Based on UAV Images

Abstract

The accurate large-scale measurement of peach crowns is vital in horticultural science and the optimization of orchard management. Nowadays, numerous crown parameters (e.g., crown area, height, and volume) can be obtained via the analysis of point clouds or photographs. Current laser-based sensors provide the required reliable and accurate information; however, they are costly and time-consuming. Therefore, a simpler approach for crown measurement is required. For this purpose, this study presents a pipeline for the monitoring and clustering of 259 peach tree crowns based on unmanned aerial vehicle (UAV) images of a peach orchard in Southeast China. Considering the limitation that the original aerial image dataset contains little information, a data augmentation process is adopted, and an efficient deep learning architecture based on conditional generative adversarial networks (cGANs) was designed to extract the crown area. Then, the shape of the crown area was clustered using an edge detection process and a$k$-means algorithm. Finally, an ellipsoid volume method (EVM) was applied to estimate the crown volume. Five indicators—namely,$Q_{\mathrm {seg}}$,$S_{\mathrm {r}}$, Precision, Recall, and F-measure—were employed to evaluate the crown extraction effects, and the average results for testing samples were 0.832, 0.847, 0.851, 0.828, and 0.846, respectively. Compared with other approaches—namely, fully convolutional network (FCN), U-Net, SegNet21, the excess green index (ExG), and the color index of vegetation extraction (CIVE)—the proposed cGAN model performs better, achieving an accuracy improvement of 5%–25%. For the estimation of crown volume, using measurements from a light detection and ranging (LIDAR) scanner as a reference, the correlation coefficient and relative-root-mean-square error (R-RMSE) were found to be 0.836% and 14.93%, respectively. Overall, the results demonstrate that the proposed method is feasible for measuring peach tree crowns. The wide application of such technology would facilitate applied research in plant phenotyping and precision horticulture.

Plant phenotyping relevance

UAV画像から桃樹冠の面積・形状・体積を抽出・推定する深層学習パイプラインを開発し、他手法およびLiDAR基準で技術評価しており、植物表現型取得が中心です。

Code and data availability

公開本文の所在を確認できませんでした。非公開または購読が必要な可能性があります。

No evidence-backed public reproduction asset is currently recorded.