Boosting plant-part segmentation of cucumber plants by enriching incomplete 3D point clouds with spectral data

Abstract

Plant scientists require high quality phenotypic datasets. Computer-vision based methods can improve the objectiveness and the accuracy of phenotypic measurements. In this paper, we focus on 3D point clouds for measuring plant architecture of cucumber plants, using spectral data and deep learning (DL). More specifically, the focus of this paper is on the segmentation of the point clouds, such that for each point it is known to which plant part (e.g. leaf or stem) it belongs. It was shown that the availability of spectral data can improve the segmentation, with the mean intersection-over-union rising from 0.90 to 0.95. Furthermore, we analysed the effect of uncertainty in the collection of ground truth data. For this purpose, we hand-labelled 264 point clouds of cucumber plants twice and show that the intra-observer variability between those two annotation sets can be as low as 0.49 for difficult classes, while it was 0.99 for the class with the least uncertainty. Adding the second set of hand-labelled data to the training of the network improved the segmentation performance slightly. Finally, we show the improved performance of a 4-class segmentation over an 8-class segmentation, emphasizing the need for a careful design of plant phenotyping experiments. The results presented in this paper contribute to further development of automated phenotyping methods for complex plant traits.

Plant phenotyping relevance

キュウリの3D点群とスペクトルデータを用いた植物部位分割手法を開発・評価し、植物構造形質の自動フェノタイピングに直接貢献するため、方法が中心的である。

Code and data availability

The paper describes 264 hand-labelled cucumber point clouds (two annotation sets) and a PointNet++-based segmentation method, but the supplied blocks contain no public dataset deposit, no author code repository, and no availability statement for the data, annotations, or trained model. The only URLs present are the CC 

No evidence-backed public reproduction asset is currently recorded.