Generation of labeled leaf point clouds for plants trait estimation.

Abstract

Today, leaf trait estimation remains a labor-intensive process. The effort to obtain ground truth measurements limits how accurately this task can be performed automatically. Traditionally, plant scientists manually measure the traits of harvested leaves and associate them with sensor data, which is key for training machine learning approaches and to automate the processes. In this paper, we propose a neural network-based method to generate synthetic 3D point clouds of leaves with their associated traits to support approaches for phenotyping. We use real-world leaf point clouds to learn how to generate realistic leaves from a leaf skeleton, which is automatically extracted. We use the generated leaves to fine-tune different leaf trait estimation methods. We evaluate our generated data using different trait estimation methods and compare the results to using real-world data or other synthetic datasets from agricultural simulation software. Experiments show that our approach generates leaf point clouds with high similarity to real-world leaves. Tuning trait estimation methods on our generated data improves their performance in the estimation of real-world leaves' traits, making our data crucial for developing and testing data-driven trait estimation methods. Accurate trait estimation is key to understanding crop growth, productivity, and pest resistance, as leaf size directly influences photosynthesis, yield potential, and vulnerability to insects and fungal growth.

Plant phenotyping relevance

葉の形質推定を支援するため、形質付き合成3D点群を生成するニューラルネットワーク手法とデータセットを開発・評価しており、フェノタイピング手法が中心である。

Code and data availability

The paper uses two public 3D plant point-cloud datasets (Pheno4D and BonnBeetClouds3D) as real-world inputs for training/evaluating its leaf trait estimation and generation pipeline; both have explicit public URLs. The authors' code is only promised ('We plan to make our code publicly available'), so it is not yet an a