A Low-Cost Framework for 3D Phenotyping of Sugarcane via Instance Segmentation and 3D Gaussian Splatting

Abstract

Sugarcane is an important economic crop, and key phenotypic traits such as plant height and leaf area play a crucial role in yield potential assessment and breeding selection. However, the quantification of these traits currently relies mainly on inefficient and destructive manual measurements, making it difficult to achieve continuous monitoring of plant growth. To address this limitation, this study integrates a YOLOv8x-seg instance segmentation model with 3D Gaussian Splatting (3DGS) and proposes a non-contact, high-precision 3D phenotyping method based on low-cost data acquisition using a smartphone. Multi-view RGB images are first processed using YOLOv8x-seg to extract plant foreground masks, which are then used as inputs for 3DGS-based reconstruction to generate 3D models. Plant height is automatically measured from the reconstructed models, while leaf area extraction involves a semi-automatic workflow combining image processing and manual steps. Experimental results demonstrate that the proposed approach enables accurate trait estimation, achieving a coefficient of determination (R2) of 0.9644 for plant height estimation (evaluated on a subset of 15 plants, with a mean absolute percentage error of approximately 1.5%) and an R2 of 0.8551 for leaf area estimation (validated on 10 plants). Ground-truth plant height was measured using a telescopic measuring rod, and leaf area was determined through destructive measurement with a leaf area meter (LI-COR Model LI-3000A). Ground-truth plant height values were obtained using a telescopic measuring rod, and leaf area was determined through destructive measurement with a leaf area meter (LI-COR Model LI-3000A). This method demonstrates the feasibility of using consumer-grade devices for high-fidelity 3D phenotyping and offers an effective approach for high-throughput sugarcane breeding applications.

Plant phenotyping relevance

スマートフォン画像、インスタンスセグメンテーション、3D再構成を統合し、サトウキビの草高・葉面積を自動／半自動推定するフェノタイピング手法を開発・検証しており、方法が研究の中心である。

Code and data availability

The paper's sugarcane video/phenotype dataset is only available from the corresponding author upon reasonable request, and no author analysis code, models, or public data repository is disclosed. The only public URL mentioned (graphdeco-inria/gaussian-splatting) is the generic third-party 3DGS framework, not a paper-­­

No evidence-backed public reproduction asset is currently recorded.