High-throughput 3D reconstruction of plants and its application to plant feature segmentation

Abstract

This study explores the development and evaluation of high-throughput 3D plant reconstruction and 2D feature detection and segmentation methods for plant phenotyping. A robotic system was employed to collect datasets of individual cucumber plants, utilizing automated mechanisms for efficient, high-throughput data acquisition. Three types of 3D reconstruction methods called Instant-NGP, Nerfacto, and 3D Gaussian Splatting were adopted and compared in terms of rendering quality and speed.Among them, 3D Gaussian Splatting performed the best, achieving PSNR: 25, SSIM: 0.84, LPIPS: 0.20, and also an impressive rendering speed of 6.39 FPS. Novel viewpoint renderings and depth maps further demonstrated its ability to generate accurate and photo-realistic representations of plants. Additionally, rendered images were utilized for training YOLO models to segment plant features into two classes: leaf and fruit. The YOLOv11s model achieved the highest F1 Score (0.932), balancing speed and accuracy. Ultra-view renderings and segmentation provided valuable insights into plant morphology, including leaf and fruit counts, paving the way for scalable, automated phenotyping applications. This study highlights the potential of integrating 3D Gaussian Splatting with advanced segmentation models for precise and efficient plant phenotyping.

Plant phenotyping relevance

植物の高スループット3D再構成、画像セグメンテーション、ロボット計測を開発・比較評価し、葉・果実数や形態の抽出に用いており、植物フェノタイピング手法が中心である。

Code and data availability

公開論文であることは確認できましたが、現在の公式API・許可済み取得経路では本文を自動取得できませんでした。

No evidence-backed public reproduction asset is currently recorded.