MSDDG: Multi-scale dual-discriminator GAN for point cloud completion of plant

Abstract

Plant 3D reconstruction using optical imaging often suffers from incomplete point clouds due to viewpoint occlusion and sensor limitations. This incompleteness hinders accurate structural representation and subsequent feature extraction for plant analysis. To address these challenges, we propose a Multi-Scale Dual-Discriminator Generative Adversarial Network (MSDDG) for plant point cloud completion. A multi-scale point cloud generator (MSPG) that integrates local and global features from raw incomplete point clouds is used for MSDDG to reconstruct complete shapes. The dual-discriminators-a multi-view projected silhouette discriminator and a spatial distance discriminator-are designed to ensure geometric realism and spatial plausibility from multiple perspectives. To train MSDDG, we created the Plant4L dataset containing four plant species (sunflower, pumpkin, luffa, and eggplant) with high-quality 3D models augmented via 3D thin plate spline transformations and virtual occlusion simulation to generate incomplete point clouds and multi-view silhouettes. Experimental results on Plant4L demonstrate that MSDDG achieves superior completion performance, with Chamfer Distance (CD), Hausdorff Distance (HD), and Uniformity Chamfer Distance (UCD) all below 0.41. Comparative evaluations confirm MSDDG's superiority over previous point cloud completion methods. The application of MSDDG for 3D reconstruction from single view further validate its effectiveness in restoring occluded plant structures.

Plant phenotyping relevance

植物の不完全点群を補完して3D構造を再構成する手法を開発し、植物データセット上で比較評価・検証しており、表現型取得ワークフローが中心です。

Code and data availability

The paper's data availability statement explicitly states that the source code and datasets (including the Plant4L point cloud completion dataset) are publicly available at the authors' GitHub repository.