A-Occ-Plant: Plant occluded point cloud completion via amodal segmentation

Abstract

Plants are geometrically and topologically complex objects, and methods and devices that produce plant point clouds often miss parts due to self occlusions, making further analysis, such as phenotypic trait extraction or 3D reconstruction, difficult. We introduce A-Occ-Plant , a novel method for point cloud completion. The first novelty of our algorithm is converting point clouds into a set of images, which are then completed using 2D amodal segmentation. The images are then converted into a complete point cloud by using view-consistent Gaussian splats. The second novelty is the use of a coarse-to-fine hierarchical Transformer with cross-scale attention. The completed soft masks are fused into a continuous 3D density field using Gaussian splatting, removing the need for external pose estimation or fixed-size inputs. We introduce a synthetic dataset using a procedural model and a real-world plant reconstruction benchmark with artificially generated occlusions. We further benchmark A-Occ-Plant against representative 3D point-cloud completion methods, demonstrate that it recovers downstream phenotypic traits (leaf count, leaf angle, plant height), and show that it generalizes to another crops (soybean). A-Occ-Plant achieves a 264.8% improvement in LPIPS and an 8.3% gain in SSIM compared to the current state of the art, while using only 2.3% of the parameters and running 39.4× faster. We release our code at https://github.com/JaeLee18/PlantPhenomics_Occlusion.

Plant phenotyping relevance

植物の遮蔽点群を補完し、葉数・葉角度・草丈という表現型形質を復元する手法を開発しており、データセット作成とベンチマーク検証も中心的に行っている。

Code and data availability

The paper explicitly releases authors' code and sample data (inference code, sample data for reproducing results) via a Google Drive project download and a GitHub repository, both with explicit availability statements and public URLs.