From occlusion to 3D: amodal completion-assisted single-view wheat reconstruction

Abstract

Occlusion is a major factor limiting accurate three-dimensional (3D) wheat phenotyping. In natural growth conditions, overlapping spikes, leaves, and stems often make only partial target regions visible in single-view images, hindering complete and reliable 3D reconstruction. To address this problem, this study proposes an amodal completion-assisted, sequential framework for single-view 3D reconstruction of occluded wheat. The framework first uses visible prompts to recover the complete appearance and structural cues of occluded targets, and then feeds the completed images into single-view 3D reconstruction models to generate complete 3D structures. We construct the MMWO (Multi-view Multi-instance Wheat Occlusion) dataset from MMW, which is captured under controlled indoor scenarios, by synthesizing diverse occlusion samples through organ-level cutouts, random geometric transformations, and region-constrained pasting, with annotations including visible masks, occlusion masks, and complete target images. Six representative reconstruction methods, including Direct3D, Real3D, SF3D, Spar3D, TRELLIS.2, and Hunyuan3D, are systematically evaluated. Hunyuan3D achieves the best geometric performance, with the lowest mean CD- \(L_1\) and CD- \(L_2\) values of 0.1286 and 0.0536, and the highest mean F-score of 0.5668. SF3D achieves the best rendering quality in terms of PSNR, SSIM, and LPIPS. In addition, Pix2Gestalt completion reduces the estimation errors of spike length, width, and area from 9.31%, 10.89%, and 32.23% to 4.64%, 9.70%, and 9.45%, respectively. These results demonstrate that amodal completion can effectively alleviate occlusion-induced information loss and provide more complete structural priors for single-view 3D wheat reconstruction. This study offers a feasible solution for 3D wheat phenotyping under occlusion and provides a systematic reference for applying 3D generative models to agricultural phenotyping.

Plant phenotyping relevance

遮蔽下の単一画像から小麦器官を3D再構成し、形質推定精度を改善する手法を開発・比較検証しており、植物フェノタイピング手法が中心である。

Code and data availability

公開論文であることは確認できましたが、現在の公式API・許可済み取得経路では本文を自動取得できませんでした。

No evidence-backed public reproduction asset is currently recorded.