F2DMAS: a smartphone video-based 3D phenotyping workflow for potted plants in complex backgrounds

Abstract

Introduction: Plant phenotyping requires accurate and repeatable three-dimensional structural information, but practical acquisition conditions in greenhouses, seedling rooms, and indoor pot experiments often include complex backgrounds, handheld motion blur, and thin leaf structures. These factors reduce the robustness of conventional three-dimensional reconstruction methods and limit their use in low-cost and automated phenotyping. Methods: To address this problem, this paper proposes F2DMAS, an automated three-dimensional plant phenotyping workflow using consumer-grade smartphone videos. The workflow first converts multiview RGB videos into image sequences and removes motion-blurred frames through frequency-domain quality filtering. A frequency-spatial plant segmentation module, termed FSAM3, is then introduced to separate plant structures from complex backgrounds without task-specific annotated training data. The segmented image sequences are further reconstructed using 2D Gaussian Splatting, followed by TSDF-based meshing, scale recovery, and virtual measurement for extracting plant height, canopy width, leaf length, and leaf width. Results: Experiments were conducted on 15 plant species under two acquisition scenarios. The proposed workflow achieved stable plant reconstruction under non-ideal background conditions, with PSNR, SSIM, and LPIPS values of 31.09, 0.9711, and 0.0365, respectively. Compared with the baseline reconstruction workflow, F2DMAS substantially reduced the processing time for mesh extraction while improving reconstruction quality. The extracted phenotypic traits showed strong agreement with manual measurements, with R² values ranging from 0.90 to 0.99, RMSE values ranging from 0.64 to 1.21 cm, and MAPE values ranging from 4.50% to 9.73%. Discussion: These results indicate that F2DMAS can provide an end-to-end workflow from smartphone video acquisition and plant segmentation to three-dimensional reconstruction and phenotypic trait extraction. The proposed method offers a practical and deployable solution for greenhouse seedling cultivation, potted plant experiments, and low-cost three-dimensional plant phenotyping.

Plant phenotyping relevance

スマートフォン動画から植物の3D構造を再構成し、複数の形態形質を抽出・検証するワークフロー自体が中心的な方法論的貢献である。

Code and data availability

The supplied blocks describe the F2DMAS workflow, plant materials (Table 1), and acquisition protocols, but contain no data availability statement, repository link, or public dataset/code deposit. The paper-specific smartphone video dataset and analysis code are not shown to be publicly available.

No evidence-backed public reproduction asset is currently recorded.