TeaNeRF: an integrated 3D visual perception pipeline for tea bud harvesting

Abstract

Accurate perception of tea buds is a fundamental prerequisite for intelligent and precise tea harvesting planning. However, in real tea plantation environments, reliable harvesting-oriented perception at the planning level remains highly challenging due to the small size of tea buds, severe occlusion, complex background clutter, and the lack of accurate three-dimensional spatial information. To address these challenges, we propose TeaNeRF, an integrated three-dimensional visual perception pipeline designed for harvesting-oriented tea bud analysis. Instead of treating detection, segmentation, and spatial analysis as independent tasks, TeaNeRF integrates sequential two-dimensional recognition, monocular depth estimation, and neural radiance field reconstruction into a coherent perception pipeline, allowing accurate spatial understanding of tea buds in complex natural scenes. It should be noted that the proposed integration is conducted at the perception-output level, where multiple modular components are connected through fixed interfaces, rather than through joint optimization or an end-to-end trainable formulation. The proposed framework combines an enhanced YOLO-based detector, prompt-guided segmentation, and monocular depth priors to guide NeRF-based three-dimensional reconstruction. By incorporating depth supervision and semantic-aware neural fields, TeaNeRF generates dense and geometrically consistent point clouds with reliable semantic separation. Quantitative evaluations show consistent improvements in reconstruction fidelity, as reflected by increased PSNR and reduced LPIPS across multiple tea tree scenes. Based on the reconstructed semantic point cloud, a three-dimensional clustering and geometric fitting strategy is further developed to enable tea bud counting and harvesting-oriented candidate point estimation at the perception level. Experiments conducted on a real-world dataset of 4,700 tea plantation images demonstrate that TeaNeRF improves detection accuracy (mAP@50 = 91.7%), segmentation quality (IoU = 0.640), and overall three-dimensional perception performance. Case-level counting results on representative tea trees indicate that the proposed 3D semantic point cloud-based approach can provide feasible tea bud counting behavior and consistent spatial guidance cues for downstream harvesting planning. By providing structured three-dimensional spatial information, including tea bud locations, counts, and harvesting-oriented candidate points, TeaNeRF offers practical perception-level outputs for downstream planning in automated tea harvesting systems.

Plant phenotyping relevance

茶芽の検出・セグメンテーション・3D再構成を統合し、茶芽の計数と3D位置推定を行う知覚パイプラインが研究の中心であり、単なる収穫対象の局在化を超えた器官形質の抽出を含む。

Code and data availability

The paper's 4,700-image tea bud dataset and trained models are not publicly deposited; the data availability statement only promises raw data from the authors on request. The arXiv URLs in the text are citations of prior work (SAM2, Inner-IoU), not paper-specific assets.

No evidence-backed public reproduction asset is currently recorded.