RTFVE-YOLOv9: Real-time fruit volume estimation model integrating YOLOv9 and binocular stereo vision

Abstract

This study proposes a real-time fruit volume estimation model based on YOLOv9 (RTFVE-YOLOv9) and binocular stereo vision technology to address the challenges of low automation and insufficient accuracy in fruit volume measurement in complex orchard environments, particularly in scenarios with diverse canopy structures and severe branch-leaf occlusion. The model achieves effective recognition of occluded fruits through the innovative design of a Dual-Scale and Global–Local Sequence (DSGLSeq) module while incorporating a Multi-Head and Multi-Scale Self-Interaction (MHMSI) module to improve the detection performance of small fruit targets. Systematic validation experiments conducted on major economic fruit tree varieties, including apples, pears, pomelos, and kiwifruit, demonstrate that RTFVE-YOLOv9 improved the mean Average Precision (mAP) by 2.1%, 1.6%, 4%, and 3.8% respectively on the four fruit datasets compared to the baseline YOLOv9-c model. The model’s internal working mechanisms were thoroughly revealed through multi-dimensional evaluation, including ablation experiments, Heatmap Analysis, and Effective Receptive Field (ERF) analysis, providing a theoretical foundation for subsequent optimization. The research findings enrich the application theory of computer vision in smart agriculture and provide reliable technical support for achieving precise orchard management.

Plant phenotyping relevance

果実の体積という植物器官形質を、YOLOv9と両眼ステレオビジョンで推定する手法を開発・検証しており、画像取得・計算による表現型推定が研究の中心である。

Code and data availability

公開状態または取得可能な本文経路を確認できませんでした。

No evidence-backed public reproduction asset is currently recorded.