WheatScoper: A lightweight organ-based framework for multi-view wheat phenotyping using time-series RGB images

Abstract

Accurate and dynamic monitoring of wheat phenotypes is essential for breeding decision-making and crop management. However, RGB image-based phenotyping still suffers from expensive pixel-level annotation, unstable organ-level segmentation across growth stages, and limited multi-trait extraction under complex field conditions. To address these issues, a high-throughput phenotyping framework (WheatScoper) was proposed, enabling organ-level segmentation and plot-level multi-trait extraction. To reduce annotation cost, a structure-aware geometry-assisted annotation (SAGA) algorithm was developed, yielding an approximately 7.6-fold improvement in annotation efficiency over fully manual annotation. To enable efficient organ-level segmentation, a lightweight semantic segmentation network (WheatScopeNet) was developed by integrating parallel hybrid spatial modeling with cross-scale feature fusion. On the held-out test set from the same site and growing season, WheatScopeNet achieved an mIoU of 0.869 and an mDice of 0.930. Leveraging the segmentation results, an automated system was established to extract 41 multi-view image-derived traits (I-traits) across four core phenotypic dimensions. The extracted I-traits supported the estimation of eight manually measured agronomic traits, with R 2 values ranging from 0.477 to 0.697. Notably, the correlations between stay-green-related-traits and yield varied distinctly with viewing-position. Only upper side-view indicators remained significantly correlated with yield, with Side-up final GPAR showing the strongest association, whereas top-view GPAR-derived indicators showed weak associations. Finally, a web-based platform integrating cascaded inference, segmentation visualization, and automatic I-trait extraction was developed. The platform provides an end-to-end solution for field wheat phenotyping and supports breeding decision-making and crop management.

Plant phenotyping relevance

RGB画像から小器官を分割し、多数の植物形質を自動抽出・推定する手法とプラットフォームが研究の中心であるため、植物フェノタイピング手法として明確に採用。

Code and data availability

公開論文であることは確認できましたが、現在の公式API・許可済み取得経路では本文を自動取得できませんでした。

No evidence-backed public reproduction asset is currently recorded.