Seed Protein Content Estimation with Bench-Top Hyperspectral Imaging and Attentive Convolutional Neural Network Models

Abstract

Wheat is a globally cultivated cereal crop with substantial protein content present in its seeds. This research aimed to develop robust methods for predicting seed protein concentration in wheat seeds using bench-top hyperspectral imaging in the visible, near-infrared (VNIR), and shortwave infrared (SWIR) regions. To fully utilize the spectral and texture features of the full VNIR and SWIR spectral domains, a computer-vision-aided image co-registration methodology was implemented to seamlessly align the VNIR and SWIR bands. Sensitivity analyses were also conducted to identify the most sensitive bands for seed protein estimation. Convolutional neural networks (CNNs) with attention mechanisms were proposed along with traditional machine learning models based on feature engineering including Random Forest (RF) and Support Vector Machine (SVM) regression for comparative analysis. Additionally, the CNN classification approach was used to estimate low, medium, and high protein concentrations because this type of classification is more applicable for breeding efforts. Our results showed that the proposed CNN with attention mechanisms predicted wheat protein content with R 2 values of 0.70 and 0.65 for ventral and dorsal seed orientations, respectively. Although, the R 2 of the CNN approach was lower than of the best performing feature-based method, RF (R 2 of 0.77), end-to-end prediction capabilities with CNN hold great promise for the automation of wheat protein estimation for breeding. The CNN model achieved better classification of protein concentrations between low, medium, and high protein contents, with an R 2 of 0.82. This study's findings highlight the significant potential of hyperspectral imaging and machine learning techniques for advancing precision breeding practices, optimizing seed sorting processes, and enabling targeted agricultural input applications.

Plant phenotyping relevance

小麦種子のタンパク質含量という植物器官形質を、ハイパースペクトル画像と画像位置合わせ・機械学習で推定する方法を開発・比較しており、表現型取得と推定手法が中心である。

Code and data availability

The paper's hyperspectral wheat seed images, Dumas protein reference data, and co-registration/model code are proprietary (Bayer Crop Science); the Data Availability Statement explicitly says 'Data are not available for public release.' The only public supplement (MDPI s1 link) contains only result tables (model hyper-

No evidence-backed public reproduction asset is currently recorded.