AI driven multi modal deep learning system for wheat disease detection, yield prediction, and crop health monitoring

Abstract

Sustainable wheat farming is challenging. Real-time information on crop health, disease transmission, and anticipated yields is essential for farmers. However, they frequently use slow, expensive, or non-communicative tools. This project develops a workable solution. There is no need for massive server farms because the entire system operates on a single graphics card. It incorporates images of wheat fields, Indian farming notes, greenhouse records, harvest statistics, and NASA meteorological data. Consider them as various “eyes” for crop photo analysis, and we tried several lightweight computer vision models. ConvNeXt-Tiny was slower but could operate on older equipment with 75% accuracy; EfficientNetB0 recognised wheat heads with 92% accuracy; and AgroMark, a hybrid solution that merged photo analysis with agricultural metadata (soil type, rainfall, increased to 87%, etc. Combining picture analysis with attention mechanisms (CBAM) allowed us to anticipate the amount of wheat that a field will yield based on these photo insights, and the results showed that our predictions were accurate, with an R 2 score of 0.97. Additionally, we developed a versatile detector that simultaneously detects disease, stress, head count, and pests. It is adjusted to deal with training data that is unbalanced (some diseases are common, while others are rare). As we packed everything into a 16-GB graphics card, we spent real time determining which strategies smaller training sets, removing weak features, and adjusting loss functions, work. We encounter real-world obstacles along the road, such as photographs from different locations not always match, mislabeled photographs from different locations not always match, mislabeled diseases, and neglected rare pests. Our step-by-step instructions, charts, and code are available.

Plant phenotyping relevance

小麦画像から病害・ストレス・穂数・収量などの植物形質・状態を推定するマルチモーダル手法を開発し、複数モデルの精度比較と実装上の検証を行っており、表現型取得・推定が研究の中心である。

Code and data availability

The paper builds its multimodal wheat phenotyping analysis on several explicitly cited public data assets: the Kaggle Wheat Plant Diseases image dataset (used for disease classification, Tables 2 and 9), the Global Wheat Head Detection dataset (used for head detection, Tables 1 and 6), FAOSTAT and India Open Government