Concept and rule guided neural network for early crop leaf nutrient deficiency diagnosis

Abstract

Crop nutrition deficiency poses a major challenge to achieving optimal yield, particularly in smallholder farming systems where timely expert diagnosis is limited. Early detection is crucial to minimize losses and reduce unnecessary fertilizer or pesticide usage. While deep learning offers potential for automated visual diagnosis, most existing approaches operate as black boxes and lack interpretability, explainability, or actionable recommendations. In this work, we present a neurosymbolic framework for early nutrient deficiency detection in ash gourd leaves using the EarlyNSD dataset. Our approach integrates a ResNet-50 backbone with a dual-head design: a classification head for deficiency prediction and a concept-prediction head that quantifies physiologically meaningful visual patterns such as yellowing, edge discoloration, spots, and vein greenness. These concept scores are combined with predefined domain rules to guide the learning of the neural component and to generate transparent, human-aligned explanations for each diagnosis. Building on the model outputs, we incorporate a Retrieval Augmented Generation (RAG)-based pipeline along with an agricultural knowledge base to generate targeted recommendations. This approach overcomes key shortcomings of pure neural models by incorporating domain knowledge in the form of differentiable fuzzy logic rules. The study demonstrates that the proposed framework improves both classification performance and interpretability compared to standard ResNet baselines. Grad-CAM analysis demonstrates that concept-guided attention aligns with symptom-specific regions, such as yellowed areas for Nitrogen deficiency or marginal discoloration for Potassium deficiency, providing visual validation of the reasoning process. Since EarlyNSD is limited in scale and visual diversity, the results are not directly comparable to large open-field datasets. Overall, our results establish a proof of concept for integrating neural detection with symbolic reasoning, enabling interpretable, actionable, and domain-informed nutrient management for practical applications.

Plant phenotyping relevance

葉画像から栄養欠乏状態と症状形質を推定する解釈可能な画像解析手法が研究の中心であり、植物表現型の取得・抽出に該当する。

Code and data availability

公開論文であることは確認できましたが、現在の公式API・許可済み取得経路では本文を自動取得できませんでした。

No evidence-backed public reproduction asset is currently recorded.