KBNet: A Language and Vision Fusion Multi-Modal Framework for Rice Disease Segmentation.

Abstract

High-quality disease segmentation plays a crucial role in the precise identification of rice diseases. Although the existing deep learning methods can identify the disease on rice leaves to a certain extent, these methods often face challenges in dealing with multi-scale disease spots and irregularly growing disease spots. In order to solve the challenges of rice leaf disease segmentation, we propose KBNet, a novel multi-modal framework integrating language and visual features for rice disease segmentation, leveraging the complementary strengths of CNN and Transformer architectures. Firstly, we propose the Kalman Filter Enhanced Kolmogorov-Arnold Networks (KF-KAN) module, which combines the modeling ability of KANs for nonlinear features and the dynamic update mechanism of the Kalman filter to achieve accurate extraction and fusion of multi-scale lesion information. Secondly, we introduce the Boundary-Constrained Physical-Information Neural Network (BC-PINN) module, which embeds the physical priors, such as the growth law of the lesion, into the loss function to strengthen the modeling of irregular lesions. At the same time, through the boundary punishment mechanism, the accuracy of edge segmentation is further improved and the overall segmentation effect is optimized. The experimental results show that the KBNet framework demonstrates solid performance in handling complex and diverse rice disease segmentation tasks and provides key technical support for disease identification, prevention, and control in intelligent agriculture. This method has good popularization value and broad application potential in agricultural intelligent monitoring and management.

Plant phenotyping relevance

イネ葉の病斑という植物の病態を画像からセグメンテーションする新規手法を開発しており、病害識別のための表現抽出・境界推定が研究の中心である。

Code and data availability

The paper's rice disease segmentation images (1550 leaf images of Blast, Bacterial Blight, and Tungro) were sourced from the public PlantVillage dataset on Kaggle, which is publicly available at the allowed URL. However, the paper-specific derived assets — the authors' pixel-level Labelme segmentation masks, text描述, 4: