A Dual-Side Synergistic LoRA Framework for Full-Chain Fine-Tuning of Qwen2.5-VL for Plant Disease Diagnosis.

Abstract

The emergence of multimodal large language models (MLLMs) is opening a new avenue for explainable and interactive intelligent diagnosis in agriculture. However, generic MLLMs still face two major obstacles in plant disease recognition-insufficient fine-grained visual perception and misalignment between visual and linguistic features-which jointly limit diagnostic accuracy. To address these issues, we propose a Qwen2.5-VL-based full-chain fine-tuning framework termed dual-side synergistic low-rank adaptation. Unlike the mainstream paradigm that freezes the vision encoder, our method injects trainable LoRA adapters into both the vision encoder and the large language model, while establishing end-to-end gradient backpropagation across the entire multimodal pipeline. By using the supervision signal from autoregressive text generation (text-supervised visual learning), the framework directly drives deep optimization of visual representations, thereby enabling coordinated alignment between pixel-level perception and semantic-level understanding. We trained Qwen over CDDM and conducted in-domain (CDDM) and cross-domain (PlantVillage) experiments. The results show that the proposed 7B-parameter model achieves 98.8 and 96.0% diagnostic accuracy under in-domain and cross-domain scenarios, respectively. The recognition accuracy of Qwen in the case of cross-domain only decreases slightly, which demonstrates that the MLLM trained by our method exhibits excellent cross-domain recognition capability. This indicates that our method can significantly improve the robustness and generalization ability of MLLM in complex agricultural scenarios.

Plant phenotyping relevance

植物画像から病害状態を診断するMLLMのファインチューニング手法を開発し、ドメイン内外で精度検証しているため、植物フェノタイピング手法が中心である。

Code and data availability

The paper fine-tunes Qwen2.5-VL on the public CDDM dataset and evaluates on PlantVillage, but both are cited third-party datasets, not paper-specific assets. The Data Availability Statement offers no public code, models, or data: 'Further inquiries can be directed to the corresponding author.' No author-deposited code,

No evidence-backed public reproduction asset is currently recorded.