Visual-language transformer-based tomato leaf disease detection for portable greenhouse monitoring device.

Abstract

Tomato leaf diseases pose a significant threat to global food security, necessitating accurate and efficient detection methods. This paper introduces the Tomato Leaf Disease Visual Language Model (TLDVLM), a novel approach based on the BLIP-2 architecture enhanced with Low-Rank Adaptation (LoRA), for precise classification of 10 distinct tomato leaf diseases. Our methodology integrates a sophisticated image preprocessing pipeline, utilizing GroundingDINO for robust leaf detection and SAM-2 for pixel-level segmentation, ensuring that the model focuses solely on relevant plant tissue. The TLDVLM leverages the powerful multimodal understanding of BLIP-2, with LoRA applied to its Q-Former module, enabling parameter-efficient fine-tuning without compromising performance. Comparative experiments demonstrate that the TLDVLM significantly outperforms baseline models, including CLIP-LoRA and ConvNeXT-tiny, achieving an accuracy of 97.27%, a precision of 0.9587, a recall of 0.9789, and an F1-score of 0.9681. Beyond classification, the finetuned TLDVLM checkpoints are integrated into a practical application for new image inference. This application displays the raw and segmented images, the predicted disease, and offers functionalities to fetch comprehensive information on disease causes and remedies using external APIs (e.g., OpenAI), with an option to download a PDF summary for offline access on a portable device. This research highlights the potential of LoRA-adapted Vision-Language Models in developing highly accurate, efficient, and user-friendly agricultural diagnostic tools.

Plant phenotyping relevance

トマト葉の病害状態を画像から分類する手法を開発・比較評価しており、植物病害表現型の取得が中心である。

Code and data availability

The supplied blocks describe a tomato leaf disease dataset (Kaggle PlantVillage plus a self-captured Silal Greenhouse set) and fine-tuned BLIP-2 checkpoints, but contain no authors' public deposit, code release, or availability statement with a URL. The Kaggle PlantVillage source is a generic third-party dataset, not a

No evidence-backed public reproduction asset is currently recorded.