Early apple moldy core classification via multi-modal sensing and SE-ResNet18.

Abstract

Apple moldy core disease is a major pathogenic disease that severely degrades the postharvest quality of apples, and its early internal lesions cannot be directly identified through visual appearance observation. To realize efficient and non-destructive early diagnosis, this study proposes a multimodal image coding method fusing Visible-Near Infrared Spectroscopy (Vis-NIR) and Electronic Nose (E-nose) data, which is combined with the SE-ResNet18 deep learning model for disease classification. By virtue of coding techniques including Gramian Angular Field (GAF), Markov Transition Field (MTF), and Recurrence Plot (RP), one-dimensional time-series and spectral data were converted into image representations, so as to visualize their spatiotemporal patterns and enhance subtle disease-related features. On this basis, a two-branch SE-ResNet18 model based on the channel attention mechanism was constructed to improve the feature representation capability and achieve effective modal fusion. Experimental results show that the multimodal fusion model achieves a classification accuracy of 95.93%, which is significantly superior to single-modal methods, thus verifying the effectiveness of multi-source information complementarity. Ablation experiments further indicate that the SE attention module plays a crucial role in feature calibration and modal balance. Information entropy analysis reveals that the proposed method effectively enhances the discriminability of information during the feature extraction process. This study provides a solution with a clear theoretical basis and reliable performance for the non-destructive detection of early diseases in agricultural products, which has favorable application prospects and popularization potential.

Plant phenotyping relevance

リンゴ果実の内部病変という植物器官の病態を対象に、Vis-NIR・E-noseのマルチモーダルセンシングと深層学習による非破壊分類法を開発・評価しており、表現型取得手法が中心である。

Code and data availability

公開本文の所在を確認できませんでした。非公開または購読が必要な可能性があります。

No evidence-backed public reproduction asset is currently recorded.