A novel dual-branch spatial-spectral attention fusion model and method: A case study for the detection of nicotine content in tobacco leaves

Abstract

Hyperspectral imaging (HSI) is a powerful tool for crop phenotypic component analysis, but developing efficient collaborative extraction and modeling methods for image and spectral features is a challenge. This study proposed a novel spatial-spectral fusion detection method for nicotine content utilizing hyperspectral imaging (HSI) and deep learning. Spectra of different regions and multi-channel images extracted by two-dimensional correlation analysis (2D-COS) were employed as inputs. A dual-branch spatial-spectral attention fusion model (DSSAM) was developed to enhance the expression ability of different modal information. Among them, two branches designed based on the residual module were used to extract spatial and spectral features, respectively. For the spectral branch, a multi-region spectral attention encoder (MSAE) was added to dynamically adjust the weights of the spectrum across leaf regions. For the spatial branch, a swin window attention (SWA) module was introduced to improve local feature extraction and spatial structure learning. The results demonstrated that MSAE and SWA could improve the spatial-spectral information fusion ability of the DSSAM. Compared with the dual-branch model without the attention modules, the coefficient of determination (R²) and relative prediction deviation (RPD) of the DSSAM model on the test set increased by 7.85% and 2.64%, respectively, and the Root Mean Square Error (RMSE) decreased by 39.29%. In addition, the DSSAM outperformed traditional chemometric and single-modal models, with a R² of 0.893, a RMSE of 0.289, and a RPD of 3.054. These findings provide a valuable approach for the quality nondestructive detection of cured tobacco leaves and other crop phenotypic components.

Plant phenotyping relevance

ハイパースペクトル画像からタバコ葉のニコチン含量を推定する空間・スペクトル融合モデルを開発し、既存モデルとの性能比較で検証しており、表現型取得・推定手法が中心である。

Code and data availability

公開状態または取得可能な本文経路を確認できませんでした。

No evidence-backed public reproduction asset is currently recorded.