Monitoring Maize Phenology Using Multi-Source Data by Integrating Convolutional Neural Networks and Transformers

Abstract

Effective monitoring of maize phenology under stress conditions is crucial for optimizing agricultural management and mitigating yield losses. Crop prediction models constructed from Convolutional Neural Network (CNN) have been widely applied. However, CNNs often struggle to capture long-range temporal dependencies in phenological data, which are crucial for modeling seasonal and cyclic patterns. The Transformer model complements this by leveraging self-attention mechanisms to effectively handle global contexts and extended sequences in phenology-related tasks. The Transformer model has the global understanding ability that CNN does not have due to its multi-head attention. This study, proposes a synergistic framework, in combining CNN with Transformer model to realize global-local feature synergy using two models, proposes an innovative phenological monitoring model utilizing near-ground remote sensing technology. High-resolution imagery of maize fields was collected using unmanned aerial vehicles (UAVs) equipped with multispectral and thermal infrared cameras. By integrating this data with CNN and Transformer architectures, the proposed model enables accurate inversion and quantitative analysis of maize phenological traits. In the experiment, a network was constructed adopting multispectral and thermal infrared images from maize fields, and the model was validated using the collected experimental data. The results showed that the integration of multispectral imagery and accumulated temperature achieved an accuracy of 92.9%, while the inclusion of thermal infrared imagery further improved the accuracy to 97.5%. This study highlights the potential of UAV-based remote sensing, combined with CNN and Transformer as a transformative approach for precision agriculture.

Plant phenotyping relevance

UAVマルチスペクトル・熱赤外画像とCNN/Transformerを統合し、トウモロコシのフェノロジー形質を定量推定する手法を開発・検証しており、植物表現型取得が中心である。

Code and data availability

The supplied blocks describe a UAV multispectral/thermal maize phenology study with custom Python preprocessing and a CNN-Transformer model, but contain no data availability statement, no public dataset deposit, and no author code repository or URL. The only URL present is the article DOI itself.

No evidence-backed public reproduction asset is currently recorded.