LUF-net: A physically informed color calibration method for UAV RGB images based on exposure and irradiance information.

Abstract

Accurate color representation is critical for UAV-based crop phenotyping, yet UAV images are often distorted by variable illumination and camera exposure settings. Here, we propose Lite U-net FiLM (LUF-net), a lightweight U-net framework integrated with feature-wise linear modulation (FiLM) layers, which incorporates both multispectral-derived irradiance and camera exposure parameters as auxiliary inputs. This metadata-aware design enables dynamic modulation of intermediate image features, allowing the network to disentangle unified canopy color from environmental artifacts. Experiments conducted across diverse crop types (soybean, rice, maize), flight altitudes (6m, 12m, 25m, 40m), and illumination conditions (overcast skies, cloudy, sunny, early morning) demonstrate that the LUF-net model substantially reduces the mean absolute percentage error to below 5.5%, outperforming conventional Gray-world, U-net, AlexNet-MLP, and SIDBlock-MLP methods. Ablation experiments further show that both irradiance and exposure metadata provide complementary information, while FiLM-based conditioning effectively integrates these acquisition parameters into feature learning, jointly contributing to improved color reconstruction performance. Moreover, correlation analysis indicates that the model's color reconstruction errors are weakly dependent on irradiance and exposure settings, confirming that LUF-net reduces sensitivity to external imaging conditions while maintaining physically meaningful and robust corrections.

Plant phenotyping relevance

UAV画像の色校正手法を開発し、複数作物・撮影条件で性能検証しており、作物フェノタイピングの画像取得・補正が中心である。

Code and data availability

The paper's data and code availability statement explicitly points to a public GitHub repository containing training/evaluation/inference code, pretrained model weights, and example data for the LUF-net color calibration method.