From RGB to Synthetic NIR: Image-to-Image Translation for Pineapple Crop Monitoring Using Pix2PixHD

Abstract

Near-infrared (NIR) imaging plays a crucial role in precision agriculture; however, the high cost of multispectral sensors limits its widespread adoption. In this study, we generate synthetic NIR images (2592 × 1944 pixels) of pineapple crops from standard RGB drone imagery using the Pix2PixHD framework. The model was trained for 580 epochs, saving the first model after epoch 1 and then every 10 epochs thereafter. While models trained beyond epoch 460 achieved marginally higher metrics, they introduced visible artifacts. Model 410 was identified as the most effective, offering consistent quantitative performance while producing artifact-free results. Evaluation of Model 410 across 229 test images showed a mean SSIM of 0.6873, PSNR of 29.92, RMSE of 8.146, and PCC of 0.6565, indicating moderate to high structural similarity and reliable spectral accuracy of the synthetic NIR data. The proposed approach demonstrates that reliable NIR information can be obtained without expensive multispectral equipment, reducing costs and enhancing accessibility for farmers. By enabling advanced tasks such as vegetation segmentation and crop health monitoring, this work highlights the potential of deep learning–based image translation to support sustainable and data-driven agricultural practices. Future directions include extending the method to other crops, environmental conditions and real-time drone monitoring.

Plant phenotyping relevance

RGB画像から作物モニタリング用の合成NIR画像を生成する画像変換手法を開発し、テスト画像で定量評価しているため、植物情報取得法が中心である。

Code and data availability

The supplied blocks describe a new paired RGB–NIR pineapple UAV dataset (1521 images) and a Pix2PixHD model, but contain no data or code availability statement, no public repository, and no author-provided URL for the dataset, images, checkpoints, or analysis code. All URLs present are citations to prior work or the MD

No evidence-backed public reproduction asset is currently recorded.