The Multi-Sensor and Multi-Temporal Dataset of Multiple Crops for In-Field Phenotyping and Monitoring

Abstract

Abstract Phenotyping is crucial for understanding crop trait variation and advancing research, but is currently limited by expensive, labor-intensive monitoring. New phenotypic trait monitoring methods are being proposed to reduce this so-called phenotyping bottleneck via automation. These methods are often data-driven, requiring a dataset recorded with a specific sensor and corresponding reference values for developing novel methods. To this end, we present the MuST-C (Multi-Sensor, multi-Temporal, multiple Crops) dataset, which contains field data from various sensors collected over a growing season, covering six crop species. All data was georeferenced for alignment across sensors and dates. To collect our dataset, we deployed aerial and ground robotic platforms equipped with RGB cameras, LiDARs, and multispectral cameras, aiming to capture a wide variety of modalities and observations from different viewpoints. In addition to sensor data, we also provide manually collected leaf area index and biomass reference measurements. Our dataset enables the development of novel automatic phenotypic trait estimation methods, allows comparisons across different sensors, and generalizability across crop species.

Plant phenotyping relevance

複数センサー・ロボットプラットフォームによる圃場フェノタイピング用データセットを構築・提供し、形質推定法の開発、センサー比較、汎化評価を可能にすることが中心的な貢献である。

Code and data availability

The paper's MuST-C multi-sensor, multi-temporal crop phenotyping dataset (RGB/multispectral images, LiDAR point clouds, LAI and biomass reference measurements) is publicly available via the authors' project webpage, and the authors' custom Python processing/loading code is publicly available on GitHub.