SST-MAE: Learning Spectral-Spatio-Temporal Representations from Plant Hyperspectral Time Series to Discover Complex Genotype-Phenotype Relations

Abstract

Abstract Understanding the link between genetic variation and observable traits is key to crop breeding. Hyperspectral imaging captures physiological and biochemical profiles, but current supervised methods require costly trait annotations and treat each observation as a static snapshot, ignoring the temporal dynamics of plant development. We introduce SST-MAE, a self-supervised framework that learns genotype-discriminative representations from plant hyperspectral developmental trajectories, without requiring phenotypic labels. The model learns to reconstruct masked information, capturing multiple growth trajectories. Validated on 194 field-grown lettuce genotypes across eight time points, the frozen encoder serves as a feature extractor for downstream genotype classification. SST-MAE outperforms raw spectral and linear baselines, achieving AUROC > 0.89 for anthocyanin pigmentation SNPs and 0.77 for leaf serration. The learned features are highly label-efficient, attaining near-full performance with only 30–50% of labeled data, offering a scalable pathway toward high-throughput genetic screening from image-based phenotypes.

Plant phenotyping relevance

植物のハイパースペクトル時系列から表現型関連表現を抽出する自己教師あり手法を開発し、複数遺伝子型・時点で検証しているため、表現型取得・解析手法が中心です。

Code and data availability

The supplied blocks describe the SST-MAE lettuce hyperspectral dataset, preprocessing, and model, but contain no public data deposit, code repository, trained model release, or availability statement. Genotype data are attributed to prior works (Wei et al.; Dijkhuizen et al.), which are cited prior publications rather,

No evidence-backed public reproduction asset is currently recorded.