Human Limits in Machine Learning: Prediction of Plant Phenotypes Using Soil Microbiome Data

Abstract

The preservation of soil health is a critical challenge in the 21st century due to its significant impact on agriculture, human health, and biodiversity. We provide the first deep investigation of the predictive potential of machine learning models to understand the connections between soil and biological phenotypes. We investigate an integrative framework performing accurate machine learning-based prediction of plant phenotypes from biological, chemical, and physical properties of the soil via two models: random forest and Bayesian neural network. We show that prediction is improved when incorporating environmental features like soil physicochemical properties and microbial population density into the models, in addition to the microbiome information. Exploring various data preprocessing strategies confirms the significant impact of human decisions on predictive performance. We show that the naive total sum scaling normalization that is commonly used in microbiome research is not the optimal strategy to maximize predictive power. Also, we find that accurately defined labels are more important than normalization, taxonomic level or model characteristics. In cases where humans are unable to classify samples accurately, machine learning model performance is limited. Lastly, we provide domain scientists via a full model selection decision tree to identify the human choices that optimize model prediction power. Our work is accompanied by open source reproducible scripts (https://github.com/solislemuslab/soil-microbiome-nn) for maximum outreach among the microbiome research community.

Plant phenotyping relevance

土壌マイクロバイオーム等から植物表現型を予測する機械学習フレームワークを中心に、モデル、前処理、ラベル精度、性能最適化を評価しており、植物表現型推定法として方法論的に重要である。

Code and data availability

The paper's reproducible analysis scripts (RF and Bayesian NN prediction of potato phenotypes from soil microbiome data) are publicly available on the authors' GitHub repository. The underlying soil/phenotype dataset is not public and must be requested from the authors.