Research on digital fruit tree reconstruction method based on neural radiance field theory

Abstract

The objective of this study is to propose a digital fruit tree reconstruction method based on neural radiation field theory that will enable the efficient, accurate, and non-destructive acquisition of phenotypic information from fruit trees, while simultaneously reducing the cost of collecting this data. Firstly, a low-cost information acquisition platform is constructed for the purpose of shooting a multi-view video around a fruit tree. The video is then extracted and framed using a motion recovery structural algorithm, thereby obtaining a multi-view image sequence of the fruit tree with positional data. Secondly, the the image sequence is employed to train the neural radiation field, thereby obtaining a converged three-dimensional scene of the fruit tree. Ultimately, the three-dimensional scene is derived in the form of a point cloud, thus yielding a high-phenotypic detail point cloud model of the fruit tree. A multi-period point cloud model of an apple tree in an orchard environment, encompassing the flowering, fruiting, and dormant periods, was reconstructed using the aforementioned method. The experimental results demonstrated that the error associated with the tree shape data recorded by the multi-period point cloud model established by the aforementioned method was, on average, below 5%. Furthermore, the average error across all periods was 2.69%, representing a 75.50% reduction compared to traditional reconstruction methods. The dimensional accuracy of the point cloud model at the organ scale can reach the millimetre level, with an average error of 3.10% for fruit diameter, which is 66.19% lower than that of the traditional reconstruction method. The reconstruction method is robust to all periods of fruit trees and can meet the majority of cases of digital fruit tree reconstruction.

Plant phenotyping relevance

果樹の多視点画像からNeRFと点群を用いて樹形・器官寸法などの表現型を非破壊取得する手法を開発・検証しており、方法が研究の中心である。

Code and data availability

公開本文の所在を確認できませんでした。非公開または購読が必要な可能性があります。

No evidence-backed public reproduction asset is currently recorded.