Combining Local and Global Viewpoint Planning for Fruit Coverage

Abstract

Obtaining 3D sensor data of complete plants or plant parts (e.g., the crop or fruit) is difficult due to their complex structure and a high degree of occlusion. However, especially for the estimation of the position and size of fruits, it is necessary to avoid occlusions as much as possible and acquire sensor information of the relevant parts. Global viewpoint planners exist that suggest a series of viewpoints to cover the regions of interest up to a certain degree, but they usually prioritize global coverage and do not emphasize the avoidance of local occlusions. On the other hand, there are approaches that aim at avoiding local occlusions, but they cannot be used in larger environments since they only reach a local maximum of coverage. In this paper, we therefore propose to combine a local, gradient-based method with global viewpoint planning to enable local occlusion avoidance while still being able to cover large areas. Our simulated experiments with a robotic arm equipped with a camera array as well as an RGB-D camera show that this combination leads to a significantly increased coverage of the regions of interest compared to just applying global coverage planning.

Plant phenotyping relevance

果実の位置・サイズ推定に必要な3Dセンサデータ取得を対象に、局所遮蔽回避と大域的視点計画を組み合わせる視点計画法を開発・評価しており、植物表現型取得が中心である。

Code and data availability

The paper's authors explicitly state that the source code of their combined local/global viewpoint planning system (used for fruit ROI coverage experiments) is publicly available on GitHub. OctoMap is a generic third-party library and is excluded.