Towards smart pruning: ViNet, a deep-learning approach for grapevine structure estimation

Abstract

Image and video tools for analyzing crop scenes and plants are essential for applying precision agriculture to crop maintenance, harvesting, or pruning. In this paper, we are interested in vine pruning, a task that requires a precise understanding of the vine structure with branch type identification, orientations, and node locations. However, estimating such a structure is highly challenging, given the large variety in grapevine appearances, lighting conditions, viewpoint, the interweaving of branches, occlusions, and the level of details needed. To address these challenges, we propose ViNet: a deep-learning approach for estimating the structure of grapevine, which comprises two main steps: The first one detects nodes and identifies the branch types of the plant, as well as the spatial relation between them, whilst the second one uses the extracted nodes and branches to build a graph, out of which the structure of the grapevine is inferred. In doing so, we make four main contributions: (i) we put forward for the first time a method for automatic segmentation and extraction of the grapevine structure from images; (ii) we propose a novel approach leveraging the powerful stacked hourglass network to infer node location, branch types and the spatial relationships between them; (iii) we propose a novel shortest path weighted graph optimization step to extract connections between nodes and infer the structure, allowing to address the problem of having an unknown number of branches in the tree; (iv) we publicly release a dataset of more than 1500 grapevine images fully annotated with the structure information. Extensive experiments on this dataset demonstrate the efficiency of our approach at predicting the structure of a grapevine, achieving a precision and recall for node prediction of 95% and 90%, respectively, as well as ablation studies validating our design choices.

Plant phenotyping relevance

画像からブドウ樹の節・枝型・空間関係を抽出し、植物構造を推定する手法を開発・検証しており、注釈付きデータセットも提供するため、植物フェノタイピング手法が中心である。

Code and data availability

公開状態または取得可能な本文経路を確認できませんでした。

No evidence-backed public reproduction asset is currently recorded.