FruitNeRF++: A Generalized Multi-Fruit Counting Method Utilizing Contrastive Learning and Neural Radiance Fields

Abstract

FruitNeRF++: A Generalized Multi-Fruit Counting Method Utilizing Contrastive Learning and Neural Radiance Fields We introduce FruitNeRF++, a novel fruit-counting approach that combines contrastive learning with neural radiance fields to count fruits from unstructured input photographs of orchards. Our work is based on FruitNeRF [6], which employs a neural semantic field combined with a fruit-specific clusteringapproach. The requirement for adaptation for each fruit type limits the applicability of the method, and makes it difficult to use in practice. To lift this limitation, we design a shape-agnostic multi-fruit counting framework, that complements the RGB and semantic data with instance masks predicted by a vision foundation model. The masks are used to encode the identity of each fruit as instance embeddings into a neural instance field. By volumetrically sampling the neural fields, we extract apoint cloud embedded with the instance features, which can be clustered in a fruit-agnostic manner to obtain the fruit count. We evaluate our approach using a synthetic dataset containing apples, plums, lemons, pears, peaches, and mangoes, as well as a real-world benchmark apple dataset. Our results demonstrate that FruitNeRF++ is easier to control and compares favorably to other state-of-the-art methods.

Plant phenotyping relevance

果実を対象とした画像ベースの汎用カウント手法を開発し、合成および実データで評価しているため、植物形質（果実数）の取得・推定が研究の中心です。

Code and data availability

The paper's own FruitNeRF++ code is only promised 'upon acceptance' with no live public deposit, and the extended dataset is only referenced via a project page not among the allowed URLs. The allowed URLs correspond to cited third-party resources (XFrog tree models, BlenderNeRF software, a contrastive-loss reference),i

No evidence-backed public reproduction asset is currently recorded.