Appearance quality classification method of Huangguan pear under complex background based on instance segmentation and semantic segmentation.

Abstract

The 'Huangguan' pear disease spot detection and grading is the key to fruit processing automation. Due to the variety of individual shapes and disease spot types of 'Huangguan' pear. The traditional computer vision technology and pattern recognition methods have some limitations in the detection of 'Huangguan' pear diseases. In recent years, with the development of deep learning technology and convolutional neural network provides a new solution for the fast and accurate detection of 'Huangguan' pear diseases. To achieve automatic grading of 'Huangguan' pear appearance quality in a complex context, this study proposes an integrated framework combining instance segmentation, semantic segmentation and grading models. In the first stage, Mask R-CNN and Mask R-CNN with the introduction of the preprocessing module are used to segment 'Huangguan' pears from complex backgrounds. In the second stage, DeepLabV3+, UNet and PSPNet are used to segment the 'Huangguan' pear spots to get the spots, and the ratio of the spot pixel area to the 'Huangguan' pear pixel area is calculated and classified into three grades. In the third stage, the grades of 'Huangguan' pear are obtained using ResNet50, VGG16 and MobileNetV3. The experimental results show that the model proposed in this paper can segment the 'Huangguan' pear and disease spots in complex background in steps, and complete the grading of 'Huangguan' pear fruit disease severity. According to the experimental results. The Mask R-CNN that introduced the CLAHE preprocessing module in the first-stage instance segmentation model is the most accurate. The resulting pixel accuracy (PA) is 97.38% and the Dice coefficient is 68.08%. DeepLabV3+ is the most accurate in the second-stage semantic segmentation model. The pixel accuracy is 94.03% and the Dice coefficient is 67.25%. ResNet50 is the most accurate among the third-stage classification models. The average precision (AP) was 97.41% and the F1 (harmonic average assessment) was 95.43%.In short, it not only provides a new framework for the detection and identification of 'Huangguan' pear fruit diseases in complex backgrounds, but also lays a theoretical foundation for the assessment and grading of 'Huangguan' pear diseases.

Plant phenotyping relevance

ナシ果実の病斑を画像分割で抽出し、病斑面積比から病害重症度・外観品質を等級化する画像ベースの植物表現型推定法が研究の中心である。

Code and data availability

The paper uses a paper-specific dataset of 5,562 'Huangguan' pear images with pixel-level disease annotations, but no public deposit or URL is provided; the data availability statement says the raw data will be made available by the authors upon request. No public code or model checkpoints are mentioned.

No evidence-backed public reproduction asset is currently recorded.