Improving Pixel Embedding Learning through Intermediate Distance Regression Supervision for Instance Segmentation

Abstract

As a proposal-free approach, instance segmentation through pixel embedding learning and clustering is gaining more emphasis. Compared with bounding box refinement approaches, such as Mask R-CNN, it has potential advantages in handling complex shapes and dense objects. In this work, we propose a simple, yet highly effective, architecture for object-aware embedding learning. A distance regression module is incorporated into our architecture to generate seeds for fast clustering. At the same time, we show that the features learned by the distance regression module are able to promote the accuracy of learned object-aware embeddings significantly. By simply concatenating features of the distance regression module to the images as inputs of the embedding module, the mSBD scores on the CVPPP Leaf Segmentation Challenge can be further improved by more than 8% compared to the identical set-up without concatenation, yielding the best overall result amongst the leaderboard at CodaLab.

Plant phenotyping relevance

CVPPP葉セグメンテーション課題を対象に、植物器官画像からのインスタンス分割を改善する埋め込み・距離回帰手法を開発しており、表現型抽出の計算手法が中心である。

Code and data availability

The paper (W-Net for leaf/cell instance segmentation) uses CVPPP2017 LSC and BBBC006v1 datasets but provides no public code, model, or dataset deposit with an authors' URL; no qualifying paper-specific assets are present in the supplied blocks.

No evidence-backed public reproduction asset is currently recorded.