https://scholars.lib.ntu.edu.tw/handle/123456789/581382
Title: | Real-Time Multi-class Instance Segmentation with One-Time Deep Embedding Clustering | Authors: | Chen Y.-C Chang C.-Y Hsiao P.-Y Fu L.-C. LI-CHEN FU |
Keywords: | Deep learning; Embeddings; Image segmentation; Object recognition; Pixels; Semantics; Clustering approach; Clustering methods; Detection networks; One-time; Real time; Segmentation quality; Semantic segmentation; State of the art; Object detection | Issue Date: | 2020 | Journal Volume: | 12046 LNCS | Start page/Pages: | 223-235 | Source: | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | Abstract: | In recent years, instance segmentation research has been considered as an extension of object detection and semantic segmentation, which can provide pixel-level annotations on detected objects. Several approaches for instance segmentation exploit object detection network to generate bounding box and segment each bounding box with segmentation network. However, these approaches need more time consumption due to two independent networks as their framework. On the other hand, some approaches based on clustering transform each pixel into unique representation and produce instance mask by postprocessing. Nevertheless, most clustering approaches have to cluster all instances of each class individually, which contribute to additional time consumption. In this research, we propose a fast clustering method called one-time clustering with single network aiming at reducing time consumption on multi-class instance segmentation. Moreover, we present a class-sensitive loss function that allows the network to generate unique embedding which contains class and instance information. With the informative embeddings, we can cluster them only once instead of clustering for each class in other clustering approaches. Our approach is up to 6x faster than the state-of-the-art UPSNet [1], which appeared in CVPR 2019, and get about 25% lower AP performance on Cityscape dataset. It achieves significantly faster speed and great segmentation quality while having an acceptable AP performance. ? Springer Nature Switzerland AG 2020. |
URI: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85081537765&doi=10.1007%2f978-3-030-41404-7_16&partnerID=40&md5=c10d1c509860abaff2c365d2e6b32c4e https://scholars.lib.ntu.edu.tw/handle/123456789/581382 |
ISSN: | 03029743 | DOI: | 10.1007/978-3-030-41404-7_16 |
Appears in Collections: | 資訊工程學系 |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.