LightSegmentor: Lightweight Model for Real-time Semantic Segmentation
Part Of
2024 IEEE 4th International Conference on Electronic Communications, Internet of Things and Big Data, ICEIB 2024
Journal Volume
34
Start Page
518
End Page
521
ISBN (of the container)
979-835036072-1
Date Issued
2024-04-19
Author(s)
Abstract
We developed LightSegmentor, a real-time semantic segmentation model characterized by its lightweight design, utilizing just 3.3 million parameters. The compact framework comprises an encoder, termed LightFormer, as well as a decoder. The LightFormer incorporates a novel lightweight channel mixing operation, Unified Light Channel multilayer perceptron (MLP), to efficiently exchange image information across different channels and reduce memory usage and computational cost. For the decoder, we adopted the design of EffSegmentNet to effectively integrate the detailed and contextual information from the encoder to produce the semantic segmentation result. The LightSegmentor showed 66.9% mIoU utilizing only 3.3 million parameters on the test dataset of Cityscapes. Furthermore, it attained an impressive inference speed of 151 frames per second (FPS) on an NVIDIA RTX 2080Ti card, showcasing its suitability for real-time semantic segmentation.
Event(s)
4th IEEE International Conference on Electronic Communications, Internet of Things and Big Data, ICEIB 2024
Publisher
IEEE
Type
conference paper