Rainbow UDA: Combining Domain Adaptive Models for Semantic Segmentation Tasks
Journal
IEEE Transactions on Pattern Analysis and Machine Intelligence
Journal Volume
45
Journal Issue
10
Start Page
12707
End Page
12713
ISSN
0162-8828
2160-9292
1939-3539
Date Issued
2023-10
Author(s)
Abstract
In this paper, we propose Rainbow UDA, a framework designed to address the drawbacks of the previous ensemble-distillation frameworks when combining multiple unsupervised domain adaptation (UDA) models for semantic segmentation tasks. Such drawbacks are mainly caused by overlooking the magnitudes of the output certainties of different members in an ensemble as well as their individual performance in the target domain, causing the distillation process to suffer from certainty inconsistency and performance variation issues. These issues may hinder the effectiveness of an ensemble that includes members with either biased certainty distributions or have poor performance in the target domain. To mitigate such a deficiency, Rainbow UDA introduces two operations: the unification and the channel-wise fusion operations, to address the above two issues. In order to validate the designs of Rainbow UDA, we leverage the GTA5 → Cityscapes and SYNTHIA → Cityscapes benchmarks to examine the effectiveness of the two operations, and compare Rainbow UDA against a wide variety of baseline approaches. We also provide a set of analyses to show that Rainbow UDA is effective, robust, and can evolve with time as the ensemble grows.
SDGs
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Type
journal article