Hsu, H.-W.H.-W.HsuJIAN-JIUN DING2020-06-042020-06-042018https://www.scopus.com/inward/record.uri?eid=2-s2.0-85050802449&doi=10.1109%2fAPSIPA.2017.8282115&partnerID=40&md5=4166928ed5a5fb303312f8b3782ba032Recently in VOT competitions, trackers based on tracking-by-detection and deep neural network discriminators reached impressive accuracy. However, these trackers require time-consuming model adaptation methods like online learning to handle target appearance changes, which tremendously increases the time complexity and becomes an obstruction in realworld applications for these tracking algorithms. In this paper, we propose an efficient RNN-based model adaptation method which extremely decreases the time complexity of trackers. The proposed model learns the relations of relative model change in RNN training and predicts the score and the model adaptation state at the same time in testing, which nearly removes the finetuning time in the cost of additional RNN training. The proposed method is applicable to any tracker based on neural network discriminator. The RNN branch can be further designed with more complicated model under the condition of enough training videos. We apply the proposed algorithm to MDNet and create a new tracker: Faster-MDNet. According to the experiment, using our method can nearly remove the time of finetuning and reduce the bottleneck of time-complexity down to the prediction time. © 2017 IEEE.[SDGs]SDG10Deep neural networks; Discriminators; Learning models; Model Adaptation; Online learning; Prediction time; Time complexity; Tracking algorithm; Tracking by detections; Visual Tracking; Complex networksFasterMDNet: Learning model adaptation by RNN in tracking-by-detection based visual trackingconference paper10.1109/APSIPA.2017.82821152-s2.0-85050802449