Dynamic Unlearning for Online learning on Concept-drifting Data
Date Issued
2015
Date
2015
Author(s)
You, Sheng-Chi
Abstract
Real-world online learning applications often face data coming from changing target functions. Such changes, called the concept drift, degrade the performance of traditional online learning algorithms. Thus, many existing works focus on detecting concept drift based on statistical evidence. Other works use sliding window or similar mechanisms to select the data that closely reflect current concept. Nevertheless, few works study how the detection and selection techniques can be combined to improve the learning performance. We propose a framework on top of existing online learning algorithms to improve the learning performance under concept drift. The framework detects the possible concept drift by checking whether forgetting some older data may be helpful, and then conduct forgetting through a step called unlearning. The framework effectively results in a dynamic sliding window that selects the data flexibly for different kinds of concept drifts. We design concrete approaches from the framework based on three popular online learning algorithms. Empirical results show that the framework consistently improves those online learning algorithms on ten synthetic data sets and two real-world data sets.
Subjects
Online learning
concpet drift
Type
thesis
File(s)![Thumbnail Image]()
Loading...
Name
ntu-104-R02922068-1.pdf
Size
23.32 KB
Format
Adobe PDF
Checksum
(MD5):920f67106fd8c93dba2e3ee2c3031dc0