Pairwise regression with upper confidence bound for contextual bandit with multiple actions
Journal
2013 Conference on Technologies and Applications of Artificial Intelligence
Pages
19-24
Date Issued
2013
Author(s)
Chang, Y.-H.
Abstract
The contextual bandit problem is typically used to model online applications such as article recommendation. However, the problem cannot fully meet certain needs of these applications, such as performing multiple actions at the same time. We defined a new Contextual Bandit Problem with Multiple Actions (CBMA), which is an extension of the traditional contextual bandit problem and fits the online applications better. We adapt some existing contextual bandit algorithms for our CBMA problem, and developed the new Pair wise Regression with Upper Confidence Bound (PairUCB) algorithm which addresses the new properties of the new CBMA problem. Experimental results demonstrate that PairUCB significantly outperforms other approaches.
Type
conference paper