481@2021@IJCAI

Total: 1

#1 Toward Optimal Solution for the Context-Attentive Bandit Problem [PDF] [Copy] [Kimi] [REL]

Authors: Djallel Bouneffouf ; Raphael Feraud ; Sohini Upadhyay ; Irina Rish ; Yasaman Khazaeni

In various recommender system applications, from medical diagnosis to dialog systems, due to observation costs only a small subset of a potentially large number of context variables can be observed at each iteration; however, the agent has a freedom to choose which variables to observe. In this paper, we analyze and extend an online learning framework known as Context-Attentive Bandit, We derive a novel algorithm, called Context-Attentive Thompson Sampling (CATS), which builds upon the Linear Thompson Sampling approach, adapting it to Context-Attentive Bandit setting. We provide a theoretical regret analysis and an extensive empirical evaluation demonstrating advantages of the proposed approach over several baseline methods on a variety of real-life datasets.