Towards Resolving Propensity Contradiction in Offline Recommender Learning

Abstract

We study offline recommender learning from explicit rating feedback in the presence of selection bias. A current promising solution for the bias is the inverse propensity score (IPS) estimation. However, the performance of existing propensity-based methods can suffer significantly from the propensity estimation bias. In fact, most of the previous IPS-based methods require some amount of missing-completely-at-random (MCAR) data to accurately estimate the propensity. This leads to a critical self-contradiction; IPS is ineffective without MCAR data, even though it originally aims to learn recommenders from only missing-not-at-random feedback. To resolve this propensity contradiction, we derive a propensity-independent generalization error bound and propose a novel algorithm to minimize the theoretical bound via adversarial learning. Our theory and algorithm do not require a propensity estimation procedure, thereby leading to a well-performing rating predictor without the true propensity information. Extensive experiments demonstrate that the proposed approach is superior to a range of existing methods both in rating prediction and ranking metrics in the practical settings without MCAR data.

Category
Publication
In Proceedings of the 31st International Joint Conference on Artificial Intelligence (IJCAI) (Acceptance rate=15%, Long Talk (top 4% of submissions))
Yuta Saito
Yuta Saito
Third-year CS Ph.D. Student

Related