[2307.15142] Reconciling the accuracy-diversity trade-off in recommendations
Abstract:In recommendation settings, there is an apparent trade-off between the goals of accuracy (to recommend items a user is most likely to want) and diversity (to recommend items representing a range of categories). As such, real-world recommender systems often explicitly incorporate diversity separately from accuracy. This approach, however, leaves a basic question unanswered: Why is there a trade-off in the first place? We show how the trade-off can be explained via a user's consumption constraints -- users typically only consume a few of the items they are recommended. In a stylized model we introduce, objectives that account for this constraint induce diverse recommendations, while objectives that do not account for this constraint induce homogeneous recommendations. This suggests that accuracy and diversity appear misaligned because standard accuracy metrics do not consider consumption constraints. Our model yields precise and interpretable characterizations of diversity in different settings, giving practical insights into the design of diverse recommendations.
View PDF HTML (experimental) Abstract:In recommendation settings, there is an apparent trade-off between the goals of accuracy (to recommend items a user is most likely to want) and diversity (to recommend items representing a range of categories). As such, real-world recommender systems often explicitly incorporate diversity separately from accuracy. This approach, however, leaves a basic question unanswered: Why is there a trade-off in the first place? We show how the trade-off can be explained via a user's consumption constraints -- users typically only consume a few of the items they…
saved by
related reading
- [2305.18290] Direct Preference Optimization: Your Language Model is Secretly a Reward Modelarxiv.org
- Shifting Consumption towards Diverse content via Reinforcement Learning | Spotify Researchresearch.atspotify.com
- 2301.00993v1.pdfarxiv.org
- Effect of recommending users and opinions on the network connectivity and idea generation processarxiv.org
- [1904.06813] Personalized Re-ranking for Recommendationarxiv.org
- Algorithmic Effects on the Diversity of Consumption on Spotify | Spotify Researchresearch.atspotify.com
- Evaluating and Enhancing Robustness of Deep Recommendation Systems Against Hardware Errorsarxiv.org
- Algorithmic Content Selection and the Impact of User Disengagementarxiv.org
- [2605.12715] Scaling Laws for Mixture Pretraining Under Data Constraintsarxiv.org
- OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentarxiv.org
- Scaling Laws for Reward Model Overoptimizationarxiv.org
- [2205.13147] Matryoshka Representation Learningarxiv.org