A Preference-oriented Diversity Model Based on Mutual-information in Re-ranking for E-commerce Search
0
Sign in to get full access
Overview
- Proposes a preference-oriented diversity model based on mutual information for re-ranking in e-commerce search
- Aims to improve search result diversity while also considering user preferences
- Introduces a new diversity metric that accounts for both relevance and diversity
Plain English Explanation
This paper presents a new approach to improving the diversity of search results in e-commerce settings. The key idea is to use a measure called "mutual information" to capture the relationship between the relevance of search results and their diversity. This builds on prior work like Mallows-DPO and Prompt-based Multi-Interest Learning that have explored diversity in recommendation and search.
The goal is to provide a diverse set of search results that still align well with the user's preferences. The authors argue that existing diversity metrics don't fully capture this balance. Their new metric incorporates both relevance and diversity, using mutual information to quantify how much the search results cover different aspects of what the user might be interested in.
This allows the system to re-rank the initial search results to improve diversity, but in a way that keeps the most relevant items near the top. The authors test this approach on real e-commerce datasets and show it outperforms other diversity-aware ranking methods.
Technical Explanation
The paper formulates the problem of diversity-aware re-ranking for e-commerce search, building on prior work like Low-Rank Online Dynamic Assortment and Optimizing E-commerce Search.
They propose a new diversity metric called Preference-oriented Diversity (PoD) that captures both relevance and diversity. PoD is based on the mutual information between the ranked search results and the user's preferences, as modeled by a preference distribution.
The paper then presents a re-ranking algorithm that optimizes this PoD metric, interleaving relevant and diverse results. Experiments on real e-commerce datasets show this approach, called MInDE (Mutual Information Neural Diffusion Estimation), outperforms prior diversity-aware re-ranking methods like MINDE.
Critical Analysis
The authors acknowledge some limitations of their work, such as the need to learn the user preference model and the potential for the re-ranking to negatively impact relevance at the top of the results. Additionally, the experiments are limited to a few e-commerce datasets, so further testing would be needed to understand the broader applicability of the approach.
One potential issue is the reliance on mutual information, which can be sensitive to estimation errors, especially with limited data. The authors address this by using a neural diffusion model, but this adds complexity and may introduce other challenges.
Overall, the work presents a novel and promising approach to the important problem of balancing relevance and diversity in e-commerce search. The core ideas around preference-oriented diversity and mutual information-based re-ranking are worth further exploration and refinement.
Conclusion
This paper introduces a new preference-oriented diversity model for re-ranking search results in e-commerce settings. By incorporating mutual information between relevance and diversity, the approach aims to provide a diverse set of results that still align well with user preferences.
The experimental results are encouraging, showing improvements over prior diversity-aware ranking methods. While the work has some limitations, it represents an important step forward in addressing the challenge of delivering high-quality, diverse search experiences for e-commerce customers.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
A Preference-oriented Diversity Model Based on Mutual-information in Re-ranking for E-commerce Search
Huimu Wang, Mingming Li, Dadong Miao, Songlin Wang, Guoyu Tang, Lin Liu, Sulong Xu, Jinghe Hu
Re-ranking is a process of rearranging ranking list to more effectively meet user demands by accounting for the interrelationships between items. Existing methods predominantly enhance the precision of search results, often at the expense of diversity, leading to outcomes that may not fulfill the varied needs of users. Conversely, methods designed to promote diversity might compromise the precision of the results, failing to satisfy the users' requirements for accuracy. To alleviate the above problems, this paper proposes a Preference-oriented Diversity Model Based on Mutual-information (PODM-MI), which consider both accuracy and diversity in the re-ranking process. Specifically, PODM-MI adopts Multidimensional Gaussian distributions based on variational inference to capture users' diversity preferences with uncertainty. Then we maximize the mutual information between the diversity preferences of the users and the candidate items using the maximum variational inference lower bound to enhance their correlations. Subsequently, we derive a utility matrix based on the correlations, enabling the adaptive ranking of items in line with user preferences and establishing a balance between the aforementioned objectives. Experimental results on real-world online e-commerce systems demonstrate the significant improvements of PODM-MI, and we have successfully deployed PODM-MI on an e-commerce search platform.
Read more5/27/2024
0
Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendations
Erica Coppolillo, Giuseppe Manco, Aristides Gionis
Providing recommendations that are both relevant and diverse is a key consideration of modern recommender systems. Optimizing both of these measures presents a fundamental trade-off, as higher diversity typically comes at the cost of relevance, resulting in lower user engagement. Existing recommendation algorithms try to resolve this trade-off by combining the two measures, relevance and diversity, into one aim and then seeking recommendations that optimize the combined objective, for a given number of items to recommend. Traditional approaches, however, do not consider the user interaction with the recommended items. In this paper, we put the user at the central stage, and build on the interplay between relevance, diversity, and user behavior. In contrast to applications where the goal is solely to maximize engagement, we focus on scenarios aiming at maximizing the total amount of knowledge encountered by the user. We use diversity as a surrogate of the amount of knowledge obtained by the user while interacting with the system, and we seek to maximize diversity. We propose a probabilistic user-behavior model in which users keep interacting with the recommender system as long as they receive relevant recommendations, but they may stop if the relevance of the recommended items drops. Thus, for a recommender system to achieve a high-diversity measure, it will need to produce recommendations that are both relevant and diverse. Finally, we propose a novel recommendation strategy that combines relevance and diversity by a copula function. We conduct an extensive evaluation of the proposed methodology over multiple datasets, and we show that our strategy outperforms several state-of-the-art competitors. Our implementation is publicly available at https://github.com/EricaCoppolillo/EXPLORE.
Read more8/9/2024
0
Contextual Distillation Model for Diversified Recommendation
Fan Li, Xu Si, Shisong Tang, Dingmin Wang, Kunyan Han, Bing Han, Guorui Zhou, Yang Song, Hechang Chen
The diversity of recommendation is equally crucial as accuracy in improving user experience. Existing studies, e.g., Determinantal Point Process (DPP) and Maximal Marginal Relevance (MMR), employ a greedy paradigm to iteratively select items that optimize both accuracy and diversity. However, prior methods typically exhibit quadratic complexity, limiting their applications to the re-ranking stage and are not applicable to other recommendation stages with a larger pool of candidate items, such as the pre-ranking and ranking stages. In this paper, we propose Contextual Distillation Model (CDM), an efficient recommendation model that addresses diversification, suitable for the deployment in all stages of industrial recommendation pipelines. Specifically, CDM utilizes the candidate items in the same user request as context to enhance the diversification of the results. We propose a contrastive context encoder that employs attention mechanisms to model both positive and negative contexts. For the training of CDM, we compare each target item with its context embedding and utilize the knowledge distillation framework to learn the win probability of each target item under the MMR algorithm, where the teacher is derived from MMR outputs. During inference, ranking is performed through a linear combination of the recommendation and student model scores, ensuring both diversity and efficiency. We perform offline evaluations on two industrial datasets and conduct online A/B test of CDM on the short-video platform KuaiShou. The considerable enhancements observed in both recommendation quality and diversity, as shown by metrics, provide strong superiority for the effectiveness of CDM.
Read more8/15/2024
0
Enhancing Recommendation Diversity by Re-ranking with Large Language Models
Diego Carraro, Derek Bridge
It has long been recognized that it is not enough for a Recommender System (RS) to provide recommendations based only on their relevance to users. Among many other criteria, the set of recommendations may need to be diverse. Diversity is one way of handling recommendation uncertainty and ensuring that recommendations offer users a meaningful choice. The literature reports many ways of measuring diversity and improving the diversity of a set of recommendations, most notably by re-ranking and selecting from a larger set of candidate recommendations. Driven by promising insights from the literature on how to incorporate versatile Large Language Models (LLMs) into the RS pipeline, in this paper we show how LLMs can be used for diversity re-ranking. We begin with an informal study that verifies that LLMs can be used for re-ranking tasks and do have some understanding of the concept of item diversity. Then, we design a more rigorous methodology where LLMs are prompted to generate a diverse ranking from a candidate ranking using various prompt templates with different re-ranking instructions in a zero-shot fashion. We conduct comprehensive experiments testing state-of-the-art LLMs from the GPT and Llama families. We compare their re-ranking capabilities with random re-ranking and various traditional re-ranking methods from the literature. We open-source the code of our experiments for reproducibility. Our findings suggest that the trade-offs (in terms of performance and costs, among others) of LLM-based re-rankers are superior to those of random re-rankers but, as yet, inferior to the ones of traditional re-rankers. However, the LLM approach is promising. LLMs exhibit improved performance on many natural language processing and recommendation tasks and lower inference costs. Given these trends, we can expect LLM-based re-ranking to become more competitive soon.
Read more6/19/2024