SC-Rec: Enhancing Generative Retrieval with Self-Consistent Reranking for~Sequential Recommendation
0
Sign in to get full access
Overview
- The paper introduces a novel approach called SC-Rec for enhancing generative retrieval with self-consistent reranking for sequential recommendation.
- The goal is to improve the performance of sequential recommendation systems by leveraging language models and reranking mechanisms.
- The proposed SC-Rec framework integrates a generative retrieval model with a self-consistent reranking module to generate and refine recommended sequences.
Plain English Explanation
The researchers have developed a new system called SC-Rec that aims to improve the way computers make recommendations for things like products, movies, or content that users might want to view or purchase next.
The key idea is to use language models - powerful AI systems that can generate human-like text - to first come up with a set of recommended items. Then, a "reranking" module refines these recommendations to make them more consistent and coherent for the user.
The researchers believe this two-step approach of generating recommendations and then refining them will lead to better, more personalized suggestions compared to existing recommendation systems. The hope is that this can help users discover new things they're likely to enjoy, improving their experience.
Technical Explanation
The SC-Rec framework consists of two main components:
-
Generative Retrieval Model: This is a large language model trained to generate a sequence of recommended items given a user's past interactions. It produces an initial set of recommendations.
-
Self-Consistent Reranking Module: This module takes the generated recommendations and refines them to ensure they form a coherent, self-consistent sequence. It does this by evaluating the semantic and contextual relationships between the recommended items.
The reranking module uses techniques like contrastive alignment to adjust the recommendations, boosting items that fit well with the overall sequence and downranking those that don't. This helps produce a final set of recommendations that are tailored to the user's preferences and browsing history.
The researchers evaluated SC-Rec on several benchmark datasets for sequential recommendation and showed it outperforms existing state-of-the-art methods. The self-consistent reranking was found to be a key factor in improving recommendation quality and coherence.
Critical Analysis
The paper provides a compelling approach to enhancing generative retrieval for sequential recommendation. The authors acknowledge some limitations, such as the computational cost of the reranking module and the need to further improve the language model's understanding of user preferences.
Additionally, the paper does not explore how SC-Rec might handle situations where a user's interests or context shift dramatically over time. The reranking mechanism may struggle to adapt quickly in such cases.
Further research could also investigate ways to integrate collaborative filtering signals or distill sequential patterns to supplement the language model's recommendations and improve overall performance.
Conclusion
The SC-Rec framework represents an innovative approach to enhancing sequential recommendation systems by combining generative retrieval with self-consistent reranking. By leveraging language models and refining their outputs, the system can generate more personalized and coherent recommendations for users.
While the paper highlights some areas for further improvement, the core ideas behind SC-Rec offer a promising direction for advancing the state-of-the-art in sequential recommendation and helping users discover new content and products they're likely to enjoy.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
SC-Rec: Enhancing Generative Retrieval with Self-Consistent Reranking for~Sequential Recommendation
Tongyoung Kim, Soojin Yoon, Seongku Kang, Jinyoung Yeo, Dongha Lee
Language Models (LMs) are increasingly employed in recommendation systems due to their advanced language understanding and generation capabilities. Recent recommender systems based on generative retrieval have leveraged the inferential abilities of LMs to directly generate the index tokens of the next item, based on item sequences within the user's interaction history. Previous studies have mostly focused on item indices based solely on textual semantic or collaborative information. However, although the standalone effectiveness of these aspects has been demonstrated, the integration of this information has remained unexplored. Our in-depth analysis finds that there is a significant difference in the knowledge captured by the model from heterogeneous item indices and diverse input prompts, which can have a high potential for complementarity. In this paper, we propose SC-Rec, a unified recommender system that learns diverse preference knowledge from two distinct item indices and multiple prompt templates. Furthermore, SC-Rec adopts a novel reranking strategy that aggregates a set of ranking results, inferred based on different indices and prompts, to achieve the self-consistency of the model. Our empirical evaluation on three real-world datasets demonstrates that SC-Rec considerably outperforms the state-of-the-art methods for sequential recommendation, effectively incorporating complementary knowledge from varied outputs of the model.
Read more8/20/2024
0
GenRec: Generative Personalized Sequential Recommendation
Panfeng Cao, Pietro Lio
Sequential recommendation is a task to capture hidden user preferences from historical user item interaction data and recommend next items for the user. Significant progress has been made in this domain by leveraging classification based learning methods. Inspired by the recent paradigm of 'pretrain, prompt and predict' in NLP, we consider sequential recommendation as a sequence to sequence generation task and propose a novel model named Generative Recommendation (GenRec). Unlike classification based models that learn explicit user and item representations, GenRec utilizes the sequence modeling capability of Transformer and adopts the masked item prediction objective to effectively learn the hidden bidirectional sequential patterns. Different from existing generative sequential recommendation models, GenRec does not rely on manually designed hard prompts. The input to GenRec is textual user item sequence and the output is top ranked next items. Moreover, GenRec is lightweight and requires only a few hours to train effectively in low-resource settings, making it highly applicable to real-world scenarios and helping to democratize large language models in the sequential recommendation domain. Our extensive experiments have demonstrated that GenRec generalizes on various public real-world datasets and achieves state-of-the-art results. Our experiments also validate the effectiveness of the the proposed masked item prediction objective that improves the model performance by a large margin.
Read more8/30/2024
0
CALRec: Contrastive Alignment of Generative LLMs For Sequential Recommendation
Yaoyiran Li, Xiang Zhai, Moustafa Alzantot, Keyi Yu, Ivan Vuli'c, Anna Korhonen, Mohamed Hammad
Traditional recommender systems such as matrix factorization methods have primarily focused on learning a shared dense embedding space to represent both items and user preferences. Subsequently, sequence models such as RNN, GRUs, and, recently, Transformers have emerged and excelled in the task of sequential recommendation. This task requires understanding the sequential structure present in users' historical interactions to predict the next item they may like. Building upon the success of Large Language Models (LLMs) in a variety of tasks, researchers have recently explored using LLMs that are pretrained on vast corpora of text for sequential recommendation. To use LLMs for sequential recommendation, both the history of user interactions and the model's prediction of the next item are expressed in text form. We propose CALRec, a two-stage LLM finetuning framework that finetunes a pretrained LLM in a two-tower fashion using a mixture of two contrastive losses and a language modeling loss: the LLM is first finetuned on a data mixture from multiple domains followed by another round of target domain finetuning. Our model significantly outperforms many state-of-the-art baselines (+37% in Recall@1 and +24% in NDCG@10) and our systematic ablation studies reveal that (i) both stages of finetuning are crucial, and, when combined, we achieve improved performance, and (ii) contrastive alignment is effective among the target domains explored in our experiments.
Read more8/27/2024
0
DELRec: Distilling Sequential Pattern to Enhance LLM-based Recommendation
Guohao Sun, Haoyi Zhang
Sequential recommendation (SR) tasks enhance recommendation accuracy by capturing the connection between users' past interactions and their changing preferences. Conventional models often focus solely on capturing sequential patterns within the training data, neglecting the broader context and semantic information embedded in item titles from external sources. This limits their predictive power and adaptability. Recently, large language models (LLMs) have shown promise in SR tasks due to their advanced understanding capabilities and strong generalization abilities. Researchers have attempted to enhance LLMs' recommendation performance by incorporating information from SR models. However, previous approaches have encountered problems such as 1) only influencing LLMs at the result level; 2) increased complexity of LLMs recommendation methods leading to reduced interpretability; 3) incomplete understanding and utilization of SR models information by LLMs. To address these problems, we proposes a novel framework, DELRec, which aims to extract knowledge from SR models and enable LLMs to easily comprehend and utilize this supplementary information for more effective sequential recommendations. DELRec consists of two main stages: 1) SR Models Pattern Distilling, focusing on extracting behavioral patterns exhibited by SR models using soft prompts through two well-designed strategies; 2) LLMs-based Sequential Recommendation, aiming to fine-tune LLMs to effectively use the distilled auxiliary information to perform SR tasks. Extensive experimental results conducted on three real datasets validate the effectiveness of the DELRec framework.
Read more6/19/2024