Towards Robust Recommendation via Decision Boundary-aware Graph Contrastive Learning

Read original: arXiv:2407.10184 - Published 7/23/2024 by Jiakai Tang, Sunhao Dai, Zexu Sun, Xu Chen, Jun Xu, Wenhui Yu, Lantao Hu, Peng Jiang, Han Li
Total Score

0

Towards Robust Recommendation via Decision Boundary-aware Graph Contrastive Learning

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper proposes a novel graph contrastive learning (GCL) approach to improve the robustness of recommender systems.
  • The key idea is to leverage the decision boundary information of a recommendation model to guide the GCL process, leading to more discriminative and robust node representations.
  • The proposed method, called Decision Boundary-aware Graph Contrastive Learning (DB-GCL), outperforms existing GCL-based recommendation models in terms of recommendation accuracy and robustness against adversarial attacks.

Plain English Explanation

Recommender systems are widely used to suggest products, content, or services that users might be interested in. However, these systems can be vulnerable to adversarial attacks, where small, imperceptible changes to the input data can cause the system to make incorrect recommendations.

The authors of this paper have developed a new approach, called Decision Boundary-aware Graph Contrastive Learning (DB-GCL), to make recommender systems more robust against these types of attacks. The key idea is to use the decision boundary information of the recommendation model - that is, the regions in the data where the model is most uncertain about its predictions - to guide the training of the model.

By incorporating this decision boundary information into the graph contrastive learning process, the model is able to learn more discriminative and robust representations of the user and item data. This, in turn, helps the recommender system make more accurate and reliable recommendations, even in the face of adversarial attacks.

The authors demonstrate the effectiveness of their approach through experiments on several real-world datasets, showing that DB-GCL outperforms existing graph contrastive learning methods in terms of both recommendation accuracy and robustness.

Technical Explanation

The authors propose a novel graph contrastive learning (GCL) approach called Decision Boundary-aware Graph Contrastive Learning (DB-GCL) to improve the robustness of recommender systems. The key idea is to leverage the decision boundary information of the recommendation model to guide the GCL process, leading to more discriminative and robust node representations.

Specifically, the authors first train a base recommendation model using a standard approach, such as graph neural network or matrix factorization. They then use this base model to identify the decision boundary regions in the user-item interaction graph, which correspond to the areas where the model is most uncertain about its predictions.

Next, the authors incorporate this decision boundary information into the GCL objective function, encouraging the model to learn representations that are more separable and robust around these critical regions. This is achieved by introducing a decision boundary-aware contrastive loss that pulls positive node pairs (i.e., connected nodes) closer together and pushes negative node pairs (i.e., unconnected nodes) further apart, with a stronger emphasis on node pairs near the decision boundary.

The authors evaluate the proposed DB-GCL approach on several real-world datasets and compare it to existing GCL-based recommendation methods, such as Dual-Perspective Cross-Contrastive Learning and Community-Invariant Graph Contrastive Learning. The results demonstrate that DB-GCL outperforms these baselines in terms of recommendation accuracy and robustness against adversarial attacks.

Critical Analysis

The authors have provided a thoughtful and well-designed approach to improving the robustness of recommender systems through graph contrastive learning. The key innovation of leveraging decision boundary information to guide the GCL process is a promising direction that can potentially be applied to other graph-based machine learning tasks beyond recommendation.

However, the paper does not discuss potential limitations or caveats of the proposed method. For example, it is unclear how the decision boundary information is precisely computed and incorporated into the GCL objective function. Additionally, the authors do not explore the trade-offs between recommendation accuracy and robustness, or how the method might perform in the presence of more sophisticated adversarial attacks.

Further research could also investigate the theoretical properties of the proposed approach, such as its convergence guarantees and generalization bounds. Exploring the transferability of the learned representations to other downstream tasks could also be a valuable direction.

Conclusion

This paper presents a novel graph contrastive learning approach, called Decision Boundary-aware Graph Contrastive Learning (DB-GCL), to improve the robustness of recommender systems. The key idea is to leverage the decision boundary information of the recommendation model to guide the GCL process, leading to more discriminative and robust node representations.

The authors demonstrate the effectiveness of their approach through experiments on several real-world datasets, showing that DB-GCL outperforms existing GCL-based recommendation methods in terms of both recommendation accuracy and robustness against adversarial attacks. The proposed method represents a promising direction for enhancing the reliability and trustworthiness of recommender systems, which are crucial for many real-world applications.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Towards Robust Recommendation via Decision Boundary-aware Graph Contrastive Learning
Total Score

0

Towards Robust Recommendation via Decision Boundary-aware Graph Contrastive Learning

Jiakai Tang, Sunhao Dai, Zexu Sun, Xu Chen, Jun Xu, Wenhui Yu, Lantao Hu, Peng Jiang, Han Li

In recent years, graph contrastive learning (GCL) has received increasing attention in recommender systems due to its effectiveness in reducing bias caused by data sparsity. However, most existing GCL models rely on heuristic approaches and usually assume entity independence when constructing contrastive views. We argue that these methods struggle to strike a balance between semantic invariance and view hardness across the dynamic training process, both of which are critical factors in graph contrastive learning. To address the above issues, we propose a novel GCL-based recommendation framework RGCL, which effectively maintains the semantic invariance of contrastive pairs and dynamically adapts as the model capability evolves through the training process. Specifically, RGCL first introduces decision boundary-aware adversarial perturbations to constrain the exploration space of contrastive augmented views, avoiding the decrease of task-specific information. Furthermore, to incorporate global user-user and item-item collaboration relationships for guiding on the generation of hard contrastive views, we propose an adversarial-contrastive learning objective to construct a relation-aware view-generator. Besides, considering that unsupervised GCL could potentially narrower margins between data points and the decision boundary, resulting in decreased model robustness, we introduce the adversarial examples based on maximum perturbations to achieve margin maximization. We also provide theoretical analyses on the effectiveness of our designs. Through extensive experiments on five public datasets, we demonstrate the superiority of RGCL compared against twelve baseline models.

Read more

7/23/2024

Dual Adversarial Perturbators Generate rich Views for Recommendation
Total Score

0

Dual Adversarial Perturbators Generate rich Views for Recommendation

Lijun Zhang, Yuan Yao, Haibo Ye

Graph contrastive learning (GCL) has been extensively studied and leveraged as a potent tool in recommender systems. Most existing GCL-based recommenders generate contrastive views by altering the graph structure or introducing perturbations to embedding. While these methods effectively enhance learning from sparse data, they risk performance degradation or even training collapse when the differences between contrastive views become too pronounced. To mitigate this issue, we employ curriculum learning to incrementally increase the disparity between contrastive views, enabling the model to gain from more challenging scenarios. In this paper, we propose a dual-adversarial graph learning approach, AvoGCL, which emulates curriculum learning by progressively applying adversarial training to graph structures and embedding perturbations. Specifically, AvoGCL construct contrastive views by reducing graph redundancy and generating adversarial perturbations in the embedding space, and achieve better results by gradually increasing the difficulty of contrastive views. Extensive experiments on three real-world datasets demonstrate that AvoGCL significantly outperforms the state-of-the-art competitors.

Read more

9/12/2024

👨‍🏫

Total Score

0

Mixed Supervised Graph Contrastive Learning for Recommendation

Weizhi Zhang, Liangwei Yang, Zihe Song, Henry Peng Zou, Ke Xu, Yuanjie Zhu, Philip S. Yu

Recommender systems (RecSys) play a vital role in online platforms, offering users personalized suggestions amidst vast information. Graph contrastive learning aims to learn from high-order collaborative filtering signals with unsupervised augmentation on the user-item bipartite graph, which predominantly relies on the multi-task learning framework involving both the pair-wise recommendation loss and the contrastive loss. This decoupled design can cause inconsistent optimization direction from different losses, which leads to longer convergence time and even sub-optimal performance. Besides, the self-supervised contrastive loss falls short in alleviating the data sparsity issue in RecSys as it learns to differentiate users/items from different views without providing extra supervised collaborative filtering signals during augmentations. In this paper, we propose Mixed Supervised Graph Contrastive Learning for Recommendation (MixSGCL) to address these concerns. MixSGCL originally integrates the training of recommendation and unsupervised contrastive losses into a supervised contrastive learning loss to align the two tasks within one optimization direction. To cope with the data sparsity issue, instead unsupervised augmentation, we further propose node-wise and edge-wise mixup to mine more direct supervised collaborative filtering signals based on existing user-item interactions. Extensive experiments on three real-world datasets demonstrate that MixSGCL surpasses state-of-the-art methods, achieving top performance on both accuracy and efficiency. It validates the effectiveness of MixSGCL with our coupled design on supervised graph contrastive learning.

Read more

4/29/2024

Enhancing Graph Contrastive Learning with Reliable and Informative Augmentation for Recommendation
Total Score

0

Enhancing Graph Contrastive Learning with Reliable and Informative Augmentation for Recommendation

Bowen Zheng, Junjie Zhang, Hongyu Lu, Yu Chen, Ming Chen, Wayne Xin Zhao, Ji-Rong Wen

Graph neural network (GNN) has been a powerful approach in collaborative filtering (CF) due to its ability to model high-order user-item relationships. Recently, to alleviate the data sparsity and enhance representation learning, many efforts have been conducted to integrate contrastive learning (CL) with GNNs. Despite the promising improvements, the contrastive view generation based on structure and representation perturbations in existing methods potentially disrupts the collaborative information in contrastive views, resulting in limited effectiveness of positive alignment. To overcome this issue, we propose CoGCL, a novel framework that aims to enhance graph contrastive learning by constructing contrastive views with stronger collaborative information via discrete codes. The core idea is to map users and items into discrete codes rich in collaborative information for reliable and informative contrastive view generation. To this end, we initially introduce a multi-level vector quantizer in an end-to-end manner to quantize user and item representations into discrete codes. Based on these discrete codes, we enhance the collaborative information of contrastive views by considering neighborhood structure and semantic relevance respectively. For neighborhood structure, we propose virtual neighbor augmentation by treating discrete codes as virtual neighbors, which expands an observed user-item interaction into multiple edges involving discrete codes. Regarding semantic relevance, we identify similar users/items based on shared discrete codes and interaction targets to generate the semantically relevant view. Through these strategies, we construct contrastive views with stronger collaborative information and develop a triple-view graph contrastive learning approach. Extensive experiments on four public datasets demonstrate the effectiveness of our proposed approach.

Read more

9/10/2024