Evidential Graph Contrastive Alignment for Source-Free Blending-Target Domain Adaptation

Read original: arXiv:2408.07527 - Published 8/27/2024 by Juepeng Zheng, Yibin Wen, Jinxiao Zhang, Runmin Dong, Haohuan Fu
Total Score

0

Evidential Graph Contrastive Alignment for Source-Free Blending-Target Domain Adaptation

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Presents a novel approach called Evidential Graph Contrastive Alignment (EGCA) for source-free blending-target domain adaptation
  • Leverages an evidential graph neural network to capture both local and global structure of the target domain
  • Aligns the target domain with the source domain using contrastive learning to improve generalization

Plain English Explanation

The paper introduces a new technique called Evidential Graph Contrastive Alignment (EGCA) to help machine learning models adapt to new target domains without access to the original source domain data. This is a common challenge in real-world applications, where the source data used to train a model may not be available when deploying the model in a new environment.

EGCA works by using an evidential graph neural network to capture both the local and global structure of the target domain. It then aligns this target domain representation with the source domain using contrastive learning, a technique that encourages the model to learn features that are shared between the two domains.

By preserving the relationships and patterns in the target data, while also finding the commonalities with the source, EGCA is able to adapt the original model to perform well on the new target domain without requiring access to the original training data. This can be very useful in applications where the source data may be sensitive, expensive, or otherwise unavailable when deploying the model.

Technical Explanation

The key technical components of EGCA are:

  1. Evidential Graph Neural Network: The authors use an evidential graph neural network to encode the target domain data. This allows the model to capture both the local and global structure of the target data, which is important for preserving the relationships and patterns in the new domain.

  2. Contrastive Alignment: EGCA aligns the target domain representation with the source domain using contrastive learning. This encourages the model to learn features that are shared between the two domains, facilitating the transfer of knowledge from the source to the target.

  3. Source-Free Adaptation: By leveraging the evidential graph and contrastive alignment, EGCA is able to adapt the original model to the target domain without requiring access to the source domain data. This makes it applicable to real-world scenarios where the source data may not be available during deployment.

The authors evaluate EGCA on several benchmark datasets for domain adaptation and show that it outperforms state-of-the-art source-free and unsupervised domain adaptation methods.

Critical Analysis

The paper provides a well-designed and thorough evaluation of the EGCA approach, demonstrating its effectiveness on multiple domain adaptation tasks. However, the authors do acknowledge some potential limitations:

  1. Sensitivity to Target Domain Size: The performance of EGCA may be sensitive to the size of the target domain, as the evidential graph and contrastive alignment rely on having a sufficient amount of target data to learn meaningful representations.

  2. Computational Complexity: The use of the evidential graph neural network and contrastive alignment may increase the computational complexity of the model, which could be a concern for real-world deployment.

  3. Generalization to Diverse Domains: While EGCA shows promising results on the evaluated benchmarks, it would be valuable to further assess its performance on a wider range of target domains with more diverse characteristics.

Overall, EGCA presents a compelling approach to source-free domain adaptation that leverages the strengths of evidential graph neural networks and contrastive learning. The authors have made a valuable contribution to the field, but there are still opportunities for further research and refinement of the technique.

Conclusion

The Evidential Graph Contrastive Alignment (EGCA) method proposed in this paper offers a novel solution to the challenge of source-free domain adaptation. By capturing the structure of the target domain and aligning it with the source domain through contrastive learning, EGCA can effectively transfer knowledge without requiring access to the original training data.

This capability is highly valuable for real-world applications where the source data may be unavailable or difficult to obtain. EGCA's strong performance on benchmark datasets suggests that it has the potential to significantly improve the adaptability and deployment of machine learning models in diverse and dynamic environments.

While the paper identifies some potential limitations, the core ideas behind EGCA represent an important advancement in the field of domain adaptation. As the authors continue to refine and expand upon this work, it could have far-reaching implications for the development of more robust and flexible AI systems.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Evidential Graph Contrastive Alignment for Source-Free Blending-Target Domain Adaptation
Total Score

0

Evidential Graph Contrastive Alignment for Source-Free Blending-Target Domain Adaptation

Juepeng Zheng, Yibin Wen, Jinxiao Zhang, Runmin Dong, Haohuan Fu

In this paper, we firstly tackle a more realistic Domain Adaptation (DA) setting: Source-Free Blending-Target Domain Adaptation (SF-BTDA), where we can not access to source domain data while facing mixed multiple target domains without any domain labels in prior. Compared to existing DA scenarios, SF-BTDA generally faces the co-existence of different label shifts in different targets, along with noisy target pseudo labels generated from the source model. In this paper, we propose a new method called Evidential Contrastive Alignment (ECA) to decouple the blending target domain and alleviate the effect from noisy target pseudo labels. First, to improve the quality of pseudo target labels, we propose a calibrated evidential learning module to iteratively improve both the accuracy and certainty of the resulting model and adaptively generate high-quality pseudo target labels. Second, we design a graph contrastive learning with the domain distance matrix and confidence-uncertainty criterion, to minimize the distribution gap of samples of a same class in the blended target domains, which alleviates the co-existence of different label shifts in blended targets. We conduct a new benchmark based on three standard DA datasets and ECA outperforms other methods with considerable gains and achieves comparable results compared with those that have domain labels or source data in prior.

Read more

8/27/2024

👀

Total Score

0

Source-Free Domain Adaptation Guided by Vision and Vision-Language Pre-Training

Wenyu Zhang, Li Shen, Chuan-Sheng Foo

Source-free domain adaptation (SFDA) aims to adapt a source model trained on a fully-labeled source domain to a related but unlabeled target domain. While the source model is a key avenue for acquiring target pseudolabels, the generated pseudolabels may exhibit source bias. In the conventional SFDA pipeline, a large data (e.g. ImageNet) pre-trained feature extractor is used to initialize the source model at the start of source training, and subsequently discarded. Despite having diverse features important for generalization, the pre-trained feature extractor can overfit to the source data distribution during source training and forget relevant target domain knowledge. Rather than discarding this valuable knowledge, we introduce an integrated framework to incorporate pre-trained networks into the target adaptation process. The proposed framework is flexible and allows us to plug modern pre-trained networks into the adaptation process to leverage their stronger representation learning capabilities. For adaptation, we propose the Co-learn algorithm to improve target pseudolabel quality collaboratively through the source model and a pre-trained feature extractor. Building on the recent success of the vision-language model CLIP in zero-shot image recognition, we present an extension Co-learn++ to further incorporate CLIP's zero-shot classification decisions. We evaluate on 4 benchmark datasets and include more challenging scenarios such as open-set, partial-set and open-partial SFDA. Experimental results demonstrate that our proposed strategy improves adaptation performance and can be successfully integrated with existing SFDA methods.

Read more

8/22/2024

Learn from the Learnt: Source-Free Active Domain Adaptation via Contrastive Sampling and Visual Persistence
Total Score

0

Learn from the Learnt: Source-Free Active Domain Adaptation via Contrastive Sampling and Visual Persistence

Mengyao Lyu, Tianxiang Hao, Xinhao Xu, Hui Chen, Zijia Lin, Jungong Han, Guiguang Ding

Domain Adaptation (DA) facilitates knowledge transfer from a source domain to a related target domain. This paper investigates a practical DA paradigm, namely Source data-Free Active Domain Adaptation (SFADA), where source data becomes inaccessible during adaptation, and a minimum amount of annotation budget is available in the target domain. Without referencing the source data, new challenges emerge in identifying the most informative target samples for labeling, establishing cross-domain alignment during adaptation, and ensuring continuous performance improvements through the iterative query-and-adaptation process. In response, we present learn from the learnt (LFTL), a novel paradigm for SFADA to leverage the learnt knowledge from the source pretrained model and actively iterated models without extra overhead. We propose Contrastive Active Sampling to learn from the hypotheses of the preceding model, thereby querying target samples that are both informative to the current model and persistently challenging throughout active learning. During adaptation, we learn from features of actively selected anchors obtained from previous intermediate models, so that the Visual Persistence-guided Adaptation can facilitate feature distribution alignment and active sample exploitation. Extensive experiments on three widely-used benchmarks show that our LFTL achieves state-of-the-art performance, superior computational efficiency and continuous improvements as the annotation budget increases. Our code is available at https://github.com/lyumengyao/lftl.

Read more

7/29/2024

High-order Neighborhoods Know More: HyperGraph Learning Meets Source-free Unsupervised Domain Adaptation
Total Score

0

High-order Neighborhoods Know More: HyperGraph Learning Meets Source-free Unsupervised Domain Adaptation

Jinkun Jiang, Qingxuan Lv, Yuezun Li, Yong Du, Sheng Chen, Hui Yu, Junyu Dong

Source-free Unsupervised Domain Adaptation (SFDA) aims to classify target samples by only accessing a pre-trained source model and unlabelled target samples. Since no source data is available, transferring the knowledge from the source domain to the target domain is challenging. Existing methods normally exploit the pair-wise relation among target samples and attempt to discover their correlations by clustering these samples based on semantic features. The drawback of these methods includes: 1) the pair-wise relation is limited to exposing the underlying correlations of two more samples, hindering the exploration of the structural information embedded in the target domain; 2) the clustering process only relies on the semantic feature, while overlooking the critical effect of domain shift, i.e., the distribution differences between the source and target domains. To address these issues, we propose a new SFDA method that exploits the high-order neighborhood relation and explicitly takes the domain shift effect into account. Specifically, we formulate the SFDA as a Hypergraph learning problem and construct hyperedges to explore the local group and context information among multiple samples. Moreover, we integrate a self-loop strategy into the constructed hypergraph to elegantly introduce the domain uncertainty of each sample. By clustering these samples based on hyperedges, both the semantic feature and domain shift effects are considered. We then describe an adaptive relation-based objective to tune the model with soft attention levels for all samples. Extensive experiments are conducted on Office-31, Office-Home, VisDA, and PointDA-10 datasets. The results demonstrate the superiority of our method over state-of-the-art counterparts.

Read more

5/14/2024