GLOCALFAIR: Jointly Improving Global and Local Group Fairness in Federated Learning
0
🤖
Sign in to get full access
Overview
- Federated learning (FL) allows multiple clients to collaboratively train a shared model without sharing their private data.
- However, the federated model can be biased against certain demographic groups due to data heterogeneity and client selection.
- Mitigating bias in FL is challenging as private training data and sensitive attributes are not directly accessible.
- Most prior work focuses on global fairness, overlooking local fairness for individual clients.
- Existing methods often require sharing sensitive information about client datasets, which is undesirable.
Plain English Explanation
Federated learning is a way for multiple organizations or individuals to train a shared machine learning model without having to share their private data. This is useful for protecting people's privacy. However, the model that is trained through federated learning can end up being biased against certain groups of people, like those of different races or genders. This is because the data used to train the model may not be representative of the full population.
Fixing this bias problem in federated learning is particularly tricky, because the private training data and sensitive attributes of the participants are not directly available. Most previous research has focused on making the overall, or "global," model fair, but has ignored the fairness of the model for individual participants, or the "local" fairness.
Additionally, many existing methods to improve fairness in federated learning require the participants to share sensitive information about their private data, which is not desirable from a privacy perspective.
Technical Explanation
To address these issues, the researchers propose a framework called GLOCALFAIR that can jointly improve both global and local group fairness in federated learning without requiring access to private data.
On the client side, GLOCALFAIR uses constrained optimization to enforce local fairness within each participant's model. On the server side, it adopts a fairness-aware clustering-based aggregation approach to further ensure global model fairness across different sensitive groups, while still maintaining a high level of overall utility.
The researchers evaluated GLOCALFAIR on image and tabular datasets, comparing it to state-of-the-art fairness baselines. The results show that GLOCALFAIR can achieve enhanced fairness at both the global and local levels, while preserving good model performance.
Critical Analysis
The paper acknowledges some limitations of GLOCALFAIR. For example, the fairness-aware clustering approach on the server side may not scale well to a large number of clients. The researchers also note that GLOCALFAIR requires additional hyperparameters to balance fairness and utility, which may be challenging to tune in practice.
Additionally, the evaluation is conducted on a relatively small number of datasets, and the real-world deployment implications are not fully explored. Further research may be needed to assess GLOCALFAIR's performance and generalizability in more diverse, large-scale federated learning scenarios.
Conclusion
The GLOCALFAIR framework represents an important step towards jointly improving global and local fairness in federated learning, without requiring access to sensitive client data. By addressing both global and local fairness concerns, this approach can help ensure that the benefits of federated learning are distributed equitably across different demographic groups. As federated learning continues to gain traction in real-world applications, techniques like GLOCALFAIR will become increasingly crucial for developing fair and inclusive AI systems.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🤖
0
New!GLOCALFAIR: Jointly Improving Global and Local Group Fairness in Federated Learning
Syed Irfan Ali Meerza, Luyang Liu, Jiaxin Zhang, Jian Liu
Federated learning (FL) has emerged as a prospective solution for collaboratively learning a shared model across clients without sacrificing their data privacy. However, the federated learned model tends to be biased against certain demographic groups (e.g., racial and gender groups) due to the inherent FL properties, such as data heterogeneity and party selection. Unlike centralized learning, mitigating bias in FL is particularly challenging as private training datasets and their sensitive attributes are typically not directly accessible. Most prior research in this field only focuses on global fairness while overlooking the local fairness of individual clients. Moreover, existing methods often require sensitive information about the client's local datasets to be shared, which is not desirable. To address these issues, we propose GLOCALFAIR, a client-server co-design fairness framework that can jointly improve global and local group fairness in FL without the need for sensitive statistics about the client's private datasets. Specifically, we utilize constrained optimization to enforce local fairness on the client side and adopt a fairness-aware clustering-based aggregation on the server to further ensure the global model fairness across different sensitive groups while maintaining high utility. Experiments on two image datasets and one tabular dataset with various state-of-the-art fairness baselines show that GLOCALFAIR can achieve enhanced fairness under both global and local data distributions while maintaining a good level of utility and client fairness.
Read more10/4/2024
0
Enhancing Group Fairness in Federated Learning through Personalization
Yifan Yang, Ali Payani, Parinaz Naghizadeh
Personalized Federated Learning (FL) algorithms collaboratively train customized models for each client, enhancing the accuracy of the learned models on the client's local data (e.g., by clustering similar clients, by fine-tuning models locally, or by imposing regularization terms). In this paper, we investigate the impact of such personalization techniques on the group fairness of the learned models, and show that personalization can also lead to improved (local) fairness as an unintended benefit. We begin by illustrating these benefits of personalization through numerical experiments comparing several classes of personalized FL algorithms against a baseline FedAvg algorithm, elaborating on the reasons behind improved fairness using personalized FL, and then providing analytical support. Motivated by these, we then show how to build on this (unintended) fairness benefit, by further integrating a fairness metric into the cluster-selection procedure of clustering-based personalized FL algorithms, and improve the fairness-accuracy trade-off attainable through them. Specifically, we propose two new fairness-aware federated clustering algorithms, Fair-FCA and Fair-FL+HC, extending the existing IFCA and FL+HC algorithms, and demonstrate their ability to strike a (tuneable) balance between accuracy and fairness at the client level.
Read more10/4/2024
0
Federated Fairness Analytics: Quantifying Fairness in Federated Learning
Oscar Dilley, Juan Marcelo Parra-Ullauri, Rasheed Hussain, Dimitra Simeonidou
Federated Learning (FL) is a privacy-enhancing technology for distributed ML. By training models locally and aggregating updates - a federation learns together, while bypassing centralised data collection. FL is increasingly popular in healthcare, finance and personal computing. However, it inherits fairness challenges from classical ML and introduces new ones, resulting from differences in data quality, client participation, communication constraints, aggregation methods and underlying hardware. Fairness remains an unresolved issue in FL and the community has identified an absence of succinct definitions and metrics to quantify fairness; to address this, we propose Federated Fairness Analytics - a methodology for measuring fairness. Our definition of fairness comprises four notions with novel, corresponding metrics. They are symptomatically defined and leverage techniques originating from XAI, cooperative game-theory and networking engineering. We tested a range of experimental settings, varying the FL approach, ML task and data settings. The results show that statistical heterogeneity and client participation affect fairness and fairness conscious approaches such as Ditto and q-FedAvg marginally improve fairness-performance trade-offs. Using our techniques, FL practitioners can uncover previously unobtainable insights into their system's fairness, at differing levels of granularity in order to address fairness challenges in FL. We have open-sourced our work at: https://github.com/oscardilley/federated-fairness.
Read more8/16/2024
0
Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversity
Yuhang Chen, Wenke Huang, Mang Ye
Federated learning (FL) has emerged as a new paradigm for privacy-preserving collaborative training. Under domain skew, the current FL approaches are biased and face two fairness problems. 1) Parameter Update Conflict: data disparity among clients leads to varying parameter importance and inconsistent update directions. These two disparities cause important parameters to potentially be overwhelmed by unimportant ones of dominant updates. It consequently results in significant performance decreases for lower-performing clients. 2) Model Aggregation Bias: existing FL approaches introduce unfair weight allocation and neglect domain diversity. It leads to biased model convergence objective and distinct performance among domains. We discover a pronounced directional update consistency in Federated Learning and propose a novel framework to tackle above issues. First, leveraging the discovered characteristic, we selectively discard unimportant parameter updates to prevent updates from clients with lower performance overwhelmed by unimportant parameters, resulting in fairer generalization performance. Second, we propose a fair aggregation objective to prevent global model bias towards some domains, ensuring that the global model continuously aligns with an unbiased model. The proposed method is generic and can be combined with other existing FL methods to enhance fairness. Comprehensive experiments on Digits and Office-Caltech demonstrate the high fairness and performance of our method.
Read more5/28/2024