Mysterious and Manipulative Black Boxes: A Qualitative Analysis of Perceptions on Recommender Systems
2302.09933
0
0
🤔
Abstract
Recommender systems are used to provide relevant suggestions on various matters. Although these systems are a classical research topic, knowledge is still limited regarding the public opinion about these systems. Public opinion is also important because the systems are known to cause various problems. To this end, this paper presents a qualitative analysis of the perceptions of ordinary citizens, civil society groups, businesses, and others on recommender systems in Europe. The dataset examined is based on the answers submitted to a consultation about the Digital Services Act (DSA) recently enacted in the European Union (EU). Therefore, not only does the paper contribute to the pressing question about regulating new technologies and online platforms, but it also reveals insights about the policy-making of the DSA. According to the qualitative results, Europeans have generally negative opinions about recommender systems and the quality of their recommendations. The systems are widely seen to violate privacy and other fundamental rights. According to many Europeans, these also cause various societal problems, including even threats to democracy. Furthermore, existing regulations in the EU are commonly seen to have failed due to a lack of proper enforcement. Numerous suggestions were made by the respondents to the consultation for improving the situation, but only a few of these ended up to the DSA.
Create account to get full access
Overview
- This paper presents a qualitative analysis of the public perception of recommender systems in Europe.
- The dataset is based on responses to a consultation about the European Union's Digital Services Act (DSA).
- The analysis reveals generally negative opinions about recommender systems and concerns about privacy, rights violations, and societal problems.
- Respondents made numerous suggestions for improving the regulation of recommender systems, but many were not incorporated into the final DSA.
Plain English Explanation
Recommender systems are technologies that provide personalized suggestions to users, such as product recommendations on e-commerce sites or video suggestions on streaming platforms. This paper examines how ordinary citizens, advocacy groups, businesses, and others in Europe perceive these recommender systems.
The researchers analyzed responses from a public consultation about the European Union's new Digital Services Act (DSA), which is aimed at regulating online platforms and technologies. The responses reveal that many Europeans have significant concerns about recommender systems. They believe these systems often violate people's privacy and other fundamental rights, and can even threaten democracy by reinforcing harmful content or opinions.
Respondents provided numerous suggestions for improving the regulation of recommender systems, such as increasing transparency, user control, and accountability. However, the researchers found that only a few of these suggestions were ultimately incorporated into the final DSA legislation. This suggests a disconnect between public concerns and the policy decisions made by lawmakers.
Overall, the study highlights the need for policymakers to better understand and address the public's perceptions and concerns about emerging technologies like recommender systems. Careful regulation and oversight will be crucial to ensure these systems are developed and used responsibly to benefit society.
Technical Explanation
This paper presents a qualitative analysis of public perceptions of recommender systems in Europe, based on responses to a consultation about the European Union's Digital Services Act (DSA). The researchers examined over 2,000 submissions to the DSA consultation, which sought input from citizens, civil society groups, businesses, and other stakeholders.
Through thematic analysis of the responses, the researchers identified several key themes regarding public views on recommender systems. Respondents expressed widespread concerns about these systems violating privacy and other fundamental rights. Many also believed recommender systems were causing societal problems, including the spread of misinformation and threats to democracy.
Respondents provided numerous suggestions for improving the regulation of recommender systems, such as increased transparency, user control, and accountability. However, the researchers found that only a small subset of these suggestions were ultimately incorporated into the final DSA legislation.
The paper provides valuable insights into the public's perceptions of recommender systems and the challenges of regulating emerging technologies. The findings suggest a need for policymakers to better engage with and address citizens' concerns when developing new laws and regulations.
Critical Analysis
This study offers important insights into public attitudes towards recommender systems, an area that has received relatively little research attention compared to the technical development of these systems. By analyzing responses to a high-profile policy consultation, the researchers were able to gain a nuanced understanding of diverse stakeholder perspectives.
The qualitative approach used in the study allows for a rich, contextual understanding of public perceptions. However, it is unclear how representative the consultation responses are of the general population. The sample may be biased towards more engaged citizens and advocacy groups.
Additionally, the paper does not delve deeply into the specific reasons behind the negative perceptions of recommender systems. Further research is needed to understand the underlying factors driving public concerns, such as data privacy, algorithmic bias, or the societal impacts of personalized content curation.
While the paper highlights the disconnect between public input and policymaking, it does not explore the complex political and institutional factors that may shape regulatory outcomes. A more comprehensive analysis of the policy process could yield additional insights into the challenges of regulating emerging technologies.
Overall, this study represents an important contribution to the growing body of research on public attitudes towards algorithmic systems. Continued engagement with citizens and civil society will be crucial as policymakers work to develop appropriate governance frameworks for recommender systems and other AI-powered technologies.
Conclusion
This paper provides valuable insights into how European citizens, civil society groups, businesses, and other stakeholders perceive recommender systems. The qualitative analysis of responses to a public consultation on the EU's Digital Services Act reveals widespread negative opinions about these systems.
Respondents expressed concerns that recommender systems violate privacy, enable the spread of misinformation, and even threaten democratic values. Many offered suggestions for improving the regulation of these systems, but the researchers found that only a small fraction of these ideas were incorporated into the final DSA legislation.
The study highlights the need for policymakers to better engage with public perceptions and concerns when developing regulations for emerging technologies like recommender systems. Continued dialogue and collaboration between citizens, civil society, industry, and government will be crucial to ensuring these powerful algorithms are developed and deployed in ways that benefit society as a whole.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Transparency, Privacy, and Fairness in Recommender Systems
Dominik Kowald
0
0
Recommender systems have become a pervasive part of our daily online experience, and are one of the most widely used applications of artificial intelligence and machine learning. Therefore, regulations and requirements for trustworthy artificial intelligence, for example, the European AI Act, which includes notions such as transparency, privacy, and fairness are also highly relevant for the design of recommender systems in practice. This habilitation elaborates on aspects related to these three notions in the light of recommender systems, namely: (i) transparency and cognitive models, (ii) privacy and limited preference information, and (iii) fairness and popularity bias in recommender systems. Specifically, with respect to aspect (i), we highlight the usefulness of incorporating psychological theories for a transparent design process of recommender systems. We term this type of systems psychology-informed recommender systems. In aspect (ii), we study and address the trade-off between accuracy and privacy in differentially-private recommendations. We design a novel recommendation approach for collaborative filtering based on an efficient neighborhood reuse concept, which reduces the number of users that need to be protected with differential privacy. Furthermore, we address the related issue of limited availability of user preference information, e.g., click data, in the settings of session-based and cold-start recommendations. With respect to aspect (iii), we analyze popularity bias in recommender systems. We find that the recommendation frequency of an item is positively correlated with this item's popularity. This also leads to the unfair treatment of users with little interest in popular content. Finally, we study long-term fairness dynamics in algorithmic decision support in the labor market using agent-based modeling techniques.
7/1/2024
📊
Review-based Recommender Systems: A Survey of Approaches, Challenges and Future Perspectives
Emrul Hasan, Mizanur Rahman, Chen Ding, Jimmy Xiangji Huang, Shaina Raza
0
0
Recommender systems play a pivotal role in helping users navigate an overwhelming selection of products and services. On online platforms, users have the opportunity to share feedback in various modes, including numerical ratings, textual reviews, and likes/dislikes. Traditional recommendation systems rely on users explicit ratings or implicit interactions (e.g. likes, clicks, shares, saves) to learn user preferences and item characteristics. Beyond these numerical ratings, textual reviews provide insights into users fine-grained preferences and item features. Analyzing these reviews is crucial for enhancing the performance and interpretability of personalized recommendation results. In recent years, review-based recommender systems have emerged as a significant sub-field in this domain. In this paper, we provide a comprehensive overview of the developments in review-based recommender systems over recent years, highlighting the importance of reviews in recommender systems, as well as the challenges associated with extracting features from reviews and integrating them into ratings. Specifically, we present a categorization of these systems and summarize the state-of-the-art methods, analyzing their unique features, effectiveness, and limitations. Finally, we propose potential directions for future research, including the integration of multimodal data, multi-criteria rating information, and ethical considerations.
5/14/2024
Effect of recommending users and opinions on the network connectivity and idea generation process
Sriniwas Pandey, Hiroki Sayama
0
0
The growing reliance on online services underscores the crucial role of recommendation systems, especially on social media platforms seeking increased user engagement. This study investigates how recommendation systems influence the impact of personal behavioral traits on social network dynamics. It explores the interplay between homophily, users' openness to novel ideas, and recommendation-driven exposure to new opinions. Additionally, the research examines the impact of recommendation systems on the diversity of newly generated ideas, shedding light on the challenges and opportunities in designing effective systems that balance the exploration of new ideas with the risk of reinforcing biases or filtering valuable, unconventional concepts.
5/24/2024
🤔
Ah, that's the great puzzle: On the Quest of a Holistic Understanding of the Harms of Recommender Systems on Children
Robin Ungruh, Maria Soledad Pera
0
0
Children come across various media items online, many of which are selected by recommender systems (RS) primarily designed for adults. The specific nature of the content selected by RS to display on online platforms used by children - although not necessarily targeting them as a user base - remains largely unknown. This raises questions about whether such content is appropriate given children's vulnerable stages of development and the potential risks to their well-being. In this position paper, we reflect on the relationship between RS and children, emphasizing the possible adverse effects of the content this user group might be exposed to online. As a step towards fostering safer interactions for children in online environments, we advocate for researchers, practitioners, and policymakers to undertake a more comprehensive examination of the impact of RS on children - one focused on harms. This would result in a more holistic understanding that could inform the design and deployment of strategies that would better suit children's needs and preferences while actively mitigating the potential harm posed by RS; acknowledging that identifying and addressing these harms is complex and multifaceted.
5/6/2024