Automated Transparency: A Legal and Empirical Analysis of the Digital Services Act Transparency Database

Read original: arXiv:2404.02894 - Published 5/6/2024 by Rishabh Kaushal, Jacob van de Kerkhof, Catalina Goanta, Gerasimos Spanakis, Adriana Iamnitchi
Total Score

0

Automated Transparency: A Legal and Empirical Analysis of the Digital Services Act Transparency Database

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper analyzes the transparency database created by the EU's Digital Services Act (DSA), which requires large online platforms to publicly report on their content moderation practices.
  • The researchers conducted a legal and empirical analysis to assess the transparency and compliance of the database.
  • They found issues with the completeness and usability of the data, as well as potential conflicts between the transparency requirements and platforms' data protection obligations.

Plain English Explanation

The Digital Services Act is a new European Union law that aims to make large online platforms more transparent about how they moderate user-generated content. As part of this, the platforms have to publicly report information about their content moderation practices, such as how many posts they remove and why.

The researchers in this paper looked closely at this transparency database to see how well it is working. They found some problems - the data in the database is often incomplete or difficult to understand, and there are also concerns that the transparency requirements might clash with the platforms' legal obligations to protect user privacy.

Overall, the researchers conclude that while the transparency database is a step in the right direction, there is still work to be done to make it truly effective and useful for the public. Requiring platforms to be more open about their content moderation is a good idea, but the implementation needs to be improved.

Technical Explanation

The paper provides a legal and empirical analysis of the transparency database created under the EU's Digital Services Act (DSA). The DSA mandates that very large online platforms publish regular reports on various aspects of their content moderation practices, including the volumes and reasons for content removals, the use of recommender systems, and the handling of user complaints.

The researchers first conducted a legal analysis to understand the transparency requirements set out in the DSA. They then gathered and analyzed the transparency reports published by the platforms, assessing their completeness, usability, and compliance with the legal framework.

The key findings include:

  • Significant gaps and inconsistencies in the data reported by platforms, limiting the database's completeness and usefulness.
  • Usability challenges, as the reports use different formats and metrics, making cross-platform comparisons difficult.
  • Potential conflicts between the transparency requirements and platforms' data protection obligations under the GDPR.

The researchers also highlight concerns that the transparency database may not provide sufficient insight into the actual content moderation practices of the platforms, as the reported data could be selectively presented.

Critical Analysis

The paper provides a thorough and balanced assessment of the transparency database created under the DSA. The researchers acknowledge the valuable intent behind the transparency requirements but also identify several important limitations and challenges in their implementation.

One key issue raised is the potential tension between the transparency goals and platforms' data protection obligations. While the public has a legitimate interest in understanding content moderation practices, the researchers note that overly granular reporting could compromise user privacy. Striking the right balance is crucial but difficult.

The researchers also highlight that the current transparency reports may not provide a complete or accurate picture of the platforms' actual content moderation activities. The ability of platforms to selectively present data raises concerns about the database's true utility and effectiveness.

Further research could explore ways to improve the consistency, usability, and comprehensiveness of the transparency data, while also addressing the data protection considerations. Engaging with both platform providers and civil society stakeholders may be necessary to develop solutions that meet the spirit and intent of the DSA's transparency mandate.

Conclusion

This paper offers a critical examination of the transparency database established under the EU's Digital Services Act. While the researchers recognize the importance of platform accountability and public oversight, they identify significant challenges in the current implementation of the transparency requirements.

The analysis suggests that the transparency database, in its current form, may not be fully achieving its intended goals of providing the public with a clear and complete understanding of online platforms' content moderation practices. Addressing the issues of data quality, usability, and potential conflicts with data protection laws will be essential to ensure the database fulfills its role as a mechanism for meaningful platform transparency and accountability.

As policymakers and regulators continue to grapple with the complexities of platform governance, this paper highlights the need for ongoing evaluation and refinement of transparency frameworks to balance competing interests and deliver on the promise of a more open and accountable digital ecosystem.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Automated Transparency: A Legal and Empirical Analysis of the Digital Services Act Transparency Database
Total Score

0

Automated Transparency: A Legal and Empirical Analysis of the Digital Services Act Transparency Database

Rishabh Kaushal, Jacob van de Kerkhof, Catalina Goanta, Gerasimos Spanakis, Adriana Iamnitchi

The Digital Services Act (DSA) is a much awaited platforms liability reform in the European Union that was adopted on 1 November 2022 with the ambition to set a global example in terms of accountability and transparency. Among other obligations, the DSA emphasizes the need for online platforms to report on their content moderation decisions (`statements of reasons' - SoRs), which is a novel transparency mechanism we refer to as automated transparency in this study. SoRs are currently made available in the DSA Transparency Database, launched by the European Commission in September 2023. The DSA Transparency Database marks a historical achievement in platform governance, and allows investigations about the actual transparency gains, both at structure level as well as at the level of platform compliance. This study aims to understand whether the Transparency Database helps the DSA to live up to its transparency promises. We use legal and empirical arguments to show that while there are some transparency gains, compliance remains problematic, as the current database structure allows for a lot of discretion from platforms in terms of transparency practices. In our empirical study, we analyze a representative sample of the Transparency Database (131m SoRs) submitted in November 2023, to characterise and evaluate platform content moderation practices.

Read more

5/6/2024

The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Media
Total Score

0

The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Media

Amaury Trujillo, Tiziano Fagni, Stefano Cresci

Since September 2023, the Digital Services Act (DSA) obliges large online platforms to submit detailed data on each moderation action they take within the European Union (EU) to the DSA Transparency Database. From its inception, this centralized database has sparked scholarly interest as an unprecedented and potentially unique trove of data on real-world online moderation. Here, we thoroughly analyze all 353.12M records submitted by the eight largest social media platforms in the EU during the first 100 days of the database. Specifically, we conduct a platform-wise comparative study of their: volume of moderation actions, grounds for decision, types of applied restrictions, types of moderated content, timeliness in undertaking and submitting moderation actions, and use of automation. Furthermore, we systematically cross-check the contents of the database with the platforms' own transparency reports. Our analyses reveal that (i) the platforms adhered only in part to the philosophy and structure of the database, (ii) the structure of the database is partially inadequate for the platforms' reporting needs, (iii) the platforms exhibited substantial differences in their moderation actions, (iv) a remarkable fraction of the database data is inconsistent, (v) the platform X (formerly Twitter) presents the most inconsistencies. Our findings have far-reaching implications for policymakers and scholars across diverse disciplines. They offer guidance for future regulations that cater to the reporting needs of online platforms in general, but also highlight opportunities to improve and refine the database itself.

Read more

8/2/2024

🎯

Total Score

0

Operationalizing content moderation accuracy in the Digital Services Act

Johnny Tian-Zheng Wei, Frederike Zufall, Robin Jia

The Digital Services Act, recently adopted by the EU, requires social media platforms to report the accuracy of their automated content moderation systems. The colloquial term is vague, or open-textured -- the literal accuracy (number of correct predictions divided by the total) is not suitable for problems with large class imbalance, and the ground truth and dataset to measure accuracy against is unspecified. Without further specification, the regulatory requirement allows for deficient reporting. In this interdisciplinary work, we operationalize accuracy reporting by refining legal concepts and relating them to technical implementation. We start by elucidating the legislative purpose of the Act to legally justify an interpretation of accuracy as precision and recall. These metrics remain informative in class imbalanced settings, and reflect the proportional balancing of Fundamental Rights of the EU Charter. We then focus on the estimation of recall, as its naive estimation can incur extremely high annotation costs and disproportionately interfere with the platform's right to conduct business. Through a simulation study, we show that recall can be efficiently estimated using stratified sampling with trained classifiers, and provide concrete recommendations for its application. Finally, we present a case study of recall reporting for a subset of Reddit under the Act. Based on the language in the Act, we identify a number of ways recall could be reported due to underspecification. We report on one possibility using our improved estimator, and discuss the implications and areas for further legal clarification.

Read more

6/4/2024

🤔

Total Score

0

Law and the Emerging Political Economy of Algorithmic Audits

Petros Terzis, Michael Veale, Noelle Gaumann

For almost a decade now, scholarship in and beyond the ACM FAccT community has been focusing on novel and innovative ways and methodologies to audit the functioning of algorithmic systems. Over the years, this research idea and technical project has matured enough to become a regulatory mandate. Today, the Digital Services Act (DSA) and the Online Safety Act (OSA) have established the framework within which technology corporations and (traditional) auditors will develop the `practice' of algorithmic auditing thereby presaging how this `ecosystem' will develop. In this paper, we systematically review the auditing provisions in the DSA and the OSA in light of observations from the emerging industry of algorithmic auditing. Who is likely to occupy this space? What are some political and ethical tensions that are likely to arise? How are the mandates of `independent auditing' or `the evaluation of the societal context of an algorithmic function' likely to play out in practice? By shaping the picture of the emerging political economy of algorithmic auditing, we draw attention to strategies and cultures of traditional auditors that risk eroding important regulatory pillars of the DSA and the OSA. Importantly, we warn that ambitious research ideas and technical projects of/for algorithmic auditing may end up crashed by the standardising grip of traditional auditors and/or diluted within a complex web of (sub-)contractual arrangements, diverse portfolios, and tight timelines.

Read more

6/19/2024