Using Bibliometrics to Detect Unconventional Authorship Practices and Examine Their Impact on Global Research Metrics, 2019-2023

Read original: arXiv:2407.18331 - Published 7/29/2024 by Lokman I. Meho, Elie A. Akl
Total Score

0

๐Ÿ“Š

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Between 2019 and 2023, 16 universities increased their research output by over 15 times the global average.
  • Significant changes in authorship dynamics were observed, including decreased first authorship, rise in hyperprolific authors, increased multi-affiliations, and increased authors per publication.
  • Bibliometric analysis detected patterns suggesting a reliance on unconventional authorship practices like gift, honorary, and sold authorship to inflate publication metrics.
  • The study highlights the need for reforms across universities, policymakers, funding agencies, ranking bodies, accreditation organizations, publishers, and researchers to maintain academic integrity and ensure reliable global rankings.

Plain English Explanation

The study examined how the publication output and authorship patterns at 16 universities changed dramatically between 2019 and 2023. Instead of a steady, expected increase, these universities saw their research output skyrocket, growing over 15 times faster than the global average.

Digging deeper, the researchers noticed some concerning shifts in how these publications were authored. There was a decline in researchers being listed as the primary or "first" author on papers. There was also a rise in a small number of researchers who were publishing an extremely high volume of papers, known as "hyperprolific authors." Additionally, more researchers were listing multiple institutional affiliations and the average number of authors per publication increased.

By analyzing the citation data and publication trends, the researchers detected signs that these universities may have been relying on questionable authorship practices to boost their publication metrics. This could include things like "gift authorship" where someone is listed as an author without making a significant contribution, "honorary authorship" where a senior researcher is added as an author despite minimal involvement, or even "sold authorship" where authorship is purchased.

The key takeaway is that the dramatic increases in research output at these universities, coupled with the suspicious authorship dynamics, raise serious concerns about the integrity and reliability of global university ranking systems. The study calls for extensive reforms across the academic ecosystem to address these issues and restore trust in the publication process.

Technical Explanation

Using bibliometric methods, this study examined publication patterns at 16 universities that saw their research output increase by over 15 times the global average between 2019 and 2023. The analysis detected significant shifts in authorship dynamics, including:

  • Decreased rates of first authorship
  • Rise of "hyperprolific authors" publishing an exceptionally high volume of papers
  • Increased rates of multi-institutional affiliations among authors
  • Higher average number of authors per publication

These authorship trends, combined with other bibliometric signals, led the researchers to suspect a reliance on unconventional authorship practices to inflate publication metrics. Potential issues like "gift authorship", "honorary authorship", and "sold authorship" were detected.

The study underscores the need for comprehensive reforms by universities, policymakers, funding agencies, ranking bodies, accreditation organizations, scholarly publishers, and researchers themselves. This is necessary to maintain academic integrity and ensure the reliability of global university ranking systems, which are increasingly influential in shaping research priorities and resource allocation.

Critical Analysis

While the paper provides compelling evidence of concerning authorship practices at the universities studied, there are a few important caveats to consider:

  • The analysis was limited to 16 universities, so the findings may not generalize to the broader academic landscape. Further research is needed to understand if these trends are isolated or more widespread.

  • The bibliometric methods used can detect suspicious patterns, but cannot definitively prove the existence of gift, honorary, or sold authorship. More in-depth investigation would be required to verify the underlying causes.

  • The study does not explore potential systemic drivers that may be incentivizing these problematic authorship behaviors, such as increasing pressure to maximize publication metrics for funding, tenure, and ranking purposes. Addressing the root causes will be crucial.

Nevertheless, the study raises critical questions about the integrity of academic publishing and the reliability of university ranking systems. Policymakers, university administrations, and the research community as a whole must work to implement robust safeguards and reforms to restore trust in the scholarly process.

Conclusion

This study uncovered alarming trends in the publication outputs and authorship dynamics at 16 universities, suggesting a potential reliance on questionable practices to artificially inflate research metrics. The findings underscore the urgent need for comprehensive reforms across the academic ecosystem to uphold principles of research integrity and ensure the credibility of global university ranking systems.

By addressing issues like gift, honorary, and sold authorship, universities, policymakers, funding agencies, ranking bodies, accreditation organizations, publishers, and researchers can work to restore trust in the scholarly process and realign incentives with the pursuit of genuine academic excellence. Maintaining the reliability of university rankings is essential, as these metrics increasingly shape institutional priorities, resource allocation, and the overall direction of scientific research.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on ๐• โ†’

Related Papers

๐Ÿ“Š

Total Score

0

Using Bibliometrics to Detect Unconventional Authorship Practices and Examine Their Impact on Global Research Metrics, 2019-2023

Lokman I. Meho, Elie A. Akl

Between 2019 and 2023, sixteen universities increased their research output by over fifteen times the global average, alongside significant changes in authorship dynamics (e.g., decreased first authorship, rise in hyperprolific authors, increased multi-affiliations, and increased authors per publication rate). Using bibliometric methods, this study detected patterns suggesting a reliance on unconventional authorship practices, such as gift, honorary, and sold authorship, to inflate publication metrics. The study underscores the need for reforms by universities, policymakers, funding agencies, ranking agencies, accreditation bodies, scholarly publishers, and researchers to maintain academic integrity and ensure the reliability of global ranking systems.

Read more

7/29/2024

๐Ÿ’ฌ

Total Score

0

Topics, Authors, and Institutions in Large Language Model Research: Trends from 17K arXiv Papers

Rajiv Movva, Sidhika Balachandar, Kenny Peng, Gabriel Agostini, Nikhil Garg, Emma Pierson

Large language models (LLMs) are dramatically influencing AI research, spurring discussions on what has changed so far and how to shape the field's future. To clarify such questions, we analyze a new dataset of 16,979 LLM-related arXiv papers, focusing on recent trends in 2023 vs. 2018-2022. First, we study disciplinary shifts: LLM research increasingly considers societal impacts, evidenced by 20x growth in LLM submissions to the Computers and Society sub-arXiv. An influx of new authors -- half of all first authors in 2023 -- are entering from non-NLP fields of CS, driving disciplinary expansion. Second, we study industry and academic publishing trends. Surprisingly, industry accounts for a smaller publication share in 2023, largely due to reduced output from Google and other Big Tech companies; universities in Asia are publishing more. Third, we study institutional collaboration: while industry-academic collaborations are common, they tend to focus on the same topics that industry focuses on rather than bridging differences. The most prolific institutions are all US- or China-based, but there is very little cross-country collaboration. We discuss implications around (1) how to support the influx of new authors, (2) how industry trends may affect academics, and (3) possible effects of (the lack of) collaboration.

Read more

4/30/2024

๐Ÿงช

Total Score

0

Fusion of the Power from Citations: Enhance your Influence by Integrating Information from References

Cong Qi, Qin Liu, Kan Liu

Influence prediction plays a crucial role in the academic community. The amount of scholars' influence determines whether their work will be accepted by others. Most existing research focuses on predicting one paper's citation count after a period or identifying the most influential papers among the massive candidates, without concentrating on an individual paper's negative or positive impact on its authors. Thus, this study aims to formulate the prediction problem to identify whether one paper can increase scholars' influence or not, which can provide feedback to the authors before they publish their papers. First, we presented the self-adapted ACC (Average Annual Citation Counts) metric to measure authors' impact yearly based on their annual published papers, paper citation counts, and contributions in each paper. Then, we proposed the RD-GAT (Reference-Depth Graph Attention Network) model to integrate heterogeneous graph information from different depth of references by assigning attention coefficients on them. Experiments on AMiner dataset demonstrated that the proposed ACC metrics could represent the authors influence effectively, and the RD-GAT model is more efficiently on the academic citation network, and have stronger robustness against the overfitting problem compared with the baseline models. By applying the framework in this work, scholars can identify whether their papers can improve their influence in the future.

Read more

6/27/2024

๐Ÿ”

Total Score

0

Hidden Citations Obscure True Impact in Science

Xiangyi Meng, Onur Varol, Albert-L'aszl'o Barab'asi

References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by incorporation. This leads to the concept of hidden citation, representing a clear textual credit to a discovery without a reference to the publication embodying it. Here, we rely on unsupervised interpretable machine learning applied to the full text of each paper to systematically identify hidden citations. We find that for influential discoveries hidden citations outnumber citation counts, emerging regardless of publishing venue and discipline. We show that the prevalence of hidden citations is not driven by citation counts, but rather by the degree of the discourse on the topic within the text of the manuscripts, indicating that the more discussed is a discovery, the less visible it is to standard bibliometric analysis. Hidden citations indicate that bibliometric measures offer a limited perspective on quantifying the true impact of a discovery, raising the need to extract knowledge from the full text of the scientific corpus.

Read more

5/14/2024