Past, Present, and Future of Citation Practices in HCI

Read original: arXiv:2405.16526 - Published 9/11/2024 by Jonas Oppenlaender
Total Score

0

Past, Present, and Future of Citation Practices in HCI

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper examines the past, present, and future of citation practices in the field of Human-Computer Interaction (HCI).
  • It explores how citation patterns have evolved over time and how they can shape the perceived impact and dissemination of research in the HCI community.
  • The paper also discusses the challenges and potential solutions for improving citation practices to better reflect the true influence of HCI research.

Plain English Explanation

The paper delves into how researchers in the field of Human-Computer Interaction (HCI) cite and reference each other's work. Citations are an important part of academic research, as they help build upon previous findings and give credit to the original contributors. However, the authors of this paper argue that the way citations are currently used in HCI may not accurately reflect the true impact and influence of certain studies.

For example, some research papers may have a relatively low number of direct citations, but their ideas and findings may have been widely adopted and incorporated into other work without being properly acknowledged. Conversely, some papers may receive a high number of citations, but those citations may not necessarily indicate the significance or usefulness of the research. The authors suggest that a more nuanced understanding of citation patterns is needed to better understand the intellectual landscape of HCI.

The paper explores how citation practices have changed over time, from the early days of HCI to the present day, and how factors like publication venue, research methods, and disciplinary norms can influence how researchers cite each other's work. The authors also discuss potential solutions, such as the use of alternative metrics or citation-based tools, to provide a more comprehensive and accurate assessment of the impact of HCI research.

By understanding the complexities of citation practices, the authors hope to help HCI researchers and the broader academic community to better recognize and appreciate the true contributions and influence of their field.

Technical Explanation

The paper begins by providing an overview of the historical development of citation practices in HCI. The authors note that as the field of HCI has evolved, the way researchers cite and reference each other's work has also changed. They highlight how factors like the increasing emphasis on empirical research methods (as discussed in this related paper) and the emergence of new publication venues have influenced citation patterns.

The paper then delves into a more detailed analysis of citation practices in HCI, drawing on previous research on the relationship between citations and true impact and the challenges of evaluating the reproducibility and reliability of research findings. The authors argue that the current citation-based metrics used to assess the impact of HCI research may not fully capture the nuances of how ideas and findings are disseminated and applied within the field.

To address these issues, the paper explores potential solutions, such as the use of alternative metrics or citation-based tools that could provide a more comprehensive and accurate assessment of the influence of HCI research. The authors also discuss the role of institutional and disciplinary factors in shaping citation practices and suggest ways to foster a more inclusive and transparent citation culture within the HCI community.

Critical Analysis

The paper raises valid concerns about the limitations of current citation-based metrics in accurately reflecting the true impact and influence of HCI research. The authors make a compelling case that the way researchers cite each other's work can be influenced by factors beyond the inherent significance or quality of the research, such as publication venue, disciplinary norms, and the complexities of how ideas are disseminated and adopted within the field.

One potential limitation of the paper is that it does not provide a comprehensive solution or a detailed roadmap for implementing the proposed alternatives. While the authors discuss the use of alternative metrics and citation-based tools, they do not delve into the specific challenges or trade-offs associated with these approaches. Further research and discussion within the HCI community would be needed to develop and evaluate these potential solutions.

Additionally, the paper could have explored the role of open science practices, such as pre-registration, data sharing, and transparent reporting, in enhancing the credibility and transparency of HCI research, and how these practices could be better integrated with citation practices.

Overall, the paper makes a valuable contribution to the ongoing conversation about the limitations of citation-based metrics and the need for a more nuanced understanding of the dissemination and impact of HCI research. The insights and suggestions presented in this work could serve as a foundation for further discussions and initiatives within the HCI community to improve citation practices and better recognize the true influence of the field.

Conclusion

This paper provides a comprehensive examination of the past, present, and future of citation practices in the field of Human-Computer Interaction (HCI). The authors argue that the current citation-based metrics used to assess the impact of HCI research may not accurately reflect the true influence and dissemination of ideas within the field.

The paper explores how citation patterns have evolved over time, highlighting the role of factors like publication venue, research methods, and disciplinary norms in shaping how researchers cite each other's work. The authors suggest that a more nuanced understanding of citation practices is needed to better recognize the intellectual contributions and real-world impact of HCI research.

To address these challenges, the paper discusses potential solutions, such as the use of alternative metrics and citation-based tools, that could provide a more comprehensive assessment of research influence. The authors also emphasize the importance of fostering a more inclusive and transparent citation culture within the HCI community.

By drawing attention to the complexities of citation practices, this paper lays the groundwork for further discussions and initiatives aimed at improving the way HCI researchers recognize and appreciate each other's work. Ultimately, the insights and recommendations presented in this study could have significant implications for the future of citation practices and the overall advancement of the field of Human-Computer Interaction.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Past, Present, and Future of Citation Practices in HCI
Total Score

0

Past, Present, and Future of Citation Practices in HCI

Jonas Oppenlaender

Science is a complex system comprised of many scientists who individually make collective decisions that, due to the size and nature of the academic system, largely do not affect the system as a whole. However, certain decisions at the meso-level of research communities, such as the Human-Computer Interaction (HCI) community, may result in deep and long-lasting behavioral changes in scientists. In this article, we provide evidence on how a change in editorial policies introduced at the ACM CHI Conference in 2016 launched the CHI community on an expansive path, denoted by a year-by-year increase in the mean number of references included in CHI articles. If this near-linear trend continues undisrupted, an article in CHI 2030 will include on average almost 130 references. The trend towards more citations reflects a citation culture where quantity is prioritized over quality, contributing to both author and peer reviewer fatigue. This article underscores the profound impact that meso-level policy adjustments have on the evolution of scientific fields and disciplines, urging stakeholders to carefully consider the broader implications of such changes.

Read more

9/11/2024

🏷️

Total Score

0

Why do you cite? An investigation on citation intents and decision-making classification processes

Lorenzo Paolini (Department of Classical Philology,Italian Studies, University of Bologna, Bologna, Italy), Sahar Vahdati (Nature-inspired machine intelligence group, SCaDS.AI center, Technical University of Dresden, Germany Institute for Applied Computer Science, InfAI - Dresden, Germany), Angelo Di Iorio (Department of Computer Science,Engineering, University of Bologna, Bologna, Italy), Robert Wardenga (Institute for Applied Computer Science, InfAI - Dresden, Germany), Ivan Heibi (Research Centre for Open Scholarly Metadata, Department of Classical Philology,Italian Studies, University of Bologna, Bologna, Italy, Digital Humanities Advanced Research Centre), Silvio Peroni (Research Centre for Open Scholarly Metadata, Department of Classical Philology,Italian Studies, University of Bologna, Bologna, Italy, Digital Humanities Advanced Research Centre)

Identifying the reason for which an author cites another work is essential to understand the nature of scientific contributions and to assess their impact. Citations are one of the pillars of scholarly communication and most metrics employed to analyze these conceptual links are based on quantitative observations. Behind the act of referencing another scholarly work there is a whole world of meanings that needs to be proficiently and effectively revealed. This study emphasizes the importance of trustfully classifying citation intents to provide more comprehensive and insightful analyses in research assessment. We address this task by presenting a study utilizing advanced Ensemble Strategies for Citation Intent Classification (CIC) incorporating Language Models (LMs) and employing Explainable AI (XAI) techniques to enhance the interpretability and trustworthiness of models' predictions. Our approach involves two ensemble classifiers that utilize fine-tuned SciBERT and XLNet LMs as baselines. We further demonstrate the critical role of section titles as a feature in improving models' performances. The study also introduces a web application developed with Flask and currently available at http://137.204.64.4:81/cic/classifier, aimed at classifying citation intents. One of our models sets as a new state-of-the-art (SOTA) with an 89.46% Macro-F1 score on the SciCite benchmark. The integration of XAI techniques provides insights into the decision-making processes, highlighting the contributions of individual words for level-0 classifications, and of individual models for the metaclassification. The findings suggest that the inclusion of section titles significantly enhances classification performances in the CIC task. Our contributions provide useful insights for developing more robust datasets and methodologies, thus fostering a deeper understanding of scholarly communication.

Read more

7/19/2024

🔍

Total Score

0

Hidden Citations Obscure True Impact in Science

Xiangyi Meng, Onur Varol, Albert-L'aszl'o Barab'asi

References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by incorporation. This leads to the concept of hidden citation, representing a clear textual credit to a discovery without a reference to the publication embodying it. Here, we rely on unsupervised interpretable machine learning applied to the full text of each paper to systematically identify hidden citations. We find that for influential discoveries hidden citations outnumber citation counts, emerging regardless of publishing venue and discipline. We show that the prevalence of hidden citations is not driven by citation counts, but rather by the degree of the discourse on the topic within the text of the manuscripts, indicating that the more discussed is a discovery, the less visible it is to standard bibliometric analysis. Hidden citations indicate that bibliometric measures offer a limited perspective on quantifying the true impact of a discovery, raising the need to extract knowledge from the full text of the scientific corpus.

Read more

5/14/2024

Empirical research methods for human-computer interaction
Total Score

0

Empirical research methods for human-computer interaction

I. Scott MacKenzie, Janet C. Read, Matthew Horton

Most attendees at CHI conferences will agree that an experiment (user study) is the hallmark of good research in human-computer interaction. But what constitutes an experiment? And how does one go from an experiment to a CHI paper? This course will teach how to pose testable research questions, how to make and measure observations, and how to design and conduct an experiment. Specifically, attendees will participate in a real experiment to gain experience as both an investigator and as a participant. The second session covers the statistical tools typically used to analyze data. Most notably, attendees will learn how to organize experiment results and write a CHI paper.

Read more

4/23/2024