Header

UZH-Logo

Maintenance Infos

Transparency of CHI Research Artifacts: Results of a Self-Reported Survey


Wacharamanotham, Chatchavan; Eisenring, Lukas; Haroz, Steve; Echtler, Florian (2020). Transparency of CHI Research Artifacts: Results of a Self-Reported Survey. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, Hawai’i, 25 April 2020 - 30 April 2020.

Abstract

Several fields of science are experiencing a ""replication crisis"" that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress.Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018-2019 papers, asking if they share their papers' research materials and data, how they share them, and why they do not. The results (34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices.This paper and all data and materials are freely available at https://osf.io/3bu6t.

Abstract

Several fields of science are experiencing a ""replication crisis"" that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress.Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018-2019 papers, asking if they share their papers' research materials and data, how they share them, and why they do not. The results (34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices.This paper and all data and materials are freely available at https://osf.io/3bu6t.

Statistics

Citations

Dimensions.ai Metrics

Altmetrics

Downloads

15 downloads since deposited on 02 Dec 2020
15 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Scopus Subject Areas:Physical Sciences > Computer Graphics and Computer-Aided Design
Physical Sciences > Human-Computer Interaction
Physical Sciences > Software
Language:English
Event End Date:30 April 2020
Deposited On:02 Dec 2020 09:40
Last Modified:03 Dec 2020 21:01
Publisher:ACM Digital Library
OA Status:Green
Publisher DOI:https://doi.org/10.1145/3313831.3376448
Related URLs:https://osf.io/3bu6t/ (Author)
Other Identification Number:merlin-id:20081

Download

Green Open Access

Download PDF  'Transparency of CHI Research Artifacts: Results of a Self-Reported Survey'.
Preview
Content: Published Version
Filetype: PDF
Size: 2MB
View at publisher