Header

UZH-Logo

Maintenance Infos

Towards Collaborative Data Analysis with Diverse Crowds – a Design Science Approach


Feldman, Michael; Anastasiu, Cristian; Bernstein, Abraham (2018). Towards Collaborative Data Analysis with Diverse Crowds – a Design Science Approach. In: 13th International Conference on Design Science Research in Information Systems and Technology, Madras, 3 June 2018 - 6 June 2018.

Abstract

The last years have witnessed an increasing shortage of data experts capable of analyzing the omnipresent data and producing meaningful insights. Furthermore, some data scientists mention data preprocessing to take up to 80% of the whole project time. This paper proposes a method for collaborative data analysis that involves a crowd without data analysis expertise. Orchestrated by an expert, the team of novices conducts data analysis through iterative refinement of results up to its successful completion. To evaluate the proposed method, we implemented a tool that supports collaborative data analysis for teams with mixed level of expertise. Our evaluation demonstrates that with proper guidance data analysis tasks, especially preprocessing, can be distributed and successfully accomplished by non-experts. Using the design science approach, iterative development also revealed some important features for the collaboration tool, such as support for dynamic development, code deliberation, and project journal. As such we pave the way for building tools that can leverage the crowd to address the shortage of data analysts.

Abstract

The last years have witnessed an increasing shortage of data experts capable of analyzing the omnipresent data and producing meaningful insights. Furthermore, some data scientists mention data preprocessing to take up to 80% of the whole project time. This paper proposes a method for collaborative data analysis that involves a crowd without data analysis expertise. Orchestrated by an expert, the team of novices conducts data analysis through iterative refinement of results up to its successful completion. To evaluate the proposed method, we implemented a tool that supports collaborative data analysis for teams with mixed level of expertise. Our evaluation demonstrates that with proper guidance data analysis tasks, especially preprocessing, can be distributed and successfully accomplished by non-experts. Using the design science approach, iterative development also revealed some important features for the collaboration tool, such as support for dynamic development, code deliberation, and project journal. As such we pave the way for building tools that can leverage the crowd to address the shortage of data analysts.

Statistics

Downloads

12 downloads since deposited on 15 Feb 2019
12 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Language:German
Event End Date:6 June 2018
Deposited On:15 Feb 2019 14:36
Last Modified:15 Feb 2019 14:47
Publisher:s.n.
OA Status:Green
Other Identification Number:merlin-id:16305

Download

Download PDF  'Towards Collaborative Data Analysis with Diverse Crowds – a Design Science Approach'.
Preview
Content: Accepted Version
Filetype: PDF
Size: 781kB