Navigation auf zora.uzh.ch

Search ZORA

ZORA (Zurich Open Repository and Archive)

On the Helpfulness of Answering Developer Questions on Discord with Similar Conversations and Posts from the Past

Lill, Alexander; Meyer, André N.; Fritz, Thomas (2024). On the Helpfulness of Answering Developer Questions on Discord with Similar Conversations and Posts from the Past. In: 46th International Conference on Software Engineering (ICSE 2024), Lisbon, Portugal, 14 April 2024 - 20 April 2024. ACM Digital library, Epub ahead of print.

Abstract

A big part of software developers’ time is spent finding answers to their coding-task-related questions. To answer their questions, developers usually perform web searches, ask questions on Q&A websites, or, more recently, in chat communities. Yet, many of these questions have frequently already been answered in previous chat conversations or other online communities. Automatically identifying and then suggesting these previous answers to the askers could, thus, save time and effort. In an empirical analysis, we first explored the frequency of repeating questions on the Discord chat platform and assessed our approach to identify them automatically. The approach was then evaluated with real-world developers in a field experiment, through which we received 142 ratings on the helpfulness of the suggestions we provided to help answer 277 questions that developers posted in four Discord communities. We further collected qualitative feedback through 53 surveys and 10 follow-up interviews. We found that the suggestions were considered helpful in 40% of the cases, that suggesting Stack Overflow posts is more often considered helpful than past Discord conversations, and that developers have difficulties describing their problems as search queries and, thus, prefer describing them as natural language questions in online communities.

Additional indexing

Item Type:Conference or Workshop Item (Paper), not_refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Uncontrolled Keywords:Developer Questions, Chat Community, Semantic Similarity
Scope:Discipline-based scholarship (basic research)
Language:English
Event End Date:20 April 2024
Deposited On:20 Sep 2023 14:24
Last Modified:08 Mar 2024 09:40
Publisher:ACM Digital library
OA Status:Green
Publisher DOI:https://doi.org/10.1145/3597503.3623341
Other Identification Number:merlin-id:24070
Download PDF  'On the Helpfulness of Answering Developer Questions on Discord with Similar Conversations and Posts from the Past'.
Preview
  • Content: Published Version
  • Language: English
  • Licence: Creative Commons: Attribution 4.0 International (CC BY 4.0)

Metadata Export

Statistics

Citations

Dimensions.ai Metrics

Altmetrics

Downloads

296 downloads since deposited on 20 Sep 2023
238 downloads since 12 months
Detailed statistics

Authors, Affiliations, Collaborations

Similar Publications