Quick Search:

uzh logo
Browse by:
bullet
bullet
bullet
bullet

Zurich Open Repository and Archive 

Permanent URL to this publication: http://dx.doi.org/10.5167/uzh-44841

Bachmann, A; Bird, C; Rahman, F; Devanbu, P; Bernstein, A (2010). The Missing Links: Bugs and Bug-fix Commits. In: ACM SIGSOFT / FSE '10: eighteenth International Symposium on the Foundations of Software Engineering, CHECK Santa Fe, USA, 2010 - 2010, 97-106.

[img]
Preview
PDF
730kB

Abstract

Empirical studies of software defects rely on links between bug databases and program code repositories. This linkage is typically based on bug-fixes identified in developer-entered commit logs. Unfortunately, developers do not always report which commits perform bug-fixes. Prior work suggests that such links can be a biased sample of the entire population of fixed bugs. The validity of statistical hypotheses-testing based on linked data could well be affected by bias. Given the wide use of linked defect data, it is vital to gauge the nature and extent of the bias, and try to develop testable theories and models of the bias. To do this, we must establish ground truth: manually analyze a complete version history corpus, and nail down those commits that fix defects, and those that do not. This is a diffcult task, requiring an expert to compare versions, analyze changes, find related bugs in the bug database, reverse-engineer missing links, and finally record their work for use later. This effort must be repeated for hundreds of commits to obtain a useful sample of reported and unreported bug-fix commits. We make several contributions. First, we present Linkster, a tool to facilitate link reverse-engineering. Second, we evaluate this tool, engaging a core developer of the Apache HTTP web server project to exhaustively annotate 493 commits that occurred during a six week period. Finally, we analyze this comprehensive data set, showing that there are serious and consequential problems in the data.

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
DDC:000 Computer science, knowledge & systems
Event End Date:2010
Deposited On:10 Feb 2011 09:19
Last Modified:19 Oct 2012 06:37
Free access at:Official URL. An embargo period may apply.
Official URL:http://macbeth.cs.ucdavis.edu/fse2010-devanbu.pdf
Other Identification Number:1415
Citations:Google Scholar™
Scopus®. Citation Count: 18

Users (please log in): suggest update or correction for this item

Repository Staff Only: item control page