Publication:

Understanding flaky tests: the developer’s perspective

Date

Date

Date
2019
Conference or Workshop Item
Published version

Citations

Citation copied

Eck, M., Palomba, F., Castelluccio, M., & Bacchelli, A. (2019). Understanding flaky tests: the developer’s perspective. 830–840. https://doi.org/10.1145/3338906.3338945

Abstract

Abstract

Abstract

Flaky tests are software tests that exhibit a seemingly random outcome (pass or fail) despite exercising unchanged code. In this work, we examine the perceptions of software developers about the nature, relevance, and challenges of flaky tests.

We asked 21 professional developers to classify 200 flaky tests they previously fixed, in terms of the nature and the origin of the flakiness, as well as of the fixing effort. We also examined developers' fixing strategies. Subsequently, we conducted an online survey with 121 developers with a

Additional indexing

Creators (Authors)

  • Eck, Moritz
    affiliation.icon.alt
  • Palomba, Fabio
    affiliation.icon.alt
  • Castelluccio, Marco
    affiliation.icon.alt
  • Bacchelli, Alberto
    affiliation.icon.alt

Event Title

Event Title

Event Title
ESEC/FSE '19: 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Event Location

Event Location

Event Location
Tallinn Estonia

Event Start Date

Event Start Date

Event Start Date
2019-09-26

Event End Date

Event End Date

Event End Date
2019-09-30

Publisher

Publisher

Publisher

Page range/Item number

Page range/Item number

Page range/Item number
830

Page end

Page end

Page end
840

Item Type

Item Type

Item Type
Conference or Workshop Item

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Scope

Scope

Scope
Discipline-based scholarship (basic research)

Language

Language

Language
English

Date available

Date available

Date available
2021-01-26

ISBN or e-ISBN

ISBN or e-ISBN

ISBN or e-ISBN
9781450355728

OA Status

OA Status

OA Status
Green

Other Identification Number

Other Identification Number

Other Identification Number
merlin-id:20225

Citations

Citation copied

Eck, M., Palomba, F., Castelluccio, M., & Bacchelli, A. (2019). Understanding flaky tests: the developer’s perspective. 830–840. https://doi.org/10.1145/3338906.3338945

Green Open Access
Loading...
Thumbnail Image

Files

Files

Files
Files available to download:1

Files

Files

Files
Files available to download:1
Loading...
Thumbnail Image