Header

UZH-Logo

Maintenance Infos

On the Relation of Test Smells to Software Code Quality


Spadini, Davide; Palomba, Fabio; Zaidman, Andy; Bruntink, Magiel; Bacchelli, Alberto (2018). On the Relation of Test Smells to Software Code Quality. In: 2018 IEEE International Conference on Software Maintenance and Evolution (ICSME), Madrid, 23 October 2018 - 29 October 2018, 1-12.

Abstract

Test smells are sub-optimal design choices in the implementation of test code. As reported by recent studies, their presence might not only negatively affect the comprehension of test suites but can also lead to test cases being less effective in finding bugs in production code. Although significant steps toward understanding test smells, there is still a notable absence of studies assessing their association with software quality. In this paper, we investigate the relationship between the presence of test smells and the change-and defect-proneness of test code, as well as the defect-proneness of the tested production code. To this aim, we collect data on 221 releases of ten software systems and we analyze more than a million test cases to investigate the association of six test smells and their co-occurrence with software quality. Key results of our study include:(i) tests with smells are more change-and defect-prone, (ii) "Indirect Testing", "Eager Test", and "Assertion Roulette" are the most significant smells for change-proneness and, (iii) production code is more defect-prone when tested by smelly tests.

Abstract

Test smells are sub-optimal design choices in the implementation of test code. As reported by recent studies, their presence might not only negatively affect the comprehension of test suites but can also lead to test cases being less effective in finding bugs in production code. Although significant steps toward understanding test smells, there is still a notable absence of studies assessing their association with software quality. In this paper, we investigate the relationship between the presence of test smells and the change-and defect-proneness of test code, as well as the defect-proneness of the tested production code. To this aim, we collect data on 221 releases of ten software systems and we analyze more than a million test cases to investigate the association of six test smells and their co-occurrence with software quality. Key results of our study include:(i) tests with smells are more change-and defect-prone, (ii) "Indirect Testing", "Eager Test", and "Assertion Roulette" are the most significant smells for change-proneness and, (iii) production code is more defect-prone when tested by smelly tests.

Statistics

Citations

Dimensions.ai Metrics
15 citations in Web of Science®
38 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

3 downloads since deposited on 26 Jan 2021
3 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Scopus Subject Areas:Physical Sciences > Safety, Risk, Reliability and Quality
Physical Sciences > Software
Language:English
Event End Date:29 October 2018
Deposited On:26 Jan 2021 10:49
Last Modified:27 Jan 2021 21:02
Publisher:IEEE
ISBN:978-1-5386-7870-1
OA Status:Green
Publisher DOI:https://doi.org/10.1109/ICSME.2018.00010
Other Identification Number:merlin-id:20235

Download

Green Open Access

Download PDF  'On the Relation of Test Smells to Software Code Quality'.
Preview
Content: Accepted Version
Filetype: PDF
Size: 346kB
View at publisher