UZH-Logo

Maintenance Infos

Internal consistency reliability is a poor predictor of responsiveness


Puhan, M A; Bryant, D; Guyatt, G H; Heels-Ansdell, D; Schünemann, H J (2005). Internal consistency reliability is a poor predictor of responsiveness. Health and Quality of Life Outcomes, 3:33.

Abstract

BACKGROUND: Whether responsiveness represents a measurement property of health-related quality of life (HRQL) instruments that is distinct from reliability and validity is an issue of debate. We addressed the claims of a recent study, which suggested that investigators could rely on internal consistency to reflect instrument responsiveness. METHODS: 516 patients with chronic obstructive pulmonary disease or knee injury participating in four longitudinal studies completed generic and disease-specific HRQL questionnaires before and after an intervention that impacted on HRQL. We used Pearson correlation coefficients and linear regression to assess the relationship between internal consistency reliability (expressed as Cronbach's alpha), instrument type (generic and disease-specific) and responsiveness (expressed as the standardised response mean, SRM). RESULTS: Mean Cronbach's alpha was 0.83 (SD 0.08) and mean SRM was 0.59 (SD 0.33). The correlation between Cronbach's alpha and SRMs was 0.10 (95% CI -0.12 to 0.32) across all studies. Cronbach's alpha alone did not explain variability in SRMs (p = 0.59, r2 = 0.01) whereas the type of instrument was a strong predictor of the SRM (p = 0.012, r2 = 0.37). In multivariable models applied to individual studies Cronbach's alpha consistently failed to predict SRMs (regression coefficients between -0.45 and 1.58, p-values between 0.15 and 0.98) whereas the type of instrument did predict SRMs (regression coefficients between -0.25 to -0.59, p-values between <0.01 and 0.05). CONCLUSION: Investigators must look to data other than internal consistency reliability to select a responsive instrument for use as an outcome in clinical trials.

BACKGROUND: Whether responsiveness represents a measurement property of health-related quality of life (HRQL) instruments that is distinct from reliability and validity is an issue of debate. We addressed the claims of a recent study, which suggested that investigators could rely on internal consistency to reflect instrument responsiveness. METHODS: 516 patients with chronic obstructive pulmonary disease or knee injury participating in four longitudinal studies completed generic and disease-specific HRQL questionnaires before and after an intervention that impacted on HRQL. We used Pearson correlation coefficients and linear regression to assess the relationship between internal consistency reliability (expressed as Cronbach's alpha), instrument type (generic and disease-specific) and responsiveness (expressed as the standardised response mean, SRM). RESULTS: Mean Cronbach's alpha was 0.83 (SD 0.08) and mean SRM was 0.59 (SD 0.33). The correlation between Cronbach's alpha and SRMs was 0.10 (95% CI -0.12 to 0.32) across all studies. Cronbach's alpha alone did not explain variability in SRMs (p = 0.59, r2 = 0.01) whereas the type of instrument was a strong predictor of the SRM (p = 0.012, r2 = 0.37). In multivariable models applied to individual studies Cronbach's alpha consistently failed to predict SRMs (regression coefficients between -0.45 and 1.58, p-values between 0.15 and 0.98) whereas the type of instrument did predict SRMs (regression coefficients between -0.25 to -0.59, p-values between <0.01 and 0.05). CONCLUSION: Investigators must look to data other than internal consistency reliability to select a responsive instrument for use as an outcome in clinical trials.

Citations

Altmetrics

Downloads

71 downloads since deposited on 11 Feb 2008
0 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:04 Faculty of Medicine > University Hospital Zurich > Clinic and Policlinic for Internal Medicine
Dewey Decimal Classification:610 Medicine & health
Language:English
Date:2005
Deposited On:11 Feb 2008 12:12
Last Modified:05 Apr 2016 12:12
Publisher:BioMed Central
ISSN:1477-7525
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:10.1186/1477-7525-3-33
Official URL:http://www.hqlo.com/content/pdf/1477-7525-3-33.pdf
PubMed ID:15877824
Permanent URL: http://doi.org/10.5167/uzh-79

Download

[img]
Preview
Content: Published Version
Filetype: PDF
Size: 327kB
View at publisher

TrendTerms

TrendTerms displays relevant terms of the abstract of this publication and related documents on a map. The terms and their relations were extracted from ZORA using word statistics. Their timelines are taken from ZORA as well. The bubble size of a term is proportional to the number of documents where the term occurs. Red, orange, yellow and green colors are used for terms that occur in the current document; red indicates high interlinkedness of a term with other terms, orange, yellow and green decreasing interlinkedness. Blue is used for terms that have a relation with the terms in this document, but occur in other documents.
You can navigate and zoom the map. Mouse-hovering a term displays its timeline, clicking it yields the associated documents.

Author Collaborations