Header

UZH-Logo

Maintenance Infos

Rating of included trials on the Efficacy–Effectiveness Spectrum: development of a new tool for systematic reviews


Wieland, L Susan; Berman, Brian M; Altman, Douglas G; Barth, Jürgen; Bouter, Lex M; D'Adamo, Christopher R; Linde, Klaus; Moher, David; Mullins, C Daniel; Treweek, Shaun; Tunis, Sean; van der Windt, Danielle A; Zwarenstein, Merrick; Witt, Claudia (2017). Rating of included trials on the Efficacy–Effectiveness Spectrum: development of a new tool for systematic reviews. Journal of Clinical Epidemiology, 84:95-104.

Abstract

BACKGROUND AND OBJECTIVE: Randomized trials may be designed to provide evidence more strongly related to efficacy or effectiveness of an intervention. When systematic reviews are used to inform clinical or policy decisions, it is important to know the efficacy-effectiveness nature of the included trials. The objective of this study was to develop a tool to characterize randomized trials included in a systematic review on an efficacy-effectiveness continuum.
METHODS: We extracted rating domains and descriptors from existing tools and used a modified Delphi procedure to condense the domains and develop a new tool. The feasibility and interrater reliability of the tool was tested on trials from four systematic reviews.
RESULTS: The Rating of Included Trials on the Efficacy-Effectiveness Spectrum (RITES) tool rates clinical trials on a five-point Likert scale in four domains: (1) participant characteristics, (2) trial setting, (3) flexibility of interventions, and (4) clinical relevance of interventions. When RITES was piloted on trials from three reviews by unaffiliated raters, ratings were variable (intraclass correlation coefficient [ICC] 0.25-0.66 for the four domains); but, when RITES was used on one review by the review authors with expertise on the topic, the ratings were consistent (ICCs > 0.80.
CONCLUSION: RITES may help to characterize the efficacy-effectiveness nature of trials included in systematic reviews.

Abstract

BACKGROUND AND OBJECTIVE: Randomized trials may be designed to provide evidence more strongly related to efficacy or effectiveness of an intervention. When systematic reviews are used to inform clinical or policy decisions, it is important to know the efficacy-effectiveness nature of the included trials. The objective of this study was to develop a tool to characterize randomized trials included in a systematic review on an efficacy-effectiveness continuum.
METHODS: We extracted rating domains and descriptors from existing tools and used a modified Delphi procedure to condense the domains and develop a new tool. The feasibility and interrater reliability of the tool was tested on trials from four systematic reviews.
RESULTS: The Rating of Included Trials on the Efficacy-Effectiveness Spectrum (RITES) tool rates clinical trials on a five-point Likert scale in four domains: (1) participant characteristics, (2) trial setting, (3) flexibility of interventions, and (4) clinical relevance of interventions. When RITES was piloted on trials from three reviews by unaffiliated raters, ratings were variable (intraclass correlation coefficient [ICC] 0.25-0.66 for the four domains); but, when RITES was used on one review by the review authors with expertise on the topic, the ratings were consistent (ICCs > 0.80.
CONCLUSION: RITES may help to characterize the efficacy-effectiveness nature of trials included in systematic reviews.

Statistics

Altmetrics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:04 Faculty of Medicine > University Hospital Zurich > Institute of Complementary Medicine
Dewey Decimal Classification:610 Medicine & health
Language:English
Date:2017
Deposited On:23 Jun 2017 08:29
Last Modified:23 Jun 2017 08:35
Publisher:Elsevier
ISSN:0895-4356
Publisher DOI:https://doi.org/10.1016/j.jclinepi.2017.01.010
PubMed ID:28188898

Download

Full text not available from this repository.
View at publisher