Systematic reviews that attempt to assess the risk of harms (adverse effects) associated with specific therapies should consider a broad range of study designs, including both systematic reviews and observational studies. These are the findings of a new study, led by Su Golder of the Centre for Reviews and Dissemination, University of York, UK published in this week's PLoS Medicine.
There is increasing focus on the importance of using rigorous methods to assess the effectiveness and harms associated with the use of new drugs and other therapies, and recognition of the role of systematic reviews in this process. A systematic review uses predefined, explicit methods to find and appraise all relevant evidence to answer a specific question in healthcare. However, there has been considerable debate as to whether systematic reviews should use evidence from randomized controlled trials or observational studies (or both) in order to collect all the relevant evidence on risk of harms. Some groups have argued that observational studies may produce biased estimates of harm, while randomized trials may be too small to generate useful data on the risk of rare adverse effects.
In the study, Golder and colleagues identified systematic reviews that had compared the risk of specific harms in evidence from randomized controlled trials versus the evidence from observational studies. They found that there was no difference on average in the estimates produced by these two approaches. The authors conclude: "Instead of restricting the analysis to certain study designs, it may be preferable for systematic reviewers of adverse effects to evaluate a broad range of studies that can help build a complete picture of any potential harm and improve the generalisability of the review without loss of validity."
Funding: This research was undertaken by Su Golder as part of an MRC fellowship. The views expressed in this presentation are those of the authors and not necessarily those of the MRC. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing Interests: The Academic Editor, Jan P. Vandenbroucke, has disclosed that he has worked with authors SG and YKL on another project unrelated to the study reported in this paper. He also discloses an intellectual competing interest in that he has previously published the theoretical viewpoint that estimates of harms outcomes in observational studies may be as valid as results of randomized trials, and may be more generalizable. The authors have no competing interests to declare.
Citation: Golder S, Loke YK, Bland M (2011) Meta-analyses of Adverse Effects Data Derived from Randomised Controlled Trials as Compared to Observational Studies: Methodological Overview. PLoS Med 8(5): e1001026. doi:10.1371/journal.pmed.1001026
IN YOUR COVERAGE PLEASE USE THIS URL TO PROVIDE ACCESS TO THE FREELY AVAILABLE PAPER: http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal.pmed.1001026
CONTACT:
Su Golder
MRC Fellow in Health Services Research
CRD
University of York
York
YO10 5DD
+44 1904 321040
su.golder@york.ac.uk
Journal
PLoS Medicine