Factors Associated with Findings of Published Trials of Drug–Drug Comparisons: Why Some Statins Appear More Efficacious than Others
Open Access
- 5 June 2007
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLoS Medicine
- Vol. 4 (6) , e184
- https://doi.org/10.1371/journal.pmed.0040184
Abstract
Published pharmaceutical industry–sponsored trials are more likely than non-industry-sponsored trials to report results and conclusions that favor drug over placebo. Little is known about potential biases in drug–drug comparisons. This study examined associations between research funding source, study design characteristics aimed at reducing bias, and other factors that potentially influence results and conclusions in randomized controlled trials (RCTs) of statin–drug comparisons. This is a cross-sectional study of 192 published RCTs comparing a statin drug to another statin drug or non-statin drug. Data on concealment of allocation, selection bias, blinding, sample size, disclosed funding source, financial ties of authors, results for primary outcomes, and author conclusions were extracted by two coders (weighted kappa 0.80 to 0.97). Univariate and multivariate logistic regression identified associations between independent variables and favorable results and conclusions. Of the RCTs, 50% (95/192) were funded by industry, and 37% (70/192) did not disclose any funding source. Looking at the totality of available evidence, we found that almost all studies (98%, 189/192) used only surrogate outcome measures. Moreover, study design weaknesses common to published statin–drug comparisons included inadequate blinding, lack of concealment of allocation, poor follow-up, and lack of intention-to-treat analyses. In multivariate analysis of the full sample, trials with adequate blinding were less likely to report results favoring the test drug, and sample size was associated with favorable conclusions when controlling for other factors. In multivariate analysis of industry-funded RCTs, funding from the test drug company was associated with results (odds ratio = 20.16 [95% confidence interval 4.37–92.98], p < 0.001) and conclusions (odds ratio = 34.55 [95% confidence interval 7.09–168.4], p < 0.001) that favor the test drug when controlling for other factors. Studies with adequate blinding were less likely to report statistically significant results favoring the test drug. RCTs of head-to-head comparisons of statins with other drugs are more likely to report results and conclusions favoring the sponsor's product compared to the comparator drug. This bias in drug–drug comparison trials should be considered when making decisions regarding drug choice.Keywords
This publication has 53 references indexed in Scilit:
- Why Olanzapine Beats Risperidone, Risperidone Beats Quetiapine, and Quetiapine Beats Olanzapine: An Exploratory Analysis of Head-to-Head Comparison Studies of Second-Generation AntipsychoticsAmerican Journal of Psychiatry, 2006
- Why Most Published Research Findings Are FalsePLoS Medicine, 2005
- Medical Journals Are an Extension of the Marketing Arm of Pharmaceutical CompaniesPLoS Medicine, 2005
- Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authorsBMJ, 2005
- Empirical Evidence for Selective Reporting of Outcomes in Randomized TrialsJAMA, 2004
- Randomised trials comparing chemotherapy regimens for advanced non-small cell lung cancer: biases and evolution over timeEuropean Journal Of Cancer, 2003
- Quantifying effect of statins on low density lipoprotein cholesterol, ischaemic heart disease, and stroke: systematic review and meta-analysisBMJ, 2003
- Reports of Randomized Trials in Acute Stroke, 1955 to 1995Stroke, 1999
- Influences on the Quality of Published Drug StudiesInternational Journal of Technology Assessment in Health Care, 1996
- Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trialsJAMA, 1995