Statin trials: exaggerating benefits and ignoring the harm

by Dr John Briffa

The ‘Cochrane Collaboration’ is an international collective of researchers whose self-proclaimed role is to provide accurate and robust appraisals of health interventions. The group specialises in ‘meta-analyses’: the grouping together of several similar studies on interventions including drug therapies.

In 2011 Cochrane researchers assessed the evidence relating to statin use in individuals at low risk of cardiovascular disease (defined as less than a 20 per cent risk over 10 years), and concluded that there was limited evidence of overall benefit.[1] I appeared on Channel 4 news to discuss this publication and the issues surrounding it, and you can see the discussion here.

But then earlier this year, the same Cochrane group produced a new report that came to the opposite conclusion. That the overall risk of death and cardiovascular events (e.g. heart attack or stroke) were reduced by statins in low risk individuals, without increasing the risk of adverse events such as muscle, liver and kidney damage. [2] Quite a change of heart. Then last week a paper published in the British Medical Journal raised serious questions about the evidence on which this U-turn appears to have been made. [3]

The authors of the BMJ piece note that although the latest Cochrane meta-analysis included four additional trials, these trials did not substantially change the findings. The change in advice was actually based on another meta-analysis, published in 2012, conducted by a group known as the Cholesterol Treatment Trialists’ (CTT) collaboration. [4]

Advice based on theoretical reduction

Among other things, the CTT authors concluded that, in low risk individuals, for each 1.0 mmol/l reduction in LDL-cholesterol, statins reduce overall risk of death and heart attack by about 9 per cent and 20 per cent respectively. The conclusion was that statins have significant benefits in low risk individuals that greatly exceeded known risks of treatment.

However, the CTT authors took the odd step of calculating the benefits of statins according to a theoretical reduction in LDL-cholesterol levels. A much more realistic appraisal would be simply to calculate if, compared to placebo, statins actually reduce the risk of health outcomes.

The BMJ authors use the data from the CTT meta-analysis and found that risk of death was not reduced at all. So, the CTT authors had extrapolated the data in a way that showed a benefit that actually does not exist in the published research.

And what of the claim that statins reduce the risk of cardiovascular events such as heart attack or stroke? The data shows that about 150 low-risk individuals would need to be treated for five years to prevent one such event (i.e. only about one in 750 individuals will benefit per year).

Advice ignores side effects

The BMJ authors also draw our attention to the impact of statin treatment on ‘serious adverse events’. Statin therapy may result in an improvement (by, for instance, reducing the risk of heart attack) but may also worsen it (by, say, increasing the risk of serious side effects). Only by quantifying the potential harms of statins is it possible to make an informed assessment of their overall effect. But here the CTT review failed completely. It didn’t consider serious adverse effects at all. Interestingly, of three major trials that were included in the CTT review that assessed overall serious adverse effects, none found overall benefits from statin treatment.

So, while the CTT authors seem to have over-hyped the benefits of statins, they seem at the same time to have been quite keen to steer clear of talk of their very real risks and the absence of evidence for overall benefit.

The BMJ authors draw our attention to the fact that every single trial included in the CTT was industry funded. Such trials are well known to report results more favourably and perhaps downplay risks than independently funded research. The BMJ authors cite specific ways in which the adverse effects of drugs seen in clinical trials can be ‘minimised’. These include:

  • The exclusion from trials of individuals with known health issues likely to be exacerbated by statins or signal susceptibility to statin side effects (such as liver, kidney and muscle disease).
  • The use of a ‘run-in’ period before the study starts which detects and then excludes individuals who do not tolerate statins.
  • The possibility that individuals ‘drop out’ from the study because of side effects, meaning that the incidence of some side effects can be ‘lost’ from the data.
  • Failure of the study investigators to assess and monitor adverse events such as muscle damage and changes in brain function.
  • Failure to properly ascertain or report adverse events.

Industry claims about few side effects not reliable

It is noted that the Cochrane authors admit the reporting of adverse effects in studies is generally poor but also state that it’s unlikely statins have major life-threatening hazards. The authors of the BMJ piece are not convinced, though, writing: “[The] large discrepancies between the frequency of adverse events reported in commercially funded randomised controlled trials included in the CTT meta-analyses and non-commercially funded studies show that determination of harms cannot be left to industry alone.”

The BMJ piece is accompanied by an editorial from the journal’s editor, Fiona Godlee [5]. Her comment on this issue starts: “None of this does much to bolster confidence in the published literature.” Godlee goes on to write: “Nor am I reassured by discussions at two recent meetings co-hosted by the European Federation of Pharmaceutical Industry Associations (EFPIA). Drug company AbbVie is suing the European Medicines Agency to stop summary reports of its clinical trials becoming publicly available. AbbVie’s lawyer made clear that the company considers even the data on adverse events to be commercially confidential. Despite industry’s claims to be in favour of greater transparency, EFPIA and its American counterpart PhRMA are supporting Abbvie. The BMJ and BMA have joined forces to intervene on behalf of the EMA.”

If I were to summarise, I’d say that, at best, there seems to be a degree of complacency regarding the veracity of statin data on the part of both the CTT and the Cochrane researchers. There is a sense that they are happy to present the ‘positive’ findings in the best possible light and at the same time seem relaxed about the clear gaps we have in our knowledge about potential harms. The fact that statins appear to have no overall benefit in those at low risk of cardiovascular disease should not go unacknowledged, either.

Bad for our collective health

Worse still, we have evidence that drug trials can be designed, conducted and reported in ways that obscure the truth. And sometimes, even when we have data that can help us make informed decisions about the appropriateness of a treatment, some drug companies will fight tooth and nail to prevent that data seeing the light of day.

This sort of subterfuge may be good for sales and share price, but it is almost certainly bad for our collective health. On this point, the BMJ authors state than instead of doctors following guidelines and prescribing statins for individuals at low risk of cardiovascular disease, they should explain the magnitude of benefits and uncertainties regarding harm. In addition, they might also discuss the fact that the vast majority of cardiovascular disease risk is linked with lifestyle factors such as smoking, diet and physical activity. Fiona Godlee backs this approach but states that the benefits of lifestyle change are: “something that the dominance of industry sponsored clinical trials too often obscures.”

Personally, I am delighted that the misdeeds of drug companies and some researchers can now be exposed in this way. In the past, I think there was much more opportunity for the industry and its hired hands to mislead us. Greater transparency means that the industry as a whole is getting more of what I believe it deserves: our contempt.


  1. Taylor F, et al. Statins for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev 2011;1:CD004816.Medline
  2. Taylor F, et al. Statins for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev2013;1:CD004816.
  3. Abramson JD, et al. Should people at low risk of cardiovascular disease take a statin? BMJ 2013;347:f6123
  4. Cholesterol Treatment Trialists’ (CTT) Collaborators. The effects of lowering LDL cholesterol with statin therapy in people at low risk of vascular disease: meta-analysis of individual data from 27 randomised trials. The Lancet 2012;380(9841):581–90.
  5. Godlee F. Statins for all over 50? No BMJ 2013;347:f6412.
Dr John Briffa

Dr John Briffa

Dr John Briffa practices integrated medicine at two London hospitals and has written a number of books on nutrition, self-help health and diet including the best-selling Waist Disposal and Escape the Diet Trap. He also posts a widely read weekly blog that challenges medical orthodoxy on topics such as statins and the low fat diet.

1 Comment

Leave a Reply

WP-Backgrounds by InoPlugs Web Design and Juwelier Schönmann