April 16th, 2013
Blood Sample Mismatch Leads ‘Anguished’ Authors to Retract Three Lipitor Papers
Larry Husten, PHD
Three substudies of the influential TNT (Treating to New Targets) trial have been retracted after the sponsor of the trial, Pfizer, discovered that blood samples from the study had been matched to the wrong participants.
The main results of TNT, published in 2005 in the New England Journal of Medicine, had a major impact on clinical practice and statin prescription patterns. The trial supported the increasingly aggressive use of statins and helped to solidify the enormous commercial success of atorvastatin (Lipitor, Pfizer).
The 3 newly retracted substudies do not appear to affect the main finding of TNT. Two papers were published in the Journal of the American College of Cardiology. The third was published in the American Heart Journal. (The AHJ retraction notice has not yet been published, but the editors have confirmed the retraction.) Here are the 3 retracted articles:
Plasma PCSK9 Levels and Clinical Outcomes in the TNT (Treating to New Targets) Trial: A Nested Case-Control Study
Roeland Huijgen, MD; S. Matthijs Boekholdt, MD, PhD; Benoit J. Arsenault, PhD; Weihang Bao, PhD; Jean-Michel Davaine, MD; Fatiha Tabet, PhD; Francine Petrides, BSc; Kerry-Anne Rye, PhD; David A. DeMicco, PharmD; Philip J. Barter, MD, PhD; John J.P. Kastelein, MD, PhD; Gilles Lambert, PhD
J Am Coll Cardiol. 2012;59(20):1778-1784. doi:10.1016/j.jacc.2011.12.043
Prediction of Cardiovascular Events in Statin-Treated Stable Coronary Patients by Lipid and Nonlipid Biomarkers
Benoit J. Arsenault, PhD; Philip Barter, MD, PhD; David A. DeMicco, PharmD; Weihang Bao, PhD; Gregory M. Preston, PhD; John C. LaRosa, MD; Scott M. Grundy, MD, PhD; Prakash Deedwania, MD, PhD; Heiner Greten, MD; Nanette K. Wenger, MD; James Shepherd, MD; David D. Waters, MD; John J.P. Kastelein, MD, PhD
J Am Coll Cardiol. 2011;57(1):63-69. doi:10.1016/j.jacc.2010.06.052
Vitamin D levels do not predict cardiovascular events in statin-treated patients with stable coronary disease
Vera Bittner, MD, MSPH, Nanette K. Wenger, MD, David D. Waters, MD, David A. DeMicco, PharmD, Michael Messig, PhD, John C. LaRosa, MD
American Heart Journal, Volume 164, Issue 3 , Pages 387-393, September 2012
Here is the main text of the retraction:
The main findings of the TNT Trial were published in 2005 (1). Since that time, members of the Steering Committee and other investigators have published 32 papers based upon additional analyses of TNT. The data for these papers were derived from analyses of the TNT clinical database, managed by Pfizer. The clinical database has been crosschecked many times and the data in it is valid. During the trial, blood samples were drawn from the patients at regular intervals for subsequent analysis. We performed a nested case-control study that included 507 patients who experienced a CV event and 1,020 control patients in the main biomarker analysis, and 496 patients who experienced a CV event and 1,117 control patients in the PCSK9 analysis. The biomarker database was separate from the clinical database. An anonymization code was run in 2007 to link patients from one database to the other.
In late 2012, the TNT frozen blood samples were integrated into a large automated biobank that includes samples from other Pfizer trials. At that time discrepancies were noted among the samples, indicating that an error had occurred when the samples were anonymized in 2007. Further investigation revealed that the code created to manually anonymize the data was accidentally run twice. During the first run, anonymized subject identifiers were successfully assigned to both biosamples and clinical data. However, after this first run had passed quality control checks, the anonymization code was re-run inadvertently, replacing the first correct set of identifiers with a random and incorrect set. We do not understand how or why the code was re-run. The study team, who were blinded as to patient identity, thus reported on mismatched clinical and biomarker data. The investigators of the biomarkers study were puzzled that none of the 18 biomarkers were predictive of cardiovascular events. However we were reassured because on-treatment LDL-cholesterol, HDL-cholesterol and triglyceride levels were all strongly predictive of events, and we reported this in the paper. These lipid levels were part of the clinical database, and thus were not subject to the error that occurred with the biomarkers. In the PCSK9 analysis, PCSK9 levels were predictive of events in the atorvastatin 10-mg group (p = 0.039) but not in the 80-mg group. This finding, which we now realize is totally spurious, was not unexpected and raised no red flags. Similarly, the failure of vitamin D levels to predict events, as reported in the AHJ paper, was not surprising.
Since the error was discovered, we have created a new anonymized clinical and biomarker database by restoring the original set of anonymized identifiers. We are currently reanalyzing the data according to our original study plans. However, the nested case-control feature of the original study design has been lost because the patient selection for biomarker sampling was random. Only approximately one tenth of patients now had an event, compared to one third in the original study design. Thus, the power to detect a difference in the level of a biomarker between patients with and without events has been attenuated.
All authors of these manuscripts are anguished to have made this mistake and publishing incorrect information.
TNT investigator John Kastelein, an author of two of the papers, told Retraction Watch:
Since the retraction was the result of a sample mix up and the results of our analysis were negative with regards to the predictive ability of the biomarkers in question, I, in fact, do hope that with the corrected sample labels and a new analysis we will be able to make better sense of the data.
Hat tip: Marilyn Mann
Dr. Kastelein and his colleagues are to be commended for their honesty in reporting the error in some of their data. We hear so much about scientific fraud (see, for example, The Scientist; http://www.the-scientist.com/?articles.list/tagNo/1607/tags/scientific-misconduct/) that the true honesty of the this group of researchers is both refreshing and a good example of the fact that most scientists are honest. These researchers are role models for scientists in all disciplines. Cudos!
Retractions aside, how does this happen? Were a couple of samples mislabeled or were all the samples mislabeled? Someone was not minding the store, will there be consequences?
And finally, who pays for this mistake?
Coincidence?
One of the last issue of the European Heart Journal [(2013) 34,7 April 2013] reports two very interesting paper about Scientific Fraud.
1/ Editor in chief Thomas Lüscher doi:101093/eurheartj/eht063 “the Codex of Science” say ‘…we must be aware of some deviant (publications) but we also must avoid an atmosphere of distrust’
2/ In the insert “Cardiopulse” same issue, B Shurlock brings our attention to dr Goldacre’s paper in “Theguardian” about fraudulent trial of treatment of post operative pain, which data waere totally fabricated doi:10.1093/eurheartj/eht073
3/and finally a retraction notice of a paper published in the European Heart Journal (KYOTO HEART study)in 2009…
It is not necessary to recall the last french political story lie/confession…
But it is a strange period.