September 19th, 2010

A Rich OASIS for Your Journal Club

I’m always scouting for papers to discuss in journal club with my students. Earlier this month, I found the perfect pair: two simultaneously published articles from the industry-funded CURRENT–OASIS 7 randomized trial, one in the New England Journal of Medicine and the other in the Lancet. Many of the authors of the two papers were the same.

First, a recap: In a 2×2 factorial design, investigators compared higher- with standard-dose aspirin (either 300–325 mg or 75–100 mg daily) and higher- with standard-dose clopidogrel (either 600-mg loading, then 150 mg/day for 6 days, and 75 mg/day thereafter or 300-mg loading and 75 mg/day thereafter) in patients with acute coronary syndromes. All 25,086 participants were scheduled for percutaneous coronary intervention no more than 72 hours after randomization; about two thirds eventually underwent PCI. The primary endpoint was cardiovascular death, myocardial infarction, or stroke at 30 days.

The NEJM article reports the main finding: a failure to demonstrate the superiority of the higher doses over the standard doses (4.2% vs. 4.4% incidence of the primary endpoint for both aspirin and clopidogrel). In subgroup analyses, a predetermined threshold for significance of P≤0.01 was used, appropriate (as the authors note) for the multiple comparisons performed. (Some might even argue that the threshold was generous, given that there were 13 subgroups.) Within those parameters, no evidence of a significant interaction was found for any of the prespecified subgroups. The authors conclude, without qualification, that outcomes did not differ significantly between the higher- and standard-dose groups.

In the simultaneously published Lancet article, the authors pivot from the NEJM article and focus on the subgroup that underwent PCI, which was one of the 13 subgroups reported in the NEJM. Although PCI was planned for everyone who was randomized, about a third of the patients did not undergo the procedure because they were not considered suitable based on angiography findings. In the group that did eventually have a PCI, there was no difference in the primary endpoint between higher- and standard-dose aspirin (4.1% vs. 4.2%) but a “significant” difference for higher- versus standard-dose clopidogrel (3.9% vs. 4.5%; P=0.039). The authors endorse double-dose clopidogrel for ACS patients who are treated with early PCI.

Teaching Point 1: Avoid simultaneously publishing articles that spin the same data in completely different ways. Anyone who believes everything he or she reads in these high-impact journals would have been quite confused this month.

Teaching Point 2: A negative result should be called what it is. For reasons they articulate themselves, the NEJM authors prespecified the threshold for significance in the subgroup analyses at P≤0.01. They then use the term “nominally significant” to describe the PCI subgroup findings yet acknowledge in their discussion that the result did not meet their significance threshold and, therefore, “could have been due to the play of chance.” I would have preferred that they state plainly that the result was not significant.

The Lancet authors, of course, tell a different story in their discussion, saying that the data “suggest a clear benefit of double-dose clopidogrel” in the PCI subgroup. In listing the study’s limitations, they make no mention that the interaction was negative by their prespecified standard. Read in isolation, the Lancet article appears to present persuasive evidence for giving the double dose to these patients; read in tandem with the NEJM article, it obscures the fact that the interaction is negative and, therefore, that the evidence for the use of double-dose clopidogrel is weak.

Teaching Point 3: It’s best to select subgroups using information available at randomization. Even if the interaction had been positive and the evidence had clearly favored the use of double-dose clopidogrel in patients undergoing PCI, the clinical implications still would have been murky because this subgroup could not have been identified at the time the decision was being made. (Angiography results determined who would and who would not undergo PCI.) That leaves the reader to speculate, as the Lancet authors do, about the implications for practice. The authors go ahead and suggest starting everyone with a double dose of clopidogrel and discontinuing that higher dose when it becomes clear that a patient will not undergo PCI. However, this trial simply did not test that strategy, so it must be understood as speculation.

These articles earn my top rating for use in a journal club. Rarely will you witness famous authors draw such different conclusions about identical data published simultaneously in two prestigious journals. It’s a perfect opportunity for students and others to learn about interaction testing, significance levels, and subgroup selection.

What lessons do you derive from these studies? Do you agree with the NEJM authors or the Lancet authors? You can’t agree with both.

4 Responses to “A Rich OASIS for Your Journal Club”

  1. Rohan Parikh, M.B.B.S. says:

    Superb! This is what is called right learning. Applying anything that is read without applying mind can be disgraceful. I completely agree that when the two most prestigious journals of medical science present conflicting data it becomes hard to believe and act with either. Lets praise the wonderful mind and expect that such teaching points will always enlighten students like me.

  2. The presentation of results from OASIS 7 are both insulting and sobering to any practicing physician who aims to provide high quality care for their patients.

    For one, the trial failed to support a treatment strategy many have already adopted into their clinical practice. Yet, the prescribing of double-dose clopidogrel is likely to persist unchecked, as the authors and accompanying journals have refused to surrender to a negative study. The tried and true loophole – positive findings from non-prespecificied subgroup analyses – has prevailed. The recommendation to physicians: “A double-dose regimen of clopidogrel can be considered for all patients with acute coronary syndromes treated with an early invasive strategy and intended PCI.” This statement is grossly inconsistent with their results; it is irresponsible research and physicians and their patients should not have to be the ones to prove this wrong.

    Second, 1 out of 3 patients with acute coronary syndrome who were intended to get PCI, did not. We can only imagine that this number would be higher in the real-world, where patients with ACS are brought to the cath lab even if PCI is not likely. Who are these patients? No doubt, some may have had a plaque rupture/thrombosis in an epicardial artery that resolved spontaneously and thus did not require PCI. But what are the other clinical syndromes and pathophysiological mechanisms at play? Vasospasm? Hypertensive urgency? Takatsubo? Should these patients have been subject to continued clopidogrel – at any dose?

    It seems to me that OASIS7 told us more about what we don’t know, than what we do know. It also makes me think I should review findings from OASIS 1 through 6.

    Competing interests pertaining specifically to this post, comment, or both:
    None

  3. My comment is to express my thanks to Harlan Krumholz.
    He has given me an excellent lesson how to interpret data or read the trials. About two or three years ago at a cardiology session in Slovakia, after hearing some conflicting data I said that one has very little to read if one wants to read papers without conflicts of interest, or I can then read only Harlan Krumholz and some others.
    My opinion:
    1/ Journal reading requires critical mind. Much of my time has been spent to differentiate what is of clinical importance with therapeutic implications and what is not. May a time I can see there is no point in preferring one agent to another.
    2/ Unless there are papers peer-reviewed with acceptable quality, doctors will have to do it by themselves (each one with his or her own expertise…).
    3/ I never regard any journal as prestigious. Either there is a good quality paper in the journal or there is not.
    4/ This blog reminded me of Richard Smith who has said much so far.
    Anyone can access http://mlj.rsmjournals.com/cgi/reprint/76/3/79.pdf (pages 80 and 81 with strong points)
    The Trouble with Medical Journals, Richard S Smith, Executive Director of UnitedHealth Europe; Former Editor, British Medical Journal in: Medico-Legal Journal (2008) Vol. 76 Part 3, 79–93

    I would like to ask Harlan Krumholz and other experts to give lessons like these.
    Milan Kostek, MD, Slovakia

  4. Umar Shakur, D.O. says:

    Excellent discussion, helped clarify my thinking about the Lancet paper. Thank you!

    Competing interests pertaining specifically to this post, comment, or both:
    None