Govt Muzzles More

Sponsorship [of pharmaceutical research and drug trials] by manufacturers has been found to be associated with a reduced likelihood of the reporting of adverse results.  Likewise, a significant link has been found between industry funding and the likelihood that results of a randomized trial will support a new therapy. … One proposed solution to this problem is to increase public funding for the conduct of research on therapeutic effectiveness. Ironically, that may well aggravate the problem. In July 2007, AcademyHealth, a professional association of health services and health policy researchers, published results of a study of sponsor restrictions on the publication of research results. Surprisingly, the results revealed that more than three times as many researchers had experienced problems with government funders related to prior review, editing, approval, and dissemination of research results.  In addition, a higher percentage of respondents had turned down government sponsorship opportunities due to restrictions than had done the same with industrial funding. Much of the problem was linked to an “increasing government custom and culture of controlling the flow of even non-classified information.”

Of particular concern is a provision of the Senate-passed Patient Protection and Affordable Care Act, [regarding] the … new Patient-Centered Outcomes Research Institute to conduct comparative-effectiveness research.  The bill allows the withholding of funding to any institution where a researcher publishes findings not “within the bounds of and entirely consistent with the evidence,” a vague authorization that creates a tremendous tool that can be used to ensure self-censorship and conformity with bureaucratic preferences. This appears to be an effort in part to bypass the court order in Stanford v. Sullivan, a case involving federal contractual requirements that would have banned researchers from any discussion of their work without pre-approval by the Department of Health and Human Services. The order held that such blanket bans are “overly broad” and constitute “illegal prior restraint” on speech.  The language in the Senate bill attempts to overcome this hurdle by eliminating prior restraint, but using the threat of post hoc punishment as an incentive for self-censorship.

That was written Feb 8; I just contacted its author and he doesn’t know if this made it into the final med bill or not.  Alas this bodes poorly for the new comparative-effectiveness research program.

Added: Steven says this was in the final bill!  You’d better agree with the government’s interpretation of your findings if you want any future money.

GD Star Rating
loading...
Tagged as: ,
Trackback URL:
  • Steven

    It’s in the final version of the bill. Section 6301 of the Patient Protection Act (Public Law No: 111-148) adds the following section to the Social Security Act:

    “Any research published under clause
    (ii)(IV) shall be within the bounds of and entirely consistent
    with the evidence and findings produced under
    the contract with the Institute under this subparagraph.
    If the Institute determines that those requirements
    are not met, the Institute shall not enter into
    another contract with the agency, instrumentality, or
    entity which managed or conducted such research for
    a period determined appropriate by the Institute (but
    not less than 5 years).”

    This act was subsequently modified by reconciliation, but looking at the table of contents reveals that Section 6301 was not among the modified sections.

    • http://hanson.gmu.edu Robin Hanson

      Thanks Steven!

    • George

      Thanks! (I’m the author of the piece that Robin quotes).

      Another wonderful example of respect for “free speech.”

  • Joe

    Can anyone explain what

    “Any research published under clause
    (ii)(IV) shall be within the bounds of and entirely consistent
    with the evidence and findings produced under
    the contract with the Institute under this subparagraph.”

    means?

    Seriously. Isn’t “the evidence and findings produced” identical with “research”? How can this clause be violated? I don’t get it.

  • Jess Riedel

    What is the purported legitimate purpose of this clause? Specifically, is there an example of research in the past at which this clause is targeted?

  • Lord

    So researchers should be able to defraud the government at will? Yes, there are dangers from the politicization of science, but there are also dangers from unaccountability. The former can’t be prevented through law but only through administration.

  • gwern

    I’m a little confused. We start off by saying that corporate-sponsored research is ‘more likely’ to be biased than non-so-sponsored research of the same thing, and then we finish by pointing out that government-sponsored research is more likely to be biased? What’s being compared to what here? I thought if a study wasn’t corporate-sponsored it was usually government-sponsored.

    • http://entitledtoanopinion.wordpress.com TGGP

      The quoted phrasing makes it sound like a company pushing a product is more likely than others (perhaps other companies, perhaps government, perhaps non-profits) to publish research that supports said product (it is logically possible that it is the others who are more biased against it, though not likely). It also suggests that researchers complain more about restrictions placed on them by government compared to industry. Those are two distinct issues which are not incompatible.

  • Chris

    The 2007 quote is no doubt reflective of a broader culture in the Bush administration of an over-zealous control of information, and often down-right secretiveness.

    However, the threat of politicization seems to be pretty slim to me, based off this one clause.

    If you read the rest of the details of the Patient Centered Outcomes Institute it’s a not-for-profit institute, that appears quite isolated from the whims of the executive branch.

    The Board of the Institute is made up of the NIH Director, the director of the AHRQ and 17 others, selected with 6 year terms by the Comptroller General (which, if anyone doesn’t know, is the head of the Government Accountability [formerly Audit] Office, an office of the legislative branch).

    The institute, as far as i can see, has to demand some accountability from the researcher? Why throw good money after bad if the research is trash?

    Despite that, if there is any ‘muzzling’ going on it must, needless to say, be at the behest of the legislative as well as executive branches, and the politically isolated Board of the institute.

  • Gerard Harbison

    Why throw good money after bad if the research is trash?

    The established mechanism for doing this is peer review. When it works well, the panel reviewing the grant renewal will identify the prior results as trash, and score the application poorly. I’ve seen all sorts of criticisms of peer review, but inadequate identification of trash is seldom one.

    Besides, defunding the entire institutions because Dr. Incompetent in Lab 723 published crap seems a little extreme.

    • Chris

      I’m not a scientist so your answer sounds very reasonable.

      The breadth of the 5 year minimum moratorium on government contracts applies to the ‘study-conducting entity’ but whether this would encompass an entire university department (say) I don’t know.

      In spite of the concern over this portion of the bill, the Institute still appears to be very politically isolated. Fears of the PCORI galavanting around ‘muzzling’ scientists based on a political agenda seem unlikely.

      Considering your opinion on peer review the need for such a clause is not immediately apparent, but the organisation of the PCORI does not seem to lend itself to political manipulation, and in this sense it may still be better than the pressures of corporate funding.

      The

    • http://hanson.gmu.edu Robin Hanson

      Chris, there a great many possible biases that this could entrench besides “the whims of the executive branch.”

  • lemmy caution

    This guy believes that it was industry lobbyists who wanted the chilling effect:

    The Finance Committee bill also includes language requested by industry lobbyists (pages 1138–1139) that threatens to withdraw federal funding for 5 years from any investigator who publishes a report on research funded by the proposed institute that is not “within the bounds of and entirely consistent with the evidence.” Determinations regarding such consistency would be made by the newly created research entity, which would have industry involvement both in its governance and in study design. To allow scientists — and their institutions, which receive the support for the conduct of research — to be punished for the publication of work that is not approved by this entity is essentially to cede authority over the dissemination of government-funded research to a body that is at least partially controlled by persons with a potential commercial interest in its outcome. This move would be a major retrograde step that would both inhibit the conduct of CER and call its integrity into question. In addition, because researchers and their institutions will seek to avoid such punishment, this provision is likely to result in prolonged arguments, taking place out of public view, regarding which data are acceptable to publish, thereby impeding and delaying publication. The American public, which would be paying for this research, deserves better.

    The medical industry doesn’t want reports denigrating their products. 3 industry seats out of 15 isn’t a big deal though.

  • http://thelateenlightenment.blogspot.com Michael Caton

    RE the meta-finding that sponsored drug studies more frequently have positive answers regarding the treatments of the sponsors – this not necessarily indicative of twisting the truth and is better explained as a form of editorial control over research questions. That is, if you spend money developing a drug, you’re going to try to develop uses of it that you have a pretty good feeling in advance WILL WORK, and you’ll ask limited questions appropriate to that. You can have a better than 50% sense of whether something will work before you investigate it with rigor to get a MUCH better than 50% answer that it works. So I would argue the effect we’re seeing is more the result of conservative investigations than bias, and this is not inappropriate. But it’s worth thinking of ways to distinguish the two possibilities.

    • http://entitledtoanopinion.wordpress.com TGGP

      Shouldn’t only asking the questions you expect to give a positive answer be considered a kind of bias? Not one that merits some sort of punishment, but a bias nonetheless.

  • Pingback: Tweets that mention Overcoming Bias : Govt Muzzles More -- Topsy.com