<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Funding Bias</title>
	<atom:link href="http://www.overcomingbias.com/2008/07/funding-bias.html/feed" rel="self" type="application/rss+xml" />
	<link>http://www.overcomingbias.com/2008/07/funding-bias.html</link>
	<description>Overcoming Bias is economist Robin Hanson’s blog, on honesty, signaling, disagreement, forecasting, and the far future.</description>
	<lastBuildDate>Thu, 18 Mar 2010 18:47:02 -0400</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.5</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: softwareNerd</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399399</link>
		<dc:creator>softwareNerd</dc:creator>
		<pubDate>Tue, 29 Jul 2008 23:45:30 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399399</guid>
		<description>I think evaluation institutions have a role, but they have to be allowed to develop. Allowing them to develop means that the government should not pre-empt their role. It is likely that, in the absence of a government role, and the presence of a real need, some such institutions will be founded.

It is also likely that when such institutions are available, some will figure out a way to work around them, and some such institutions will be corruptly in league with those they evaluate. By such errors, the marketplace will learn what is important. By such errors, managers of future evaluation-institutions will learn what makes for a good business model.
</description>
		<content:encoded><![CDATA[<p>I think evaluation institutions have a role, but they have to be allowed to develop. Allowing them to develop means that the government should not pre-empt their role. It is likely that, in the absence of a government role, and the presence of a real need, some such institutions will be founded.</p>
<p>It is also likely that when such institutions are available, some will figure out a way to work around them, and some such institutions will be corruptly in league with those they evaluate. By such errors, the marketplace will learn what is important. By such errors, managers of future evaluation-institutions will learn what makes for a good business model.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: mike kenny</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399398</link>
		<dc:creator>mike kenny</dc:creator>
		<pubDate>Tue, 29 Jul 2008 16:50:51 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399398</guid>
		<description>is there any use for prediction markets that use play money, and the players get rewards in terms of reputation?  for example, a scholar makes accurate predictions--he earns more play money than the average person.  he can use his stats as a resume item used to help him secure jobs where his talents could make him (and his employer) a lot of money.  could creating and popularizing play-money predictions markets be a way around laws against prediction markets, and a means of creating institutions that allow us to make better decisions?

maybe establishing more such play-money systems would at least get people used to the idea and pave the way for the real thing.
</description>
		<content:encoded><![CDATA[<p>is there any use for prediction markets that use play money, and the players get rewards in terms of reputation?  for example, a scholar makes accurate predictions&#8211;he earns more play money than the average person.  he can use his stats as a resume item used to help him secure jobs where his talents could make him (and his employer) a lot of money.  could creating and popularizing play-money predictions markets be a way around laws against prediction markets, and a means of creating institutions that allow us to make better decisions?</p>
<p>maybe establishing more such play-money systems would at least get people used to the idea and pave the way for the real thing.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Robin Hanson</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399397</link>
		<dc:creator>Robin Hanson</dc:creator>
		<pubDate>Mon, 28 Jul 2008 20:36:25 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399397</guid>
		<description>Jeff, &quot;insulating&quot; researchers from sponsors may reduce some biases, but it will increase others.  Do you know of data on the overall average effect?

Michael, I&#039;m not hoping for complex hedging instincts, but for direct subsidies of the markets of interest.

Thanatos, thanks for the review.




</description>
		<content:encoded><![CDATA[<p>Jeff, &#8220;insulating&#8221; researchers from sponsors may reduce some biases, but it will increase others.  Do you know of data on the overall average effect?</p>
<p>Michael, I&#8217;m not hoping for complex hedging instincts, but for direct subsidies of the markets of interest.</p>
<p>Thanatos, thanks for the review.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Thanatos Savehn</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399396</link>
		<dc:creator>Thanatos Savehn</dc:creator>
		<pubDate>Mon, 28 Jul 2008 17:46:13 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399396</guid>
		<description>Having been involved with this and similar issues I offer the following:

1) Government funded academic research is highly prone to produce positives. My favorite (or rather least favorite) example is the funding of so-called Gulf War Syndrome research. Those institutions which didn&#039;t find a link to heretofore unknown exotic gases, un-isolatable viruses or common vaccines got paid for their work and then didn&#039;t get any more. Texas Southwestern on the other hand found all sorts of causal links. As a result its researchers have gotten tens of millions of dollars in research money and they continue to churn out junk science that can&#039;t be reproduced elsewhere. Uncle Sam is the number one purchaser, and thus producer of, science for sale - and much, if not most, of it is junk. The worst of it is deadly - see e.g. saturated fat research from the 70s and 80s. In my experience, the more trendy the research the more likely it is to be crap.

2) Fred vom Saal is a nut.

3) The premiss is &quot;BPA was invented by someone looking for a hormone, therefore BPA must a hormone, all hormones are endocrine disruptors, therefore BPA is an endocrine disruptor&quot;. It may even be true - if you are a reading this and you are a certain strain of mouse (but not a rat, guinea pig, dog, monkey or human).

4) The most bizarre aspect of the whole silliness is the belief that the dose response relationship that is the basis of all pharmacology and toxicology is wrong so that the lower the dose, the greater the response. If you like homeopathy you&#039;ll love this scare. PS One funny aspect of their &quot;science&quot; is that if you ban BPA, levels will drop; since lower levels are more toxic (indeed infinitely diluted BPA would produce 100% mortality if you extrapolate from their results) things would only get worse.

5) The Europeans, who are no chemophiles, refused to ban BPA a few days ago.


</description>
		<content:encoded><![CDATA[<p>Having been involved with this and similar issues I offer the following:</p>
<p>1) Government funded academic research is highly prone to produce positives. My favorite (or rather least favorite) example is the funding of so-called Gulf War Syndrome research. Those institutions which didn&#8217;t find a link to heretofore unknown exotic gases, un-isolatable viruses or common vaccines got paid for their work and then didn&#8217;t get any more. Texas Southwestern on the other hand found all sorts of causal links. As a result its researchers have gotten tens of millions of dollars in research money and they continue to churn out junk science that can&#8217;t be reproduced elsewhere. Uncle Sam is the number one purchaser, and thus producer of, science for sale &#8211; and much, if not most, of it is junk. The worst of it is deadly &#8211; see e.g. saturated fat research from the 70s and 80s. In my experience, the more trendy the research the more likely it is to be crap.</p>
<p>2) Fred vom Saal is a nut.</p>
<p>3) The premiss is &#8220;BPA was invented by someone looking for a hormone, therefore BPA must a hormone, all hormones are endocrine disruptors, therefore BPA is an endocrine disruptor&#8221;. It may even be true &#8211; if you are a reading this and you are a certain strain of mouse (but not a rat, guinea pig, dog, monkey or human).</p>
<p>4) The most bizarre aspect of the whole silliness is the belief that the dose response relationship that is the basis of all pharmacology and toxicology is wrong so that the lower the dose, the greater the response. If you like homeopathy you&#8217;ll love this scare. PS One funny aspect of their &#8220;science&#8221; is that if you ban BPA, levels will drop; since lower levels are more toxic (indeed infinitely diluted BPA would produce 100% mortality if you extrapolate from their results) things would only get worse.</p>
<p>5) The Europeans, who are no chemophiles, refused to ban BPA a few days ago.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jay</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399395</link>
		<dc:creator>Jay</dc:creator>
		<pubDate>Mon, 28 Jul 2008 17:32:18 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399395</guid>
		<description>99.9% of government studies support more government intervention.

I&#039;d like to hear somone name one government funded study in which the result was something other than a &quot;politician&quot; pontificating to us on how said study proves that the government needs to reduce our liberties so that the government can protect us from ourselves.
</description>
		<content:encoded><![CDATA[<p>99.9% of government studies support more government intervention.</p>
<p>I&#8217;d like to hear somone name one government funded study in which the result was something other than a &#8220;politician&#8221; pontificating to us on how said study proves that the government needs to reduce our liberties so that the government can protect us from ourselves.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jeff</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399394</link>
		<dc:creator>Jeff</dc:creator>
		<pubDate>Mon, 28 Jul 2008 17:27:06 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399394</guid>
		<description>This looks to me like a good example of &quot;perfect is the enemy of good.&quot; Any research will have some bias, but we should draw a distinction between imperfect results and those that are nearly worthless. Government-sponsored research has had its ups and downs, but there isn&#039;t a single overwhelming source of bias, and in practice it&#039;s worked reasonably well.

Industry-sponsored research is a whole different story. When a drug company pays for research, they &lt;i&gt;always&lt;/i&gt; want to find out that their new drug is safe and effective. No matter how honorable and careful their scientists might be, the fact is that 100% of the sponsorship is hoping for a particular result; for smaller companies, if the drug &lt;i&gt;isn&#039;t&lt;/i&gt; found safe and effective, it means there won&#039;t &lt;i&gt;be&lt;/i&gt; any money to finish the research. It&#039;s going to be damned hard to keep that from influencing the reported results.

(Note: I&#039;m not arguing against prediction markets or the HEI model; just pointing out that lumping together government- and industry-sponsored research as equally biased is just ludicrous.)

</description>
		<content:encoded><![CDATA[<p>This looks to me like a good example of &#8220;perfect is the enemy of good.&#8221; Any research will have some bias, but we should draw a distinction between imperfect results and those that are nearly worthless. Government-sponsored research has had its ups and downs, but there isn&#8217;t a single overwhelming source of bias, and in practice it&#8217;s worked reasonably well.</p>
<p>Industry-sponsored research is a whole different story. When a drug company pays for research, they <i>always</i> want to find out that their new drug is safe and effective. No matter how honorable and careful their scientists might be, the fact is that 100% of the sponsorship is hoping for a particular result; for smaller companies, if the drug <i>isn&#8217;t</i> found safe and effective, it means there won&#8217;t <i>be</i> any money to finish the research. It&#8217;s going to be damned hard to keep that from influencing the reported results.</p>
<p>(Note: I&#8217;m not arguing against prediction markets or the HEI model; just pointing out that lumping together government- and industry-sponsored research as equally biased is just ludicrous.)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: michael vassar</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399393</link>
		<dc:creator>michael vassar</dc:creator>
		<pubDate>Mon, 28 Jul 2008 15:49:50 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399393</guid>
		<description>Robin:  When you talk about forecasts conditional on other forecasts, as you often do with prediction markets, I think of the discussion where you asserted, correctly, that very few people actually hedge.  It seems psychologically unrealistic to me to expect complex hedging to be widespread in prediction markets when even simple hedging is uncommon in existing markets (though many things are economically justified in the name of hedging).
</description>
		<content:encoded><![CDATA[<p>Robin:  When you talk about forecasts conditional on other forecasts, as you often do with prediction markets, I think of the discussion where you asserted, correctly, that very few people actually hedge.  It seems psychologically unrealistic to me to expect complex hedging to be widespread in prediction markets when even simple hedging is uncommon in existing markets (though many things are economically justified in the name of hedging).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: sophiesdad</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399392</link>
		<dc:creator>sophiesdad</dc:creator>
		<pubDate>Mon, 28 Jul 2008 14:36:15 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399392</guid>
		<description>Mr. Crossman: The article doesn&#039;t seem to be arguing for government funded research, but rather says that the solution is a funding model that &quot;insulates&quot; researchers from sponsors.

Firstly, my bad in attributing the model choice to Dr. Hanson, rather than to the article, although his classification of it as &quot;wishful thinking&quot; suggests that he agrees with the concept, were it possible.

Secondly, it is naive to think that paid researchers can be insulated from the influence of those who are the source of their pay. This concept has virtually eliminated the possibility of getting accurate medical information from the &quot;thought leaders&quot; in my field, erectile dysfunction. Those professors have gone from a relatively low fixed-salary arrangement (making them among the lowest paid urologic surgeons) provided solely by their universities, to the current &quot;consulting&quot; arrangements for the pharmaceutical and device industry, making them the highest paid of all urologists, some into the millions of dollars annually, while still maintaining their professorships. I am acquainted with all these &quot;thought leaders&quot;; not one thinks he has been influenced by industry. My own professional certifying board cautions all journal readers and all conference attendees: decide for yourself what is true. This is worse than knowing for certain that all of it is false.
</description>
		<content:encoded><![CDATA[<p>Mr. Crossman: The article doesn&#8217;t seem to be arguing for government funded research, but rather says that the solution is a funding model that &#8220;insulates&#8221; researchers from sponsors.</p>
<p>Firstly, my bad in attributing the model choice to Dr. Hanson, rather than to the article, although his classification of it as &#8220;wishful thinking&#8221; suggests that he agrees with the concept, were it possible.</p>
<p>Secondly, it is naive to think that paid researchers can be insulated from the influence of those who are the source of their pay. This concept has virtually eliminated the possibility of getting accurate medical information from the &#8220;thought leaders&#8221; in my field, erectile dysfunction. Those professors have gone from a relatively low fixed-salary arrangement (making them among the lowest paid urologic surgeons) provided solely by their universities, to the current &#8220;consulting&#8221; arrangements for the pharmaceutical and device industry, making them the highest paid of all urologists, some into the millions of dollars annually, while still maintaining their professorships. I am acquainted with all these &#8220;thought leaders&#8221;; not one thinks he has been influenced by industry. My own professional certifying board cautions all journal readers and all conference attendees: decide for yourself what is true. This is worse than knowing for certain that all of it is false.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Allan Crossman</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399391</link>
		<dc:creator>Allan Crossman</dc:creator>
		<pubDate>Mon, 28 Jul 2008 14:18:43 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399391</guid>
		<description>Yeah, I wasn&#039;t arguing against prediction markets. They sound like a good idea to me. It was just a nitpick I suppose.
</description>
		<content:encoded><![CDATA[<p>Yeah, I wasn&#8217;t arguing against prediction markets. They sound like a good idea to me. It was just a nitpick I suppose.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Hopefully Anonymous</title>
		<link>http://www.overcomingbias.com/2008/07/funding-bias.html#comment-399390</link>
		<dc:creator>Hopefully Anonymous</dc:creator>
		<pubDate>Mon, 28 Jul 2008 14:06:24 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2008/07/funding-bias.html#comment-399390</guid>
		<description>Allan, sounds like you&#039;re making a good point, but not addressing the core of Robin&#039;s argument, and I think Robin&#039;s on the side of the angels on this one. Prediction markets can help &quot;insulate&quot; researchers (and us, the audience of the researchers) from the researchers own biases (or more broadly from many types of biases, beyond sponsor-derived bias).
</description>
		<content:encoded><![CDATA[<p>Allan, sounds like you&#8217;re making a good point, but not addressing the core of Robin&#8217;s argument, and I think Robin&#8217;s on the side of the angels on this one. Prediction markets can help &#8220;insulate&#8221; researchers (and us, the audience of the researchers) from the researchers own biases (or more broadly from many types of biases, beyond sponsor-derived bias).</p>
]]></content:encoded>
	</item>
</channel>
</rss>
