<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Radical Research Evaluation</title>
	<atom:link href="http://www.overcomingbias.com/2007/07/radical-researc.html/feed" rel="self" type="application/rss+xml" />
	<link>http://www.overcomingbias.com/2007/07/radical-researc.html</link>
	<description>Overcoming Bias is economist Robin Hanson’s blog, on honesty, signaling, disagreement, forecasting, and the far future.</description>
	<lastBuildDate>Sun, 12 Feb 2012 01:09:57 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.1.3</generator>
	<item>
		<title>By: Overcoming Bias : Bungling Bounties</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-460084</link>
		<dc:creator>Overcoming Bias : Bungling Bounties</dc:creator>
		<pubDate>Thu, 18 Nov 2010 00:13:26 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-460084</guid>
		<description>[...] on &#8216;07 I posted on how the NSF thwarts Congress&#8217; efforts to &#8220;pay for results&#8221; in research via [...]</description>
		<content:encoded><![CDATA[<p>[...] on &#8216;07 I posted on how the NSF thwarts Congress&#8217; efforts to &#8220;pay for results&#8221; in research via [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Hopefully Anonymous</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417947</link>
		<dc:creator>Hopefully Anonymous</dc:creator>
		<pubDate>Tue, 17 Jul 2007 12:17:17 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417947</guid>
		<description>Joe, I think you&#039;re describing a problem with poor incentive prize construction, rather than an inherent problem with substantial funding of research through prize incentives. You&#039;re pointing out the importance sufficient # of prizes and size of prizes, and pegging the prizes to reasonably achievable goals, all important. The MPrize seems to have moved strongly in that direction, and I imagine this whole area (encompassing how salary and bonus incentives work) has been significantly studied by economists and management researchers.
</description>
		<content:encoded><![CDATA[<p>Joe, I think you&#8217;re describing a problem with poor incentive prize construction, rather than an inherent problem with substantial funding of research through prize incentives. You&#8217;re pointing out the importance sufficient # of prizes and size of prizes, and pegging the prizes to reasonably achievable goals, all important. The MPrize seems to have moved strongly in that direction, and I imagine this whole area (encompassing how salary and bonus incentives work) has been significantly studied by economists and management researchers.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: joe</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417946</link>
		<dc:creator>joe</dc:creator>
		<pubDate>Tue, 17 Jul 2007 06:22:22 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417946</guid>
		<description>Carl,
Unfortunately it could also be a high-risk investment if you have many institutions vying for the same prize, and there is no guarantee that anyone will find an answer in a reasonable amount of time if ever.  For many institutions, a consistent yearly return on an investment might be preferred.
</description>
		<content:encoded><![CDATA[<p>Carl,<br />
Unfortunately it could also be a high-risk investment if you have many institutions vying for the same prize, and there is no guarantee that anyone will find an answer in a reasonable amount of time if ever.  For many institutions, a consistent yearly return on an investment might be preferred.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Carl Shulman</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417945</link>
		<dc:creator>Carl Shulman</dc:creator>
		<pubDate>Tue, 17 Jul 2007 02:50:47 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417945</guid>
		<description>LemmusLemmus,

&quot;but would academic institutes have enough resources to put the money up in advance? My understanding was that university scientists practically always need outside funding for empirical research projects.&quot;

They need to get outside funding in substantial part because ordinarily such research is a cost to the university, so other constituencies eager for budget prevent such allocation. The situation is different for a profit center: universities invest billions in alternative investments, from hedge funds to timber lots. Investing in efficient research aimed at winning (abundant) prizes would be a high-return investment, as prize money (unlike grants) could be channeled to fund other activities.
</description>
		<content:encoded><![CDATA[<p>LemmusLemmus,</p>
<p>&#8220;but would academic institutes have enough resources to put the money up in advance? My understanding was that university scientists practically always need outside funding for empirical research projects.&#8221;</p>
<p>They need to get outside funding in substantial part because ordinarily such research is a cost to the university, so other constituencies eager for budget prevent such allocation. The situation is different for a profit center: universities invest billions in alternative investments, from hedge funds to timber lots. Investing in efficient research aimed at winning (abundant) prizes would be a high-return investment, as prize money (unlike grants) could be channeled to fund other activities.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: LemmusLemmus</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417944</link>
		<dc:creator>LemmusLemmus</dc:creator>
		<pubDate>Mon, 16 Jul 2007 21:57:46 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417944</guid>
		<description>Carl,

I see your point about the biotechnology company, but would academic institutes have enough resources to put the money up in advance? My understanding was that university scientists practically always need outside funding for empirical research projects.

I also don&#039;t think venture capitalists would be willing to put up lots of money for the simple reason that they cannot tell how big of a challenge the reasearchers would face.
</description>
		<content:encoded><![CDATA[<p>Carl,</p>
<p>I see your point about the biotechnology company, but would academic institutes have enough resources to put the money up in advance? My understanding was that university scientists practically always need outside funding for empirical research projects.</p>
<p>I also don&#8217;t think venture capitalists would be willing to put up lots of money for the simple reason that they cannot tell how big of a challenge the reasearchers would face.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Hopefully Anonymous</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417943</link>
		<dc:creator>Hopefully Anonymous</dc:creator>
		<pubDate>Mon, 16 Jul 2007 18:16:56 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417943</guid>
		<description>Carl,
Great point and interesting idea.
</description>
		<content:encoded><![CDATA[<p>Carl,<br />
Great point and interesting idea.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: dearieme</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417942</link>
		<dc:creator>dearieme</dc:creator>
		<pubDate>Mon, 16 Jul 2007 17:04:39 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417942</guid>
		<description>Put 5% of funds aside to be allocated by lot.  Every applicant is appraised every (say) 5 years to confirm that he&#039;s qualified to be an entrant, and then chance rules.
</description>
		<content:encoded><![CDATA[<p>Put 5% of funds aside to be allocated by lot.  Every applicant is appraised every (say) 5 years to confirm that he&#8217;s qualified to be an entrant, and then chance rules.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Eliezer Yudkowsky</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417941</link>
		<dc:creator>Eliezer Yudkowsky</dc:creator>
		<pubDate>Mon, 16 Jul 2007 16:08:23 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417941</guid>
		<description>It&#039;s hard to see what motive any bureaucrat has for putting real change in place, when they can look sexy and edgy and dangerous just by calling for dangerous proposals.  It&#039;s actually putting money in place that would involve the career risk - and that, of course, can be left out at little cost to reputation.
</description>
		<content:encoded><![CDATA[<p>It&#8217;s hard to see what motive any bureaucrat has for putting real change in place, when they can look sexy and edgy and dangerous just by calling for dangerous proposals.  It&#8217;s actually putting money in place that would involve the career risk &#8211; and that, of course, can be left out at little cost to reputation.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Carl Shulman</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417940</link>
		<dc:creator>Carl Shulman</dc:creator>
		<pubDate>Mon, 16 Jul 2007 15:54:47 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417940</guid>
		<description>Plinius,

The NIH spends $28 billion per year. The genomics X-prize is $10 million, and a winning team will have delivered a major medical advance. It seems highly improbable that having well under 1% of federal funding actually be performance-based prizes is optimal.

On the issue of not having funds to get research started, prizes don&#039;t have to be enormous. Imagine the NIH allocating a fifth of its budget to endowing 5600 new $1 million prizes each year. The volume is sufficiently large that a medical school, biology department, or profit-making biotechnology company could compete for many prizes simultaneously, diversifying its research portfolio to earn a fairly steady stream of revenues, but with new incentives to conduct cost-*effective* research.
</description>
		<content:encoded><![CDATA[<p>Plinius,</p>
<p>The NIH spends $28 billion per year. The genomics X-prize is $10 million, and a winning team will have delivered a major medical advance. It seems highly improbable that having well under 1% of federal funding actually be performance-based prizes is optimal.</p>
<p>On the issue of not having funds to get research started, prizes don&#8217;t have to be enormous. Imagine the NIH allocating a fifth of its budget to endowing 5600 new $1 million prizes each year. The volume is sufficiently large that a medical school, biology department, or profit-making biotechnology company could compete for many prizes simultaneously, diversifying its research portfolio to earn a fairly steady stream of revenues, but with new incentives to conduct cost-*effective* research.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Hopefully Anonymous</title>
		<link>http://www.overcomingbias.com/2007/07/radical-researc.html#comment-417939</link>
		<dc:creator>Hopefully Anonymous</dc:creator>
		<pubDate>Mon, 16 Jul 2007 15:03:14 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/07/radical-research-evaluation.html#comment-417939</guid>
		<description>I didn&#039;t see anyone suggest a complete replacement of grants with prizes, but for the sake of argument, promising research teams could secure loans or incorporate and sell equity stakes of their incorporation in the anticipation of future prize money earnings. Practically, I suspect prize money is a good supplement to other ways of funding, rewarding, and incentivizing the best research, including the best &quot;basic&quot; research.
</description>
		<content:encoded><![CDATA[<p>I didn&#8217;t see anyone suggest a complete replacement of grants with prizes, but for the sake of argument, promising research teams could secure loans or incorporate and sell equity stakes of their incorporation in the anticipation of future prize money earnings. Practically, I suspect prize money is a good supplement to other ways of funding, rewarding, and incentivizing the best research, including the best &#8220;basic&#8221; research.</p>
]]></content:encoded>
	</item>
</channel>
</rss>

<!-- Performance optimized by W3 Total Cache. Learn more: http://www.w3-edge.com/wordpress-plugins/

Page Caching using disk (enhanced)
Database Caching using disk
Object Caching 438/455 objects using disk
Content Delivery Network via Amazon Web Services: S3: overcomingbias-assets.s3.amazonaws.com

Served from: www.overcomingbias.com @ 2012-02-11 21:07:10 -->
