<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: This Is My Dataset. There Are Many Datasets Like It, but This One Is Mine. . .</title>
	<atom:link href="http://www.overcomingbias.com/2007/02/this_is_my_data.html/feed" rel="self" type="application/rss+xml" />
	<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html</link>
	<description>Overcoming Bias is economist Robin Hanson’s blog, on honesty, signaling, disagreement, forecasting, and the far future.</description>
	<lastBuildDate>Thu, 18 Mar 2010 06:22:50 -0400</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.5</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: New Economist</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421613</link>
		<dc:creator>New Economist</dc:creator>
		<pubDate>Tue, 13 Mar 2007 21:13:18 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421613</guid>
		<description>&lt;strong&gt;Unhappy about happiness research&lt;/strong&gt;

The always readable Cato Institute gadfly Will Wilkinson has not one, but two, long posts about the supposed evils of trying to measure happiness. I only provide brief excerpts - so read the whol thing. In the first, Effective Policy and the Measuremen...
</description>
		<content:encoded><![CDATA[<p><strong>Unhappy about happiness research</strong></p>
<p>The always readable Cato Institute gadfly Will Wilkinson has not one, but two, long posts about the supposed evils of trying to measure happiness. I only provide brief excerpts &#8211; so read the whol thing. In the first, Effective Policy and the Measuremen&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Seth Baum</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421612</link>
		<dc:creator>Seth Baum</dc:creator>
		<pubDate>Sun, 04 Mar 2007 16:26:28 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421612</guid>
		<description>On these happiness studies, it looks like both sides can be accused of this sort of bias.  I&#039;ve seen many economists in particlar dismiss the entire line of inquiry outright.  For example, Tyler Cowen from the popular econ blog &quot;Marginal Revolution&quot; &lt;a href=&quot;http://www.marginalrevolution.com/marginalrevolution/2007/02/department_of_u_1.html&quot; rel=&quot;nofollow&quot;&gt;wrote&lt;/a&gt; &quot;It&#039;s a good thing I don&#039;t believe in that nasty happiness research&quot;.  A quick glimpse at the &lt;a href=&quot;http://www.happyplanetindex.org/list.htm&quot; rel=&quot;nofollow&quot;&gt;data by country&lt;/a&gt; shows that the numbers are at least plausible: USA&#039;s a 7.4; China&#039;s a 6.3; India&#039;s a 5.4; Zimbabwe&#039;s a 3.3.  Of course the data&#039;s not perfect, but neither is GDP as a measure of national well-being, and that&#039;s used much more frequently.  But economics as we know it seems to have a methodological bias towards observing behavior, and these surveys threaten that, whereas GDP, for all its flaws, is derived from such behavior.

This could easily just be a proxy for an ideological/cultural debate between those preferring continued general economic growth and those who are nervous about that, whether for environmental reasons, social justice reasons, or lifestyle &quot;&lt;a href=&quot;http://www.timeday.org/&quot; rel=&quot;nofollow&quot;&gt;take back your time&lt;/a&gt;&quot; reasons.  I know I find myself tempted to endorse the survey research whenever I find myself on the nervous side.

My background is as an engineering researcher (electromagnetics).  We often dodge this problem because we can back our work up by fairly well-defined experiments, etc: either it works or it doesn&#039;t.  The social sciences doesn&#039;t have this luxury so much.  But we also have a culture where it&#039;s more OK to be wrong, and where being unbiased is paramount.  I think we should all be in the habbit of stating our own biases (as I did above) and in turn should commend others for doing so and scold them when they don&#039;t.  This won&#039;t cure all ills, but I think it would help.

As an example of this from politics, any time a politician is accused of &quot;flip-flopping&quot;, she should attack back and say &quot;you&#039;re darn right I changed my mind when I got a better understanding of the situation, and it&#039;s a big problem that you don&#039;t too!&quot;

...Off-topic: &lt;a href=&quot;http://felicifia.com&quot; rel=&quot;nofollow&quot;&gt;Felicifia&lt;/a&gt; is an online utilitarianism community, which anyone can join/write for.  We enjoy Overcoming Bias (and overcoming bias).
</description>
		<content:encoded><![CDATA[<p>On these happiness studies, it looks like both sides can be accused of this sort of bias.  I&#8217;ve seen many economists in particlar dismiss the entire line of inquiry outright.  For example, Tyler Cowen from the popular econ blog &#8220;Marginal Revolution&#8221; <a href="http://www.marginalrevolution.com/marginalrevolution/2007/02/department_of_u_1.html" rel="nofollow">wrote</a> &#8220;It&#8217;s a good thing I don&#8217;t believe in that nasty happiness research&#8221;.  A quick glimpse at the <a href="http://www.happyplanetindex.org/list.htm" rel="nofollow">data by country</a> shows that the numbers are at least plausible: USA&#8217;s a 7.4; China&#8217;s a 6.3; India&#8217;s a 5.4; Zimbabwe&#8217;s a 3.3.  Of course the data&#8217;s not perfect, but neither is GDP as a measure of national well-being, and that&#8217;s used much more frequently.  But economics as we know it seems to have a methodological bias towards observing behavior, and these surveys threaten that, whereas GDP, for all its flaws, is derived from such behavior.</p>
<p>This could easily just be a proxy for an ideological/cultural debate between those preferring continued general economic growth and those who are nervous about that, whether for environmental reasons, social justice reasons, or lifestyle &#8220;<a href="http://www.timeday.org/" rel="nofollow">take back your time</a>&#8221; reasons.  I know I find myself tempted to endorse the survey research whenever I find myself on the nervous side.</p>
<p>My background is as an engineering researcher (electromagnetics).  We often dodge this problem because we can back our work up by fairly well-defined experiments, etc: either it works or it doesn&#8217;t.  The social sciences doesn&#8217;t have this luxury so much.  But we also have a culture where it&#8217;s more OK to be wrong, and where being unbiased is paramount.  I think we should all be in the habbit of stating our own biases (as I did above) and in turn should commend others for doing so and scold them when they don&#8217;t.  This won&#8217;t cure all ills, but I think it would help.</p>
<p>As an example of this from politics, any time a politician is accused of &#8220;flip-flopping&#8221;, she should attack back and say &#8220;you&#8217;re darn right I changed my mind when I got a better understanding of the situation, and it&#8217;s a big problem that you don&#8217;t too!&#8221;</p>
<p>&#8230;Off-topic: <a href="http://felicifia.com" rel="nofollow">Felicifia</a> is an online utilitarianism community, which anyone can join/write for.  We enjoy Overcoming Bias (and overcoming bias).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: david</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421611</link>
		<dc:creator>david</dc:creator>
		<pubDate>Sun, 04 Mar 2007 04:18:28 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421611</guid>
		<description>Or (d) they could go collect a lot more data and try again, and honestly see what happens with new better data.
</description>
		<content:encoded><![CDATA[<p>Or (d) they could go collect a lot more data and try again, and honestly see what happens with new better data.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Matthew</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421610</link>
		<dc:creator>Matthew</dc:creator>
		<pubDate>Thu, 01 Mar 2007 20:32:41 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421610</guid>
		<description>Will, (as you may know from my past comments) I agree with your skepticism about what exactly happiness studies are studying. The happiness studies make assumptions about what it is they believe people to be reporting on (usually, the assumption is that these reports reflect a certain *feeling* or beliefs about one&#039;s overall balance of hedonic satisfaction). Such views assume that happiness is the same as pleasure or satisfaction. I find these equations unconvincing. (I&#039;ll argue that elsewhere, however.) The point, which you make, too, is that many of these studies might equally be called &quot;satisfaction studies&quot; - but saying that you study happiness is more glamorous than saying that you study &quot;subjective well-being,&quot; satisfaction, and the like, which may not be the same as the happiness we&#039;re all chasing after (unless we&#039;re hedonists).
</description>
		<content:encoded><![CDATA[<p>Will, (as you may know from my past comments) I agree with your skepticism about what exactly happiness studies are studying. The happiness studies make assumptions about what it is they believe people to be reporting on (usually, the assumption is that these reports reflect a certain *feeling* or beliefs about one&#8217;s overall balance of hedonic satisfaction). Such views assume that happiness is the same as pleasure or satisfaction. I find these equations unconvincing. (I&#8217;ll argue that elsewhere, however.) The point, which you make, too, is that many of these studies might equally be called &#8220;satisfaction studies&#8221; &#8211; but saying that you study happiness is more glamorous than saying that you study &#8220;subjective well-being,&#8221; satisfaction, and the like, which may not be the same as the happiness we&#8217;re all chasing after (unless we&#8217;re hedonists).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: DED</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421609</link>
		<dc:creator>DED</dc:creator>
		<pubDate>Thu, 01 Mar 2007 06:54:26 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421609</guid>
		<description>Will --

Here&#039;s an idea that I think could be helpful in curbing confirmatory bias in the social sciences (I don&#039;t know if it&#039;s novel, but maybe you can tell me if you&#039;ve heard of it, or even if it sounds worthwhile):  Have teams of researchers with different ex ante beliefs/motivations/political allegiances regarding a given phenomena collectively design experiments and models.  I&#039;m envisioning a sort of contract between intellectual &quot;rivals&quot; that stipulates some lack of bias in a given experimental design.  If people on both sides of a dispute agree on a methodology and some sort of interpretive framework for the resulting data BEFORE seeing the results of that experiment, they might be harder pressed to  cling onto their ideas as you mentioned in your post.  To be sure, this won&#039;t necessarily lead to answers or policy solutions that are better -- after all, both sides of a dispute could be missing the mark -- but it would seemingly make the debate more honest.

what do you think?

DED
</description>
		<content:encoded><![CDATA[<p>Will &#8211;</p>
<p>Here&#8217;s an idea that I think could be helpful in curbing confirmatory bias in the social sciences (I don&#8217;t know if it&#8217;s novel, but maybe you can tell me if you&#8217;ve heard of it, or even if it sounds worthwhile):  Have teams of researchers with different ex ante beliefs/motivations/political allegiances regarding a given phenomena collectively design experiments and models.  I&#8217;m envisioning a sort of contract between intellectual &#8220;rivals&#8221; that stipulates some lack of bias in a given experimental design.  If people on both sides of a dispute agree on a methodology and some sort of interpretive framework for the resulting data BEFORE seeing the results of that experiment, they might be harder pressed to  cling onto their ideas as you mentioned in your post.  To be sure, this won&#8217;t necessarily lead to answers or policy solutions that are better &#8212; after all, both sides of a dispute could be missing the mark &#8212; but it would seemingly make the debate more honest.</p>
<p>what do you think?</p>
<p>DED</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: eric</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421608</link>
		<dc:creator>eric</dc:creator>
		<pubDate>Thu, 01 Mar 2007 02:06:18 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421608</guid>
		<description>We can understand people preferring their own data because they feel it is accurate, presumably that&#039;s why they spent so much time theorizing on it.  But a true scientist is trying to explain the world, and facts being stubborn, it&#039;s essential to have them on your side.  If the goal is to create theories that explain the world, that should be recognized as any truthful data, and to actively seek good data wherever it is.  Look what happened to Bellesiles gun control data (not good).

People think theory is hard and facts are easy, when in fact they are tightly connected.  Facts are hard, because the interesting ones aren&#039;t obvious (minimum wage effects, effect of tougher sentencing, the relation of risk to return), they take wisdom because you can see how probable a fact is not merely by the face-value in a particular paper&#039;s abstract, but its compatibility with other facts given a certain view on the way the world works.
</description>
		<content:encoded><![CDATA[<p>We can understand people preferring their own data because they feel it is accurate, presumably that&#8217;s why they spent so much time theorizing on it.  But a true scientist is trying to explain the world, and facts being stubborn, it&#8217;s essential to have them on your side.  If the goal is to create theories that explain the world, that should be recognized as any truthful data, and to actively seek good data wherever it is.  Look what happened to Bellesiles gun control data (not good).</p>
<p>People think theory is hard and facts are easy, when in fact they are tightly connected.  Facts are hard, because the interesting ones aren&#8217;t obvious (minimum wage effects, effect of tougher sentencing, the relation of risk to return), they take wisdom because you can see how probable a fact is not merely by the face-value in a particular paper&#8217;s abstract, but its compatibility with other facts given a certain view on the way the world works.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Barkley  Rosser</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421607</link>
		<dc:creator>Barkley  Rosser</dc:creator>
		<pubDate>Wed, 28 Feb 2007 21:07:53 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421607</guid>
		<description>Will,

Not going to make any national forecasts, but Scandinavia provides a good example about being careful regarding these nation-based cross-sections.  So, most of the Scandinavian countries are near the top, but then they also have pretty high suicide rates.

My own theory on them is that there is this strong tendency to conformity and to act like you are happy because you are supposed to be.  &quot;Ja, ja, I am happy, now please don&#039;t bother me while I go home and blow my brains out.&quot;  Other cultures are notoriously whiney and kvetchy.  Are they really unhappy because their members complain all the time?

Another aspect of this &quot;happiness&quot; versus &quot;satisfaction,&quot; and is happiness being measured at a moment in time or more generally?  So, more careful panel studies of moment-to-moment happiness by Kahnemann et al come up with pretty interesting stuff from a sample of 500 women in Columbus, Ohio: they are happier with being with their friends than with their husbands, happier being with their husbands than their kids, happier being with their kids than being alone, and happier being alone than with their bosses.  Also, &quot;intimate relations&quot; provide the greatest happiness, but commuting provides the least.  So?  Commute with one&#039;s friends.

Also, on this with cross-national, US women claim in general to be happier around their kids than French women, but when one monitors this on a moment-to-moment basis, the French women seem to be happier.  Does this mean American womena are lying hypocrites?

Also, economic status (again, usually relative within a society) seems to be very important for &quot;satisfaction,&quot; but is a big fat zero on moment-to-moment happiness.
</description>
		<content:encoded><![CDATA[<p>Will,</p>
<p>Not going to make any national forecasts, but Scandinavia provides a good example about being careful regarding these nation-based cross-sections.  So, most of the Scandinavian countries are near the top, but then they also have pretty high suicide rates.</p>
<p>My own theory on them is that there is this strong tendency to conformity and to act like you are happy because you are supposed to be.  &#8220;Ja, ja, I am happy, now please don&#8217;t bother me while I go home and blow my brains out.&#8221;  Other cultures are notoriously whiney and kvetchy.  Are they really unhappy because their members complain all the time?</p>
<p>Another aspect of this &#8220;happiness&#8221; versus &#8220;satisfaction,&#8221; and is happiness being measured at a moment in time or more generally?  So, more careful panel studies of moment-to-moment happiness by Kahnemann et al come up with pretty interesting stuff from a sample of 500 women in Columbus, Ohio: they are happier with being with their friends than with their husbands, happier being with their husbands than their kids, happier being with their kids than being alone, and happier being alone than with their bosses.  Also, &#8220;intimate relations&#8221; provide the greatest happiness, but commuting provides the least.  So?  Commute with one&#8217;s friends.</p>
<p>Also, on this with cross-national, US women claim in general to be happier around their kids than French women, but when one monitors this on a moment-to-moment basis, the French women seem to be happier.  Does this mean American womena are lying hypocrites?</p>
<p>Also, economic status (again, usually relative within a society) seems to be very important for &#8220;satisfaction,&#8221; but is a big fat zero on moment-to-moment happiness.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Bruce G Charlton</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421606</link>
		<dc:creator>Bruce G Charlton</dc:creator>
		<pubDate>Wed, 28 Feb 2007 15:40:35 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421606</guid>
		<description>I have tried to use happiness questionnaires in psychological studies but never got anything out of them - by contrast a depression scale, such as the Beck depression inventory, quite easily yields useful stuff that can be tested further.

The question of testing is obviously the key. Happiness studes would get sorted out if, but only if, people were using the results for practical purposes - making predictions, making interventions, seeing whether interventions conformed to predictions etc.

But insofar as happiness studies are merely used as ammunition of socio-political agendas (eg. assertions about whether equality, status, wealth, democracy or the welfare state makes people happy) then they will never get sorted out.
</description>
		<content:encoded><![CDATA[<p>I have tried to use happiness questionnaires in psychological studies but never got anything out of them &#8211; by contrast a depression scale, such as the Beck depression inventory, quite easily yields useful stuff that can be tested further.</p>
<p>The question of testing is obviously the key. Happiness studes would get sorted out if, but only if, people were using the results for practical purposes &#8211; making predictions, making interventions, seeing whether interventions conformed to predictions etc.</p>
<p>But insofar as happiness studies are merely used as ammunition of socio-political agendas (eg. assertions about whether equality, status, wealth, democracy or the welfare state makes people happy) then they will never get sorted out.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: James D. Miller</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421605</link>
		<dc:creator>James D. Miller</dc:creator>
		<pubDate>Wed, 28 Feb 2007 15:04:03 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421605</guid>
		<description>Can the proposition that &quot;happiness surveys measure happiness&quot; be falsified?

</description>
		<content:encoded><![CDATA[<p>Can the proposition that &#8220;happiness surveys measure happiness&#8221; be falsified?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Sean</title>
		<link>http://www.overcomingbias.com/2007/02/this_is_my_data.html#comment-421604</link>
		<dc:creator>Sean</dc:creator>
		<pubDate>Wed, 28 Feb 2007 00:47:22 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/02/this-is-my-dataset-there-are-many-datasets-like-it-but-this-one-is-mine.html#comment-421604</guid>
		<description>Haha, love the post title. Full Metal Jacket is a great movie.
</description>
		<content:encoded><![CDATA[<p>Haha, love the post title. Full Metal Jacket is a great movie.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
