<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Author Misreads Expert Re Crowds?</title>
	<atom:link href="http://www.overcomingbias.com/2007/10/author-misreads.html/feed" rel="self" type="application/rss+xml" />
	<link>http://www.overcomingbias.com/2007/10/author-misreads.html</link>
	<description>Overcoming Bias is economist Robin Hanson’s blog, on honesty, signaling, disagreement, forecasting, and the far future.</description>
	<lastBuildDate>Sat, 11 Feb 2012 23:23:58 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.1.3</generator>
	<item>
		<title>By: Steve Sailer</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414601</link>
		<dc:creator>Steve Sailer</dc:creator>
		<pubDate>Sun, 07 Oct 2007 21:37:39 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414601</guid>
		<description>What a fiasco...

Are Levy and Peart the pair who have been smearing the Galtonians for years? Jeez, you&#039;d think they would have something better to do with their time...

Galton was 85 years old when he did the guess-the-weight study and realized that his preconception was completely wrong. So, rather than forget about it and take a nap, he reported his new finding to Nature, which became the starting point for the &quot;Wisdom of Crowds&quot; school of thought that James S. wrote about.

Galton was a great scientist and a great man.

For a less tendentious assessment of Galton&#039;s many achievements (and fewer, but still real, shortcomings), see Jim Holt&#039;s article in The New Yorker:

http://www.newyorker.com/archive/2005/01/24/050124crbo_books

Levy and Peart need to do some soul-searching about why they are so biased against the Galtonians.
</description>
		<content:encoded><![CDATA[<p>What a fiasco&#8230;</p>
<p>Are Levy and Peart the pair who have been smearing the Galtonians for years? Jeez, you&#8217;d think they would have something better to do with their time&#8230;</p>
<p>Galton was 85 years old when he did the guess-the-weight study and realized that his preconception was completely wrong. So, rather than forget about it and take a nap, he reported his new finding to Nature, which became the starting point for the &#8220;Wisdom of Crowds&#8221; school of thought that James S. wrote about.</p>
<p>Galton was a great scientist and a great man.</p>
<p>For a less tendentious assessment of Galton&#8217;s many achievements (and fewer, but still real, shortcomings), see Jim Holt&#8217;s article in The New Yorker:</p>
<p><a href="http://www.newyorker.com/archive/2005/01/24/050124crbo_books" rel="nofollow">http://www.newyorker.com/archive/2005/01/24/050124crbo_books</a></p>
<p>Levy and Peart need to do some soul-searching about why they are so biased against the Galtonians.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: David Levy</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414600</link>
		<dc:creator>David Levy</dc:creator>
		<pubDate>Sun, 07 Oct 2007 15:30:35 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414600</guid>
		<description>Dear James,

I have had time to reflect and now I
would like to offer a more detailed personal apology than what we&#039;ve jointly posted before. When I failed to find Galton&#039;s mean, in spite of your sufficient directions, I should have asked you directly for help. From these two failures of mine, and because Sandy trusted my work, we were led to the wrong conclusion that your account of Galton&#039;s mean was false instead of the right conclusion that your account was simply different than our accounts of Galton&#039;s median. If the
accounts are merely different then we have many ways of asking which of the two estimators one might prefer. We began that helpful exercise. We did not stop there. When we said that your account was false, and asked a rhetorical question of how this came to be, we called into question my own intentions.  We also wrongly called into question the care which scholars took in citing your work.

For all this, again, I offer a personal apology.


Best wishes,

David
</description>
		<content:encoded><![CDATA[<p>Dear James,</p>
<p>I have had time to reflect and now I<br />
would like to offer a more detailed personal apology than what we&#8217;ve jointly posted before. When I failed to find Galton&#8217;s mean, in spite of your sufficient directions, I should have asked you directly for help. From these two failures of mine, and because Sandy trusted my work, we were led to the wrong conclusion that your account of Galton&#8217;s mean was false instead of the right conclusion that your account was simply different than our accounts of Galton&#8217;s median. If the<br />
accounts are merely different then we have many ways of asking which of the two estimators one might prefer. We began that helpful exercise. We did not stop there. When we said that your account was false, and asked a rhetorical question of how this came to be, we called into question my own intentions.  We also wrongly called into question the care which scholars took in citing your work.</p>
<p>For all this, again, I offer a personal apology.</p>
<p>Best wishes,</p>
<p>David</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Eliezer Yudkowsky</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414599</link>
		<dc:creator>Eliezer Yudkowsky</dc:creator>
		<pubDate>Sat, 06 Oct 2007 16:48:17 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414599</guid>
		<description>Why can&#039;t all arguments be like this?  Congratulations all &#039;round.
</description>
		<content:encoded><![CDATA[<p>Why can&#8217;t all arguments be like this?  Congratulations all &#8217;round.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: David Levy</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414598</link>
		<dc:creator>David Levy</dc:creator>
		<pubDate>Sat, 06 Oct 2007 15:58:13 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414598</guid>
		<description>The paper has been taken down at Adam Smith Lives for rethinking.  We offer our apologies to James Surowiecki.

http://adamsmithlives.blogs.com/thoughts/2007/10/experts-and-i-1.html

One paragraph which will go into the next version is this:

One of Galton&#039;s defenses for the sample median as the vox populi was it that bounds the influence of any individual voter. Replication and checking of the work of experts may be a way to bound the influence of experts.  It is important for reader to know that  in an earlier version we denied the existence of Galton&#039;s mean. This emphasizes the importance of replication and competition precisely to bound the influence of such error

Here&#039;s what we are prepared to defend :

The majority-rule context of Galton&#039;s publications is lost when the sample median, upon  which Galton put such stress, is no longer reported

David Levy
</description>
		<content:encoded><![CDATA[<p>The paper has been taken down at Adam Smith Lives for rethinking.  We offer our apologies to James Surowiecki.</p>
<p><a href="http://adamsmithlives.blogs.com/thoughts/2007/10/experts-and-i-1.html" rel="nofollow">http://adamsmithlives.blogs.com/thoughts/2007/10/experts-and-i-1.html</a></p>
<p>One paragraph which will go into the next version is this:</p>
<p>One of Galton&#8217;s defenses for the sample median as the vox populi was it that bounds the influence of any individual voter. Replication and checking of the work of experts may be a way to bound the influence of experts.  It is important for reader to know that  in an earlier version we denied the existence of Galton&#8217;s mean. This emphasizes the importance of replication and competition precisely to bound the influence of such error</p>
<p>Here&#8217;s what we are prepared to defend :</p>
<p>The majority-rule context of Galton&#8217;s publications is lost when the sample median, upon  which Galton put such stress, is no longer reported</p>
<p>David Levy</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: James Surowiecki</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414597</link>
		<dc:creator>James Surowiecki</dc:creator>
		<pubDate>Sat, 06 Oct 2007 08:20:07 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414597</guid>
		<description>To finish, Levy and Peart insist that their really important point still stands, which is that &quot;When people quote Galton through Surowiecki, they tell Surowiecki&#039;s tale, not Galton&#039;s,&quot; and that this is a problem because Galton&#039;s thinking is being misrepresented. But as I said earlier, &quot;The Wisdom of Crowds&quot; was not intended to be a discussion of Francis Galton&#039;s opinions on what&#039;s the best method to capture group judgment, nor, as far as I know, has anyone who&#039;s &quot;Surowiecki&#039;s tale&quot; used the Galton example since used it to analyze Galton&#039;s opinions. People aren&#039;t quoting the Galton story because they&#039;re interested in what Galton himself thought about the median vs. mean. They&#039;re quoting it because they&#039;re interested in the bigger idea, which is that group judgments (and this is true whether you use the median, the mean, or a method like parimutuel markets) are often exceptionally accurate. Levy and Peart have constructed a straw man -- and, in this case, a straw man based on a falsehood -- and then tried to knock it down.

Robin writes: &quot;it is ironic that Galton made quite an effort to emphasize and prefer the median, in part because the data did not look like a bell curve, while your retelling focuses on him calculating a mean after checking for a bell curve.&quot; What&#039;s ironic about this? He did check for a bell curve, and he did calculate the mean. It&#039;s the data themselves, not Galton&#039;s interpretation of them, that I was writing about. (If he hadn&#039;t calculated the mean, I would have happily told the story with the median, since it was also remarkably accurate, and demonstrated the same point about the wisdom of crowds.)

Finally, on the substantive question, Robin (and Levy and Peart) seem to think that because the distribution of guesses wasn&#039;t normal, that makes using the mean a mistake. But this is precisely what&#039;s so interesting: if the group is large enough, even if the distribution isn&#039;t normal, the mean of a group&#039;s guesses is nonetheless often exceptionally good.

</description>
		<content:encoded><![CDATA[<p>To finish, Levy and Peart insist that their really important point still stands, which is that &#8220;When people quote Galton through Surowiecki, they tell Surowiecki&#8217;s tale, not Galton&#8217;s,&#8221; and that this is a problem because Galton&#8217;s thinking is being misrepresented. But as I said earlier, &#8220;The Wisdom of Crowds&#8221; was not intended to be a discussion of Francis Galton&#8217;s opinions on what&#8217;s the best method to capture group judgment, nor, as far as I know, has anyone who&#8217;s &#8220;Surowiecki&#8217;s tale&#8221; used the Galton example since used it to analyze Galton&#8217;s opinions. People aren&#8217;t quoting the Galton story because they&#8217;re interested in what Galton himself thought about the median vs. mean. They&#8217;re quoting it because they&#8217;re interested in the bigger idea, which is that group judgments (and this is true whether you use the median, the mean, or a method like parimutuel markets) are often exceptionally accurate. Levy and Peart have constructed a straw man &#8212; and, in this case, a straw man based on a falsehood &#8212; and then tried to knock it down.</p>
<p>Robin writes: &#8220;it is ironic that Galton made quite an effort to emphasize and prefer the median, in part because the data did not look like a bell curve, while your retelling focuses on him calculating a mean after checking for a bell curve.&#8221; What&#8217;s ironic about this? He did check for a bell curve, and he did calculate the mean. It&#8217;s the data themselves, not Galton&#8217;s interpretation of them, that I was writing about. (If he hadn&#8217;t calculated the mean, I would have happily told the story with the median, since it was also remarkably accurate, and demonstrated the same point about the wisdom of crowds.)</p>
<p>Finally, on the substantive question, Robin (and Levy and Peart) seem to think that because the distribution of guesses wasn&#8217;t normal, that makes using the mean a mistake. But this is precisely what&#8217;s so interesting: if the group is large enough, even if the distribution isn&#8217;t normal, the mean of a group&#8217;s guesses is nonetheless often exceptionally good.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: James Surowiecki</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414596</link>
		<dc:creator>James Surowiecki</dc:creator>
		<pubDate>Sat, 06 Oct 2007 08:02:44 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414596</guid>
		<description>I appreciate Levy and Peart admitting their mistake. But they seem not to recognize that their mistake undermines the critique that&#039;s at the center of their paper. Their paper, they write, is about the misconstruing of Galton&#039;s experiment. &quot;A key question,&quot; they write, &quot;is whether the tale was changed deliberately (falsified) or whether, not knowing the truth, the retold (and different) tale was passed on unwittingly.&quot; But the account of Galton&#039;s experiment was not changed deliberately and was not falsified. It was recounted accurately. Levy and Peart want to use my retelling of the Galton story as evidence of how &quot;experts pass along false information
(wittingly or unwittingly) [and] become part of a process by which errors are diffused.&quot; But there&#039;s no false information here, and no diffusion of errors, which rather demolishes their thesis. If they really want to write a paper about how &quot;experts&quot; pass along false information, they&#039;d be better off using themselves as Exhibit A, and tell the story of how they managed to publish such incredibly shoddy work and have prominent economists uncritically link to it.
</description>
		<content:encoded><![CDATA[<p>I appreciate Levy and Peart admitting their mistake. But they seem not to recognize that their mistake undermines the critique that&#8217;s at the center of their paper. Their paper, they write, is about the misconstruing of Galton&#8217;s experiment. &#8220;A key question,&#8221; they write, &#8220;is whether the tale was changed deliberately (falsified) or whether, not knowing the truth, the retold (and different) tale was passed on unwittingly.&#8221; But the account of Galton&#8217;s experiment was not changed deliberately and was not falsified. It was recounted accurately. Levy and Peart want to use my retelling of the Galton story as evidence of how &#8220;experts pass along false information<br />
(wittingly or unwittingly) [and] become part of a process by which errors are diffused.&#8221; But there&#8217;s no false information here, and no diffusion of errors, which rather demolishes their thesis. If they really want to write a paper about how &#8220;experts&#8221; pass along false information, they&#8217;d be better off using themselves as Exhibit A, and tell the story of how they managed to publish such incredibly shoddy work and have prominent economists uncritically link to it.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: EconLog</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414602</link>
		<dc:creator>EconLog</dc:creator>
		<pubDate>Sat, 06 Oct 2007 05:18:44 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414602</guid>
		<description>&lt;strong&gt;Surowiecki&#039;s Mistake?&lt;/strong&gt;

In my book, I reference Surowiecki&#039;s &quot;guess-the-weight-of-an-ox&quot; anecdote. My colleague David Levy and his co-author Sandra Peart show that isn&#039;t...
</description>
		<content:encoded><![CDATA[<p><strong>Surowiecki&#8217;s Mistake?</strong></p>
<p>In my book, I reference Surowiecki&#8217;s &#8220;guess-the-weight-of-an-ox&#8221; anecdote. My colleague David Levy and his co-author Sandra Peart show that isn&#8217;t&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Eliezer Yudkowsky</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414595</link>
		<dc:creator>Eliezer Yudkowsky</dc:creator>
		<pubDate>Sat, 06 Oct 2007 00:16:55 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414595</guid>
		<description>It looks like there wasn&#039;t much variance in the individual estimates that Galton checked!  Perhaps people really are unbiased weighers, with experience at county fairs.  (I would previously have agreed with Tom McCabe.)  Post facto rationalization:  Perhaps this is because if people systematically overestimate or underestimate at county fairs, they can correct this with relatively little experience:  &quot;Gee, that&#039;s the third time in a row my estimate was too high.&quot;
</description>
		<content:encoded><![CDATA[<p>It looks like there wasn&#8217;t much variance in the individual estimates that Galton checked!  Perhaps people really are unbiased weighers, with experience at county fairs.  (I would previously have agreed with Tom McCabe.)  Post facto rationalization:  Perhaps this is because if people systematically overestimate or underestimate at county fairs, they can correct this with relatively little experience:  &#8220;Gee, that&#8217;s the third time in a row my estimate was too high.&#8221;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Robin Hanson</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414594</link>
		<dc:creator>Robin Hanson</dc:creator>
		<pubDate>Sat, 06 Oct 2007 00:05:22 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414594</guid>
		<description>A long Levy and Peart response is now added to the post.
</description>
		<content:encoded><![CDATA[<p>A long Levy and Peart response is now added to the post.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Douglas Knight</title>
		<link>http://www.overcomingbias.com/2007/10/author-misreads.html#comment-414593</link>
		<dc:creator>Douglas Knight</dc:creator>
		<pubDate>Fri, 05 Oct 2007 23:25:07 +0000</pubDate>
		<guid isPermaLink="false">http://prod.ob.trike.com.au/2007/10/author-misreads-expert-re-crowds.html#comment-414593</guid>
		<description>Thank you for the opportunity to learn about the power and subtlety of indignation.
</description>
		<content:encoded><![CDATA[<p>Thank you for the opportunity to learn about the power and subtlety of indignation.</p>
]]></content:encoded>
	</item>
</channel>
</rss>

<!-- Performance optimized by W3 Total Cache. Learn more: http://www.w3-edge.com/wordpress-plugins/

Page Caching using disk (enhanced)
Database Caching using disk
Object Caching 438/455 objects using disk
Content Delivery Network via Amazon Web Services: S3: overcomingbias-assets.s3.amazonaws.com

Served from: www.overcomingbias.com @ 2012-02-11 19:09:19 -->
