Overcoming Bias

Share this post

Talking Versus Trading

www.overcomingbias.com

Discover more from Overcoming Bias

This is a blog on why we believe and do what we do, why we pretend otherwise, how we might do better, and what our descendants might do, if they don't all die.
Over 11,000 subscribers
Continue reading
Sign in

Talking Versus Trading

Robin Hanson
Feb 16, 2008
Share this post

Talking Versus Trading

www.overcomingbias.com
5
Share

The latest Journal of Prediction Markets describes lab experiments comparing prediction markets to deliberation.  They collected 24 groups of four people to forecast a survey on the popularity of five cell phone designs.  Half the groups talked among themselves and then made a group forecast, with prizes going to the best groups.  In the other half of the groups the individuals rotated trading with an automated market maker, with prizes going to the best individual forecasters.  They found:

The direct comparison of the two group mechanisms shows that the variation across the twelve estimates is much lower for the Traders with an average standard deviation of 3.2 percent compared to 7.9 percent for the Talkers. 

I expect talking groups to do even worse when members have differing interests to manipulate the group conclusion.  Since prediction market accuracy seems to not be hindered by such manipulation, the difference between the two mechanisms should be even larger in that case.   

Share this post

Talking Versus Trading

www.overcomingbias.com
5
Share
5 Comments
Share this discussion

Talking Versus Trading

www.overcomingbias.com
Robin Hanson
May 15

Jason, good point about variance and the prize incentives.

Expand full comment
Reply
Share
Overcoming Bias Commenter
May 15

Further to Hal's point, might the increased variance of group prediction simply be due to risk preferences inadvertently created by the experiment's design? The groups are competing against 11 other deliberative groups while the individuals are competing against only 3 other traders. If it's something like a winner-take-all contest, wouldn't we expect more variance where there are more competing units?

Now if the increased variance of the deliberative groups was instead caused by internally unequal endowments of aggression and persuasive skills, while the traders' budgets were equal, isn't it the case that most markets feature (wildly) unequal trading budgets along with non-independent, feedback trading? If I remember correctly, your experiment assumed equal trading budgets and no feedback trading.

Expand full comment
Reply
Share
3 more comments...
Top
New
Community

No posts

Ready for more?

© 2023 Robin Hanson
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing