Overcoming Bias

Share this post

How To Survey Confidence

www.overcomingbias.com

Discover more from Overcoming Bias

This is a blog on why we believe and do what we do, why we pretend otherwise, how we might do better, and what our descendants might do, if they don't all die.
Over 11,000 subscribers
Continue reading
Sign in

How To Survey Confidence

Robin Hanson
Mar 22, 2010
Share this post

How To Survey Confidence

www.overcomingbias.com
1
Share

In a 3-point elicitation procedure, an expert is asked for a lower limit, upper limit, and best guess, the two limits creating an interval of some assigned confidence level (e.g., 80%). In our 4-step interval elicitation procedure, experts were also asked for a realistic lower limit, upper limit, and best guess, but no confidence level was assigned; the fourth step was to rate their anticipated confidence in the interval produced. … We … found average overconfidence of 11.9%, 95% CI [3.5, 20.3] (a hit rate of 68.1% for 80% intervals)—a substantial decrease in overconfidence compared with previous studies.

More here.

Share this post

How To Survey Confidence

www.overcomingbias.com
1
Share
1 Comment
Share this discussion

How To Survey Confidence

www.overcomingbias.com
Overcoming Bias Commenter
May 15

There should be a list of simple tricks for making people more rational like this.

Expand full comment
Reply
Share
Top
New
Community

No posts

Ready for more?

© 2023 Robin Hanson
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing