Overcoming Bias

Share this post

Meta Majoritarianism

www.overcomingbias.com

Discover more from Overcoming Bias

This is a blog on why we believe and do what we do, why we pretend otherwise, how we might do better, and what our descendants might do, if they don't all die.
Over 11,000 subscribers
Continue reading
Sign in

Meta Majoritarianism

Robin Hanson
Apr 22, 2007
Share this post

Meta Majoritarianism

www.overcomingbias.com
30
Share

Back in March, Hal Finney advocated "Majoritarianism":

In general, on most issues, the average opinion of humanity will be a better and less biased guide to the truth than my own judgment. ….. Given that we have so many intellectual and emotional biases pushing us towards overconfidence in our opinions, compensating for these biases requires that we give substantial preference to majoritarianism and only depart from it for very strong reasons.

Some of the challenges I raised are addressed in the 1981 book Rational Consensus in Science and Society, where Keith Lehrer and Carl Wagner outlined a position one might call "Meta Majoritarianism":

We shall present a theory of consensual probability … [as a] procedure for aggregating individual probability assignments.  … [that] involves … the computation of consensual weights assigned to each person on the basis of information people have about each other.  …  Our method for finding rational consensus rests on the fundamental assumption that members of a group have opinions about the dependability, reliability and rationality of other members of the group. … a member of the group is rationally committed to the consensual probability … once we agree that the method … is rational, we are rationally committed to the outcome. 

Lehrer and Wagner first describe a "very simple model" in which each person i assigns each other person j a (normalized non-negative) weight Wij.   Collecting these weights into matrix W, one gets a consensus weight wi for each person from the matrix equation W*w = w.   This consensus weight then gives a consensus probability from individual probabilities.   

This first approach implicitly assumes each person gives each other person the same weight at all meta levels of evaluation; that person is just as good at guessing rain, guessing how good John is at guessing rain, or guessing how good Mary is at guessing how good John is.  Lehrer and Wagner also describe an "extended model" where each person can assign each other person a different weight at each meta level.   Consensus weights then come from an infinite product of weight matrices, one for each meta level. 

This makes metaphorical, if not literal, sense.  Literally, one would want to also let weights vary by topic and time, and simple weighted averages of probabilities are just not the best way to combine the info in each person’s beliefs.  But metaphorically, it does make sense to ask not "What makes you think you are better than average?" but instead ask "What makes think you are better than respected others think you are?"

Share this post

Meta Majoritarianism

www.overcomingbias.com
30
Share
30 Comments
Share this discussion

Meta Majoritarianism

www.overcomingbias.com
Overcoming Bias Commenter
May 15

Dear James,

Re your other comments:You've convinced me that, theoretically, meta-majoritarianism may be succesful at determining the truth - and that a close analogue to it (Google) works quite well.

Now I'd need to see meta-majoritarianism in action, along with some analysis as to when it works better or worst that1) Expert opinion and2) Standard majoritarianism

My guess is that it would work better than standard majoritarianism when the issue is polarized between big groups, but worst when the issue is polarized between a smaller, fanatical group and a more uncertain majority.

My guess it would beat both expert opinion and standard majoritarianism in cases where there are degrees of expertise, and the "level" of expertise of any one person is not impossible for average people to see (say market predictions or editors on Wikipedia).

Expand full comment
Reply
Share
Overcoming Bias Commenter
May 15

Dear James,

Thanks for that info - it is indeed a cunning way of avoiding the closed-cult situation. And it becomes more efficient as the size of the cult goes down, which is nice.

I'm not sure how you envision a dynamic situation arising that would give rise to frequent problems

Simply that if you allow eigen-values to move, the top two will cross occasionally, leaving you with two solutions (which may be very different). This model of meta-majoritarianism seems unable to track the fact another solution is so close by, and may be within experiemental error.

Maybe a better model would be to have the average of all the eigenvectors, weighted by the squares of their eigen-values? This would be continuous in the data, and so would avoid such issues.

Expand full comment
Reply
Share
28 more comments...
Top
New
Community

No posts

Ready for more?

© 2023 Robin Hanson
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing