Overcoming Bias

Share this post

Thresholds Hurt Oddballs

www.overcomingbias.com

Discover more from Overcoming Bias

This is a blog on why we believe and do what we do, why we pretend otherwise, how we might do better, and what our descendants might do, if they don't all die.
Over 11,000 subscribers
Continue reading
Sign in

Thresholds Hurt Oddballs

Robin Hanson
Oct 15, 2010
Share this post

Thresholds Hurt Oddballs

www.overcomingbias.com
22
Share

To estimate the quality of something using a bunch of noisy clues, people often set minimum “deal-breaker” thresholds for each clue, and then reject candidates who fall below any threshold. For example, in dating:

My 20-year-old daughter informed me that she recently dumped a guy because when she asked him the meaning of a word, he said, “Are you serious?”  “That was it. It’s like a huge test for me. … It told me he felt intellectually superior to me,” explained Jenna. … Whoa, give the guy a break, I thought. …

[In] “Love and the Litmus Test,” an article that appeared here 28 years ago [I] essentially justified the kind of subjective, quick and seemingly irrational judgment that Jenna had made. … An “insignificant gesture, an offhand comment” or a plaid sports coat can alter destiny. … For my daughters, ineptitude in the kitchen is almost a deal-breaker. … “The check shouldn’t even hit the table if you’re out to dinner — he should grab it out of the waitress’s hand. … If a guy ever picks up a phone during a meal, I would never talk to him again. …  Irrelevant [facebook] wall posts tells me the guy has too much time on his hands. (more)

Now consider the following two dimensional space, where clues are linear correlates of a linear quality.

Red lines A,B,C show three different clue cutoffs, and the blue region shows the points that satisfy all three cutoffs. If we consider directions perpendicular to the better vs. worse quality axis, we can see that even though being “odd“, i.e., away from the central quality axis, does not hurt quality, the deal-breaker approach to selecting candidates is biased against odd candidates. Plain, i.e., not odd, candidates are acceptable even when relatively low in quality.

In general, instead of letting each noisy clue be a potential deal-breaker, it is usually better to weigh your clues together (e.g., via a weighted average).

So why do some women claim that they combine clues via deal-breaker thresholds instead of via weighing clues? My guess: such women are bragging about their selectivity in a way that is relatively verifiable. It would be harder to verify a claim that they set a high threshold on a complex weighing of many factors.

The same bias applies to regulations, which typically consist of a set of minimal requirements along many different dimensions. Such regulations are easier to express, monitor, and prosecute, but as with dating they are also biased against odd people and ventures. Count this as another way to see that regulation discourages innovation.

Thanks to Alex for talking this through with me.

Share this post

Thresholds Hurt Oddballs

www.overcomingbias.com
22
Share
22 Comments
Share this discussion

Thresholds Hurt Oddballs

www.overcomingbias.com
gwern
May 15

> gwern, averaging clues is also cheap fast and frugal.

Recognition is much easier than averaging and multiplication. People are not computers and FLOPS are not how they think, as anyone watching someone ponder prices and taxes at a store would instantly recognize.

If a weighted linear model is so easy for humans to do, why do we see things like http://lesswrong.com/lw/3gv... ?

Expand full comment
Reply
Share
Overcoming Bias Commenter
May 15

Consider the possibility that regulation does include a weighted component. Violations are generally punished with a fine, not a forced shutdown of the corporation, thus breaking them marginally decreases the fitness of the corporation, allowing more profitable corporations to break more regulations than marginal ones.

Expand full comment
Reply
Share
20 more comments...
Top
New
Community

No posts

Ready for more?

© 2023 Robin Hanson
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing