Overcoming Bias

Share this post

Distraction Overcomes Moral Hypocrisy

www.overcomingbias.com

Discover more from Overcoming Bias

This is a blog on why we believe and do what we do, why we pretend otherwise, how we might do better, and what our descendants might do, if they don't all die.
Over 13,000 subscribers
Continue reading
Sign in

Distraction Overcomes Moral Hypocrisy

Hal Finney
Jul 1, 2008
Share this post

Distraction Overcomes Moral Hypocrisy

www.overcomingbias.com
17
Share

The New York Times reports on a particularly interesting bias, moral hypocrisy. Unfortunately I could not get access to any of the primary reports, but generally this refers to judging your own actions as moral when you would see them as immoral for someone else. The experiment blatantly shows the effect:

You show up for an experiment and are told that you and a person arriving later will each have to do a different task on a computer. One job involves a fairly easy hunt through photos that will take just 10 minutes. The other task is a more tedious exercise in mental geometry that takes 45 minutes.

You get to decide how to divvy up the chores: either let a computer assign the tasks randomly, or make the assignments yourself. Either way, the other person will not know you had anything to do with the assignments.

Now, what is the fair way to divvy up the chores?

When the researchers posed this question in the abstract to people who were not involved in the tasks, everyone gave the same answer: It would be unfair to give yourself the easy job.

But when the researchers actually put another group of people in this situation, more than three-quarters of them took the easy job. Then, under subsequent questioning, they gave themselves high marks for acting fairly. The researchers call this moral hypocrisy because the people were absolving themselves of violating a widely held standard of fairness (even though they themselves hadn’t explicitly endorsed that standard beforehand).

I must admit that I too would probably assign myself the easy task. However I would hope that I would not be so hypocritical as to claim that I had behaved fairly when I did so. But of course, reading about the experiment is different from being part of it. Maybe I would have been just as hypocritical as the other subjects.

For me, the most interesting finding was that a simple intervention could eliminate the hypocrisy (although not the unfair action!):

[The researchers] brought more people into the lab and watched them selfishly assign themselves the easy task. Then, at the start of the subsequent questioning, some of these people were asked to memorize a list of numbers and retain it in their heads as they answered questions about the experiment and their actions.

That little bit of extra mental exertion was enough to eliminate hypocrisy. These people judged their own actions just as harshly as others did. Their brains were apparently too busy to rationalize their selfishness, so they fell back on their intuitive feelings about fairness.

This is an intriguing and (to me) counter-intuitive means for preventing at least one pervasive bias. It seems surprising because we normally think of our biases as being subconscious, in opposition to our conscious goals of clear thinking. In that sense, we might expect that distracting our conscious minds by memorizing numbers would actually increase the opportunity for bias to creep in. Yet in this case, we see the opposite. Apparently our subconscious evaluations of morality are more accurate and it is our conscious, volitional efforts which produce distortion.

Eliezer Yudkowski reported earlier on studies that showed the opposite effect, where distraction made people less accurate. It raises the question of what effect distraction would have on other forms of bias we have considered. I wonder if there is a rule of thumb for when one might productively use mental distraction in order to improve decision making?

Share this post

Distraction Overcomes Moral Hypocrisy

www.overcomingbias.com
17
Share
17 Comments
Share this discussion

Distraction Overcomes Moral Hypocrisy

www.overcomingbias.com
Overcoming Bias Commenter
May 15

The neutral observers are not neutral. They are trying to manipulate the questioner into behaving "fairly".

Expand full comment
Reply
Share
Overcoming Bias Commenter
May 15

Perhaps at least some of the people being experimented on were not initially thinking it through whether they were being fair or unfair, rational or unrational, but rather had a thought upmost in their minds when deciding which task to do: "why didn't the experimenter make the choice for me?" Irritation with the experimenter may make people feel defensive and selfish. Even if they thought it unfair that had to make the choice of what task to do, they can still evaluate whether their choice was fairest, (at least in retrospect) and sometimes tell the truth about that self-evaluation.

Also, do people, at the time they are making a choice, know that if they choose the easy task are acting unfairly towards later arrivals, or is this a judgement they can make only in retrospect? In the real world, people learn from their moral choices, and may consciously act differently when a similar situation presents itself.

Expand full comment
Reply
Share
15 more comments...
Top
New
Community

No posts

Ready for more?

© 2023 Robin Hanson
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing