Overcoming Bias

Share this post

Robot ethics returns

www.overcomingbias.com

Discover more from Overcoming Bias

This is a blog on why we believe and do what we do, why we pretend otherwise, how we might do better, and what our descendants might do, if they don't all die.
Over 11,000 subscribers
Continue reading
Sign in

Robot ethics returns

Katja Grace
Jul 12, 2012
Share this post

Robot ethics returns

www.overcomingbias.com
23
Share

People are often interested in robot ethics. I have argued before that this is strange. I offered two potential explanations:

  1. Ethics seems deep and human, so it’s engagingly eerie to combine it with heartless AI

  2. People vastly misjudge how much ethics contributes to the total value society creates

A more obvious explanation now: people are just more interested in ethics when the subject is far away, for instance in the future. This is the prediction of construal level theory. It says thinking about something far away makes you think more abstractly, and in terms of goals and ideals rather than low level constraints. Ethics is all this.

So a further prediction would be that when we come to use robots a lot, expertise from robot ethicists will be in as little demand as expertise from washing machine ethicists is now.

Some other predictions, to help check this theory:

  • Emerging or imagined technologies should arouse ethical feelings more than present technologies do in general

  • International trade should prompt more ethical feelings than local trade

  • Stories of old should be more moralizing than stories of now

  • Historical figures should be seen in a more moral light than present-day celebrities

  • Space travel should be discussed in terms of more moral goals than Earth travel.

  • Ethical features of obscure cultures should be relatively salient compared to familiar cultures

More? Which of these are actually true?

There is definitely some conflicting evidence, for instance people feel more compelled to help people in front of them than those in Africa (there was an old OB post on this, but I can’t find it). There are also many other reasons the predictions above may be true. Emerging technologies might prompt more ethical concerns because they are potentially more dangerous for instance. The ethical dimension to killing everyone is naturally prominent. Overall construal level theory still seems to me a promising model for variations in ethical concern.

Added: I’m not confident that there is disproportionate interest compared to other topic areas. I seem to have heard about it too much, but this could be a sampling bias.

Share this post

Robot ethics returns

www.overcomingbias.com
23
Share
23 Comments
Share this discussion

Robot ethics returns

www.overcomingbias.com
Overcoming Bias Commenter
May 15

The question raised by this post has been address head-on by David J. Gunkel's new book "The Machine Question: Critical Perspectives on AI, Robots and Ethics" (MIT 2012). An excerpt is available online at http://machinequestion.org

Expand full comment
Reply
Share
roystgnr
May 15

Washing machine ethicists are actually quite in demand; we teach design ethics as part of the standard engineering degrees, then enforce it for specific designs via various regulations, "fitness for use" laws, underwriters laboratories certifications, etc.

But the worst case scenario of washing machine ethics is something like what happened to a professor of mine a decade ago: a bad leak during an extended vacation, and tens of thousands of dollars of home destruction.  The worst case scenario of AI ethics looks more like "intelligent beings with greater capability than us who want to hurt us", and historically that's often resulted in genocide, even within the tighter constraints on "greater capability" that are enforced by human biology and culture.

Expand full comment
Reply
Share
21 more comments...
Top
New
Community

No posts

Ready for more?

© 2023 Robin Hanson
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing