Followup to: The Design Space of Minds-in-General, Ghosts in the Machine, A Priori
What is so terrifying about the idea that not every possible mind might agree with us, even in principle?
For some folks, nothing – it doesn’t bother them in the slightest. And for some of those folks, the reason it doesn’t bother them is that they don’t have strong intuitions about standards and truths that go beyond personal whims. If they say the sky is blue, or that murder is wrong, that’s just their personal opinion; and that someone else might have a different opinion doesn’t surprise them.
For other folks, a disagreement that persists even in principle is something they can’t accept. And for some of those folks, the reason it bothers them, is that it seems to them that if you allow that some people cannot be persuaded even in principle that the sky is blue, then you’re conceding that "the sky is blue" is merely an arbitrary personal opinion.
Yesterday, I proposed that you should resist the temptation to generalize over all of mind design space. If we restrict ourselves to minds specifiable in a trillion bits or less, then each universal generalization "All minds m: X(m)" has two to the trillionth chances to be false, while each existential generalization "Exists mind m: X(m)" has two to the trillionth chances to be true.
This would seem to argue that for every argument A, howsoever convincing it may seem to us, there exists at least one possible mind that doesn’t buy it.
And the surprise and/or horror of this prospect (for some) has a great deal to do, I think, with the intuition of the ghost-in-the-machine – a ghost with some irreducible core that any truly valid argument will convince.
Continue reading "No Universally Compelling Arguments" »
loading...