Discussion about this post

User's avatar
Overcoming Bias Commenter's avatar

If there's an accepted bias toward not changing your answer it stands to reason that most changed answers will be from incorrect to correct. Only a clearly wrong original choice would be changed. If you adopt a strategy of changing your answers, you might find yourself changing from correct to incorrect more often.

Expand full comment
Overcoming Bias Commenter's avatar

If I may deconstruct the argument:

1) Assume the relationship between the T (threshold-for-answer-changing) and C (chance-that-a-change-improves-test-score) isn't sharply discontinuous;2) We know that at current levels of T, C is > 50%therefore:3) On average, people should decrease their levels of T.

Taken literally this reasoning is fallacious. What we want to know is the marginal gain from decreasing our threshold, not whether the average C given the new threshold is >50%.

It would be fair to say that this gives us some evidence that it might not be harmful to further decrease our answer-changing threshold, T.

Of course, it is possible that some of the cited studies have attempted to plot the relationship between T and C (for example, by instructing different students to use different heuristics for when to change one's answer, and plotting the relationship). In which case the quoted passage is fallacious at face value but only because it oversimplifies the point.

Expand full comment
8 more comments...

No posts