Discover more from Overcoming Bias
One of the big wins of capitalism is that it creates strong private incentives for some kinds of social change. If someone has an idea for change, they can get investors and employees to work with them, in the hope of rewards if the change earns profits.
Alas, the most fundamental problem with social change in our world is that capitalism doesn’t encourage many other kinds of changes. Yes, under democracy elected politicians can get some weaker rewards for proposing changes. But for anything but small local changes, it isn’t worth a politican’s time to work out change details, explain it to voters, and organize support. That sort of thing is left to social movements and organized interest groups.
While many will deny it, the main promise that movements make to potential recruits is this: “If we win, you win”. Thus we mainly see movements around changes that can credibly make such promises. For example, crypto promises to reward investors with more money, and workers with valued job skills. Academic and technical movements promoting particular tools promise rewards to those who invest in these tools, relative to those who invest in competing tools.
Sometimes a movement has a vague label, and the real message is “As we ‘own’ this label, if our movement grows then we can send rewards to the high status loyalists among us.” Sometimes the movement’s implicit message is simply “We need to replace old folks with young folks like us in positions of influence.”
In entertainment and fashion movements, the reward can just be looking and sounding more knowledgable and “with-it”. For example, if I watch a lot of Game of Thrones, and it is popular, then in conversations I can relate to and say more about what others discuss. If locally sourced foods get popular, then I can seem more with-it when I cook such foods or recommend their restaurants. And if I grow or sell local food, I can gain even more. If I do or don’t wear masks, and then my mask side wins, I can brag that I supported the winning side.
The key point is that there are a lot of good ideas for change, including ideas that most people will admit are good ideas upon examination, where it is hard to organize supporting movements this way. For example, you can make a movement around a new way to teach kids, as you might start a school or be a teacher that uses it, or you might have your kid taught with it. But it is much harder to make a make a movement around the idea that there should just be a lot less school, unless you push a particular alternative to school.
Colleges rate professor teaching via student evaluations, which seems to have zero correlation with how much students learn, even though learning is the main reason given to attend college. But it seems hard to start a moment to fix this. We probably could construct ways to evaluate teacher effectiveness at student learning, but that would take resources away from other things, and would interfere with letting teachers teach any way they like. And a movement to just stop using current evaluations would admit to the public that we don’t care much about teaching quality.
More generally, when the public will mainly listen to people who specialize in X regarding changes in X, it is hard to make a movement to cut back on X. You can have movements to increase investments in X, or change how X is done, but the people who gain from cutting X are not the people listened to much on X.
Note that early on, movements can just promise gains via personal association with prestigious founders. It is later on when movements need to offer other rewards.
Futarchy would solve this, as it could give much stronger rewards for initiating changes. (At least for problems that government can solve.) But what would be gained by those who joined a movement to promote futarchy? The mechanism is simple, so there’s little to gain from investing in learning how to use it. It doesn’t promise to promise the young over the old, or to promote any particular policies for which we could identify the winners. Just making the world, or your nation better, inspires little passion.
“If We Win, You Win”
What about an "abolish X" movement? Following the movement rewards you because you have experience working without X and like with masks, you can brag if your side wins. For the student evaluation example, this would be departments or universities without them. Participants (professors, investors in universities and even students) may choose the abolish student evaluation movement in hopes that their department or university will produce more capable and prestigious students. The "keep student evaluation" side would do the same, in the same hope.
Somewhat unrelated question: how could we even design a student-side evaluation whose only goal is to measure how much students learned? If I take a course in subject S but don't know much about S before taking the course, I have no way to measure how much I've learned compared to how much I could have learned in the same amount of time. If the course was "difficult", I don't know if the difficulty is due to poor course design or inherent subject difficulty that no course could avoid.
There's so many resources available online now that such a evaluation scheme would help sift through the various online courses, videos, books, software, etc available.
There's the separate incentive issue of truthfully following whatever evaluation is designed, but lets suppose that can be overcome for the moment.
Similar question for evaluating the general applicability of what is learned. "Here are 5 steps that lets you do X" vs "Here's how you can come up with some steps, maybe 5, to do X, but also tweak it to do other things".
And what of the adversarial case where a banker tries to sell me an investment product but I also need to learn about investing through them (or another source, which may also have an incentive to sell me a possibly different investment product). How do I (self-)evaluate how much I am actually taught?
Student evals may be negatively correlated with learning outcomes: https://www.tandfonline.com...
>In summary, then, with the exception of the study by Weinberg et al. (2009), these studies present evidence that students tend to evaluate more positively the courses in which they did not learn a great deal. Or, as Braga et al. (2014) concluded, “teachers, who are more effective in promoting future performance receive worse evaluations from their students” (p. 81).
Ryerson university banned evals citing bias: https://www.insidehighered..... You would think that lefty unis everywhere would already be rolling back evals but the administration has powerful incentives to keep them around to drive grade inflation and keep student/consumers happy.