Tag Archives: Academia

Hard Facts: Teaching

More wisdom from Hard Facts:

Merit pay for teachers is an idea that is almost 100 years old ahd has been subject to much research.  In one study conducted in 1918, “48 percent of U.S. school districts sampled used compensation systerms that they called merit pay.” … The evidence shows that merit-pay plans seldom last longer than five years and that merit pay consistently failes to improve student performance.  … [Researchers] also showed that cheating [by teachers] was quite sensitive to the size of the incentives provided for enhancing student scores.  … The same problems emerged when merit-pay systems were implemented in the 1980s. … “It is like policy makers suffer from amnesia.” (pp.22-24) …

The evidence strongly suggests that students learn better when they are not graded and certainly not when they are graded on a curve.  … When drill instructors were tricked into believing that certain randomly selected soldiers would achieve superior performance, those soldiers subsequently performacned far better on tasks like firing weapons and reading maps.  (p.38)

Ending social promotion harms students and schools, and the strongest negative effects are found in the best, most rigorous studies.  At least 55 studies show that when flunked students are compared to socially promoted students, flunked students perform worse and drop out of school at higher rates.  One of the most careful studies found that, after controlling for numberous alternative explanations indlucing race, gender, family income, and school characteristics, students held back one grade were 70 percent more likely to drop out of high school.  (p.51)

Managing Our Cut

Our income tax system gives each of us a stake in the work of others – the more money others make, the more we each get via taxes.  In principle we could use this fact to justify a great deal of intervention in everyone’s work lives.  For example, one might argue: why should we let folks choose fulfilling but poorly paid jobs like social worker, veterinarian, or forestry agent, if they are capable of becoming an lawyer, doctor, or engineer?  Or why should we let folks work part time to focus on a music or acting hobby, or choose to live anywhere but the city where their skills are worth the most?

To most folks such regulations seem intolerably intrusive.  But when people are asked to justify our common and extensive regulations and subsidies of medicine and education, they often mention exactly this issue – that such interventions make sense because we all have a stake in the work of others via the income taxes those folks pay.  Why the asymmetry?  Why do folks think these arguments make sense regarding medicine and education, but not regarding choice of career or location?

My guess: humans inherited intuitions that the community should have more say in and contribute more to medicine and education.  This is the way our distant ancestors did things in their small nomadic forager bands, and we intuit we should act similarly today.  The stuff about managing our cut of others’ income is just a rationalization.

Only Trust Us

First they came for the communists, and I did not speak out—because I was not a communist;
Then they came for the trade unionists, … for the Jews, …
Then they came for me—and there was no one left to speak out for me.

PLoS Medicine:

While we continue to be interested in analyses of ways of reducing tobacco use, we will no longer be considering papers where support, in whole or in part, for the study or the researchers comes from a tobacco company.

Eric Crampton:

As good a [bias] case can be made … against tobacco industry funding. How many anti-tobacco public health researchers would be able to continue getting grants from Ministries of Health if their research found that smoking isn’t as bad as the Ministry might have thought?

John Tierney:

Many scientists, journal editors and journalists see themselves as a sort of priestly class untainted by commerce. … This snobbery was codified by the Journal of the American Medical Association in 2005, when it … refused to publish such work unless there was at least one author with no ties to the industry who would formally vouch for the data.  That policy … looked especially dubious after a team of academic researchers (not financed by industry) analyzed dozens of large-scale clinical trials in previous decades and reported that industry-sponsored ones met significantly higher standards than the nonindustry ones.

More:

As Gary Taubes nicely illustrates in his book, “Good Calories, Bad Calories,” scientists who disagreed with the accepted wisdom on the evils of fat in the diet were accused of being corrupted by industry grants even if they had received most of their money from government agencies that were looking — unsuccessfully — for evidence to back the fat-is-bad theory. Meanwhile, scientists who went along with the conventional wisdom on fat weren’t criticized for the corporate money they’d received from food companies.

Mr. Taubes has also found some wonderful examples of selective journalism in the dispute over sugar’s health effect: An article stressing the harms of sugar would make dissenting scientists look bad by stressing their connections to the sugar industry, whereas an article exonerating sugar would make the other side’s scientists look bad by stressing the money they received from companies making sugar substitutes. …

“Scientists were believed to be free of conflicts if their only source of funding was a federal agency, but all nutritionists knew that if their research failed to support the government position on a particular subject, the funding would go instead to someone whose research did.” … Not-for-profit advocacy groups … “are rarely if ever accused of conflicts of interest, even though their entire reason for existence is to argue one side of a controversy as though it were indisputable.”

If the new principle is that we mustn’t publish research not funded by groups committed to proving our official beliefs, how long before “our” beliefs exclude yours?  How long before interdisciplinary journals like Science or Nature refuse to publish papers by economists, known for their suspiciously right-wing leanings, unless non-economist co-authors vouch for them?  Do you really think that can’t happen?

Function of Stat Academia

Imagine an academic arguing:

Some say academics are lost in their “ivory tower” trying to impress each other and so aren’t very useful to the wider world.  But this is ridiculous.  Every academic paper cites previous papers the author found useful in writing this paper, and academics are very eager to be cited.  The most cited papers are the most celebrated papers.  So of course academics try to be useful.  If huge areas of academia seem pretty useless that is just because those academics just happen to be quite ignorant about to be useful – it doesn’t mean they aren’t trying to be useful.

See the flaw in that argument?  Right – being useful to other academics in trying to impress each other isn’t at all the same as being useful to the wider world.  Now consider a recent exchange between Seth Roberts and Andrew Gelman (with whom I discussed this in July.)  Seth:

Graphs and transformations are low-status. They are low-status because graphs are common and transformations are easy.  Anyone can make a graph or transform their data. I believe they were neglected for that reason.  To show their high status, statistics professors focused their research and teaching on more difficult and esoteric stuff — like complicated regression.  That the new stuff wasn’t terribly useful (compared to graphs and transformations) mattered little.  Like all academics — like everyone — they cared enormously about showing high status.  It was far more important to be impressive than to be useful.

Andrew:

This is, in my experience, ridiculous. Seth … says that useful statistical research work is generally low status. No, no, no, no! It’s hard to be useful! Just about everybody in statistics tries to do work that is useful.

OK, I know what Seth is talking about. I used to teach at Berkeley (as did Seth), and indeed the statistics department back then was chock-full of high-status professors (the department was generally considered #1 or #2 in the world) who did little if anything useful in applied statistics. But they were trying to be useful! They were just so clueless that they didn’t know better. … It’s certainly true that they didn’t appreciate graphical methods or the challenges of getting down and dirty with data. (They might have dismissed such work as being insufficiently general and enduring.) … Continue Reading "Function of Stat Academia" »

Praise Polymaths

Once upon a time folks who traveled far were treated with suspicion.  Sure if you were rich and traveled like the rich you weren’t more suspicious than other rich.  But those who traveled more than their class were suspected, correctly on average, of being less loyal to their neighbors.

Today travel is mostly celebrated; people love to talk about their trips and admire the well-traveled, even beyond the wealth it signals.  But travel today doesn’t much threaten loyalty – intellectual contact with locals is limited, and usually selected to be like-minded.  Ooh look, another pretty building.  True intellectual travel, where you actually take the time to see things from different perspectives, is rare, more valuable, and yet elicits more suspicion than admiration.

You see, our beliefs are severely distorted by our culture and training, and intellectual travel remains our only remotely reliable remedy.  We all know that we would have been inclined toward different beliefs had we been raised in different cultures or disciplines.  We see consistent differences between folks trained in West vs. East, science vs. humanities, economics vs. sociology, and in different schools of thought of most any discipline.  We like to think that we correct for this, but when we realize how hard that is, we throw up our hands saying “what ya gonna do?” Continue Reading "Praise Polymaths" »

Show, Sort, Shill

The point of writing is to help others see, but what exactly do we help others see?  Consider:

  • Show – Show the world new ideas (or insights).
  • Sort – Attach quality signals to shown ideas.
  • Shill – Push ideas, via other sorts of influences.

Many new ideas or insights can be expressed clearly in just a few paragraphs.  Others may take a few pages; a few need whole books.  With more work, one can express ideas in different ways, for more chances to connect to different readers, and attach good descriptors and connections, so that folks searching for such things can find your idea.

The vast majority of intellectual effort, however, is not such “showing”, but instead “sorting” and “shilling.”  Advocates push ideas via repetition, celebrity endorsement, etc., pundits are witty, engaging, elegant, etc, and academics make impressive-looking math models, theorems, data collections, stat studies, prototypes, etc.

When readers have good reasons to think that ideas with certain associations are objectively more true or valuable, I’ll say efforts to create such associations “sort” ideas.  Otherwise, such efforts “shill”, i.e., they direct attention or belief but not preferentially to objectively better ideas.

Now sorting is no doubt a required function — we need to know where to focus attention and belief.  But while intellectuals often suggest that their effort is efficiently directed toward this goal, I am skeptical.  Instead, I suspect audiences of pundits and academics mainly want to affiliate with credentialled-as-impressive folks.  Academics are mainly rewarded for doing impressive-looking idea-work, that can be credentialled as such.  Pundits, wonks, columnists, etc. are similarly rewarded for writing that is witty, engaging, elegant, etc.

Now academics and pundits do sometimes have original ideas and news, and such contributions can add a bit to impressiveness.  And many audiences, all else equal, prefer to hear news.  But mostly the finding and showing of such ideas and news is a side effect of trying to be and affiliate with impressiveness; institutions designed primarily to achieve that function would do it far more effectively.

To me, the great charm of blogging is that I can think about interesting things, have an apparently-original insight about something, and then in a few paragraphs I can show that insight to the world.  If an idea seems especially valuable, I can re-express it again in future posts, to better explain and index it.

My great anxiety about blogging is my fear that merely-blogged ideas will not get the attention or belief they deserve, if they do not get the usual quality signals, and that if I don’t give my ideas such quality signals, no one will.

I could take a ton of time and effort to give very standard quality signals, but I can only do this for a tiny fraction of my ideas and I might really just be trying to seem impressive.  I could work to make more efficient signals of quality for a selection of my ideas, signals that do indicate their truth or value of an idea, but that do less well at showing impressiveness.  But how many would attend to such signals, and would that be worth the neglect of other insights I could instead find and show via more blogging?

Which of these options is the most fun, and how much do I really care about anything else?  I remain honestly torn and uncertain here.

Added 8a: Both sorting and shilling both have positional aspects that concern me; they both raise ideas only at the expense of other ideas.  Overconfidence could easily trick one into over-estimating the value of such efforts.

School Is Not Healthy

Better educated folks are healthier, but they would be just as healthy with less school:

There is a strong, positive and well-documented correlation between education and health outcomes. There is much less evidence on the extent to which this correlation reflects the causal effect of education on health – the parameter of interest for policy. … Our approach exploits two changes to British compulsory schooling laws that generated sharp differences in educational attainment among individuals born just months apart. … We confirm that the cohorts just affected by these changes completed significantly more education than slightly older cohorts subject to the old laws. However, we find little evidence that this additional education improved health outcomes or changed health behaviors.

Shut Up Or Else

The overwhelmingly liberal tilt of university professors has been explained by everything from outright bias to higher I.Q. scores. … A pair of sociologists think they may have an answer: typecasting. … The academic profession “has acquired such a strong reputation for liberalism and secularism that over the last 35 years few politically or religiously conservative students, but many liberal and secular ones, have formed the aspiration to become professors,” they write in the paper, “Why Are Professors Liberal?” That is especially true of their own field, sociology. … To Mr. Gross, accusations by conservatives of bias and student brainwashing are self-defeating. “The irony is that the more conservatives complain about academia’s liberalism,” he said, “the more likely it’s going to remain a bastion of liberalism.”

More here.  ”Shut up about this imbalance or it’ll be worse.”  Can you imagine a sociologist recommending this response to a huge imbalance elsewhere, say a [disapproved] gender, ethnic, or sexual preference imbalance among executives, top colleges, country clubs, or political offices?   But when it comes to imbalances in their own profession, …  HT Tyler.

Big Questions

When young, I imagined that the giants of the intellectual world would be found chipping away at our deepest most important questions.  Sure perhaps most intellectuals would work on practical problems with paying customers, or do less glorious but needed ground work, but the best and the brightest would focus on combining that ground work into deep answers.  Aspiring to high status, I also tried to identify and chip away at deep questions.

Imagine how strange, then, the real world seems to me.  For example, Caltech prof and top science blogger Sean Carroll publishes a well-written book, From Eternity to Here, arguing for his explanation for the arrow of time, clearly one of our deepest questions.  Yet not only are such attempts rare, they get surprising little engagement.  Of the fourteen other blurbs, reviews, and articles (besides mine) listed at the book website, none express an opinion on whether Carroll’s answer is right, much less offer reasons for such an opinion.  Of the six Amazon reviews, two do express an opinion, one by complete-crank Ranger McCoy, and one by Lubos Motl, who says there is no arrow of time problem.  I also found a review by Peter Woit, who rejects the whole idea of a multiverse.  Geez, what does it take to get serious engagement of a proposed answer to a deep question?

If you search for “arrow of time” or “origin time asymmetry” at arxiv.org you’ll find a smattering of papers, but almost no one makes the subject their main focus.  In our real intellectual world, smart ambitious folks find it far easier to signal their ability by working on more mundane ground work or practical questions.  So only a crank focuses their effort on a deep question, inducing people afraid of being confused with cranks to be careful to avoid such questions.  Super bigshots sometimes counter-signal, rambling on about such topics without having given them much thought, just to show that they can.

Kudos to Sean for bucking the trend, and I hope he gets more serious engagement sometime soon.  As I said, his story is consistent, if speculative:

Many of these are far-from-proven conjectures, but still it does all hold together. … Even so, it is very hard to over-emphasize just how far one must project current physics beyond the accuracy with which we have verified it to talk about tiny new universes popping out of quantum fluctuations in empty space at 10-29K.

In the social sciences books that propose answers to deep questions do at least get reviews that engage those proposed answers.  Is that because we actually care more about social science questions?

Student Idealism

We commonly rank motives from high to low, and distinguish “cynics,” who ascribe low motives to common behaviors, from “idealists,” who ascribe high motives. Official propaganda tends to be idealistic, including what we teach in schools. While basic concepts in economics and sociobiology can be understood at young ages, we teach them much later. This isn’t an accident:

Sarah Hrdy … questioned “whether sociobiology should be taught at the high-school level … The whole message of sociobiology is oriented toward the success of the individual. … Unless a student has a moral framework already in place, we could be producing social monsters by teaching this.”

Also:

Cynical descriptive conclusions about behavior in government threaten to undermine the norm prescribing public spirit. The cynicism of journalists – and even the writings of professors – can decrease public spirit simply by describing what they claim to be its absence.

Many say we are better off training kids to help others, even if we have to lie and suggest most folks do this.  Nietzsche said “society encourages self-sacrifice because the unselfish sucker is an asset to others.”  But this theory suggests local temptations to defect; I would want your kids, but not mine, to be taught to help others.  Instead, however, we see parents pushing their own kids to be taught idealism.  Why?

One reason I think is that moderate idealism is an attractive feature of potential associates; it suggests they will be helpful and cooperative to associates. For example:

Not to be a socialist at twenty is proof of want of heart; to be one at thirty is proof of want of head. Georges Clemenceau Continue Reading "Student Idealism" »