Category Archives: Academia

Top Teachers Ineffective

Yesterday I reported that top med school docs are no healthier for patients.  Today I report that even at private schools, teachers who are fully certified do not help students perform any better on math and science tests: 

Data from the National Education Longitudinal Survey of 1988 (NELS:88) were used to investigate the effect of teacher licensure status on private school students’ 12th grade math and science test scores. This data includes schooling and family background information on students that can be linked to employment information on teachers. We find that, contrary to conventional wisdom, private school students of fully certified 12th grade math and science teachers do not appear to outperform students of private school teachers who are not fully certified.

My urban econ text says:

Studies have consistently shown that graduate coursework (e.g., a Master’s degree) does not affect teacher productivity.

I expect patients are willing to pay more for top med school docs, and parents are willing to pay more for educated and certified teachers.  And I expect that this would continue even if patients and parents knew the above results.  I suspect most of the demand for teachers, doctors, and many other professionals comes from folks wanting to affiliate with certified-as-impressive people.  And merely making patients healthier or making students perform better doesn’t count much toward impressiveness, relative to academia-certified impressiveness.   

But folks don’t like to admit this directly; they’d rather pretend they care more than they do about other outputs.  Which is why folks don’t want to hear about the above results.  The media will oblige them, and so they will continue in their preferred delusions.  Bet on it. 

Added: James Hubbard points us to a related critique of MBA training.

GD Star Rating
Tagged as:

Anthropology Patrons

Academic anthropology is funded by many organizations, including the Wenner-Gren Foundation, the National Geographic Society, the Templeton Foundation, and much more.  A few like NSF may commit to strictly using peer review, but most use their own judgement to pursue their own agendas.  Apparently that is mostly fine with anthropologists, except if the patron is the US military:

The Pentagon’s $50 million Minerva Research Initiative, named after the Roman goddess of wisdom and warriors, will fund social science research deemed crucial to national security. … the research would not be kept secret. … Gates said Minerva would solicit diverse views, regardless of whether they are critical of the military. … “This is the first significant effort in 30 or 40 years to engage social sciences on a large scale by the Department of Defense” …

Continue reading "Anthropology Patrons" »

GD Star Rating
Tagged as:

The Comedy of Behaviorism

Followup toHumans in Funny Suits

"Let me see if I understand your thesis.  You think we shouldn’t anthropomorphize people?"
        — Sidney Morgenbesser to B. F. Skinner

Behaviorism was the doctrine that it was unscientific for a psychologist to ascribe emotions, beliefs, thoughts, to a human being.  After all, you can’t directly observe anger or an intention to hit someone.  You can only observe the punch.  You may hear someone say "I’m angry!" but that’s hearing a verbal behavior, not seeing anger.  Thoughts are not observable, therefore they are unscientific, therefore they do not exist.  Oh, you think you’re thinking, but that’s just a delusion – or it would be, if there were such things as delusions.

Continue reading "The Comedy of Behaviorism" »

GD Star Rating

Variance-Induced Test Bias

Discussion of the Science article on gender differences in math test variance got me thinking.  Since a test score is a noisy measure of some underlying ability, an unusually high score can come either from an unusual high ability, or from an unusually positive measurement error (or both).  If higher male score variance is due more to a higher male ability variance than to a higher male measurement error variance, then a high female score is more likely to be due to measurement error than is the same high male score.  If so, treating the same score value as the same ability, independent of gender, as is common in school admissions, creates a bias (vs. men) in favor of high scoring, and against low scoring, women.

More precisely, assume that each test score s is a sum s = a + e of an ability a and a measurement error e, and that ability and measurement error are normally and independently distributed with variances A and E.  This implies test score variance is S = A + E, and that mean (and median) ability estimates given scores s are E[a|s] = m+(s-m)*(1-E/S), where m is the mean score.  The discounting factor, 1-E/S, is between 0 and 1.

Now assume men and women have the same mean score m and measurement error variance E, let R be the ratio of male to female score variance, and let N be the ratio of measurement error variance E to female score variance.  In this case, the ratio of female to male discounting factors is (1-N)/(1-N/R), which is < 1 for R > 1.   For example, if R = 1.16, the mid-estimate from the Science article, then for error fraction N values of 0.1, 0.2, or 0.4, the discounting factor ratios are 0.985, 0.967, or 0.916 — female scores must be discounted by these factors (relative to mean scores) to be fairly comparable to male scores.  For example, applied to the math SAT (female mean 504) you’d want to subtract off (again for my sample N values) 3.7, 8.2, or 20.7 points from a 750 point female SAT score to make it comparable to a male score.  (For a 600 point score, you’d subtract 1.5, 3.2, or 8.1 points). 

No doubt there are many other factors to consider in comparing male and female candidates, but do any schools make such corrections?  Are they even aware of this bias?  Are they aware but uninterested in correcting for it?

Added 4Aug: College Admission Futures would solve this problem and many more.

GD Star Rating
Tagged as: ,

Biases of Elite Education

From a thoughtful essay by William Deresiewicz:

An elite education … makes you incapable of talking to people who aren’t like you. Elite schools pride themselves on their diversity, but that diversity is almost entirely a matter of ethnicity and race. With respect to class, these schools are largely – indeed increasingly – homogeneous.  … My education taught me to believe that people who didn’t go to an Ivy League or equivalent school weren’t worth talking to, regardless of their class. … Elite universities … select for and develop one form of intelligence: the analytic. … social intelligence and emotional intelligence and creative ability, to name just three other forms, are not distributed preferentially among the educational elite. … There are due dates and attendance requirements at places like Yale, but no one takes them very seriously. … Students … get an endless string of second chances. Not so at places like Cleveland State.  ..

Continue reading "Biases of Elite Education" »

GD Star Rating
Tagged as:

Idea Futures In Lumpaland

Continuing the parable

Dragon markets were an exciting new fad in Lumpaland – any Oopma could bet valued cocoa beans on dragon locations, lifespans, and victim counts, and on how these might change with anti-dragon policies.  At first, instituters and amateurs both tended to dismiss markets that disagreed with favored estimates.  But as dragon markets accumulated an impressive track record, Oopmas slowly became more reluctant to disagree.  Dragon policy became better informed, more dragons were dispatched, and eventually some funds were even diverted from the institute to subsidize dragon markets. 

Yet while some instituters and amateurs came to specialize in dragon market trading, most continued with previous activities.  Most amateurs found it too tedious to specialize on particular dragons to the degree required to win bets – witty widely-read amateurs were invited to more parties.  And most instituters found that winning in the markets just did not impress to the same degree – most audiences preferred eloquence, gadgets, and math as signals of personal impressiveness. 

Prediction markets have great potential to improve info in science and business, but they’ll only go as far as demand for such info.  To the extent we really care more about affiliating with impressive folks, we’ll prefer activities and institutions that better achieve this end. 

GD Star Rating
Tagged as: ,

Do Scientists Already Know This Stuff?

Followup toScience Isn’t Strict Enough

poke alleges:

"Being able to create relevant hypotheses is an important skill and one a scientist spends a great deal of his or her time developing. It may not be part of the traditional description of science but that doesn’t mean it’s not included in the actual social institution of science that produces actual real science here in the real world; it’s your description and not science that is faulty."

I know I’ve been calling my younger self "stupid" but that is a figure of speech; "unskillfully wielding high intelligence" would be more precise.  Eliezer18 was not in the habit of making obvious mistakes – it’s just that his "obvious" wasn’t my "obvious".

No, I did not go through the traditional apprenticeship.  But when I look back, and see what Eliezer18 did wrong, I see plenty of modern scientists making the same mistakes.  I cannot detect any sign that they were better warned than myself.

Sir Roger Penrose – a world-class physicist – still thinks that consciousness is caused by quantum gravity.  I expect that no one ever warned him against mysterious answers to mysterious questions – only told him his hypotheses needed to be falsifiable and have empirical consequences.  Just like Eliezer18.

Continue reading "Do Scientists Already Know This Stuff?" »

GD Star Rating

Lumpaland Parable

Once upon a time …

Before Willy Wonka came to Lumpaland, hundreds of fierce dragons preyed on ten thousand Oompa Loompas and other wildlife.  A thousand Oopmas tried in their free time to oppose dragons, and a hundred had full time jobs at the Dragon Institute. 

Instituters were impressive – they had charisma, spoke eloquently, made cool devices and mastered hard math.  Others wanted to read about, sleep with, and study under them.  At any one time only a few instituters were out near dragons, usually at a safe distance, focused on a few relatively-safe dragons.  Some complained instituters were too distracted playing institute politics and trying to seem impressive.  But when Oopmas had to choose between an instituter and an amateur, the instituter usually won.

Amateurs were mostly content to read and argue.  And their readings and conversations rarely lingered long on one dragon.  While instituters focused on particular dragons, amateurs prided themselves on having passionate witty opinions on many dragons.  Amateurs were eager to associate with instituters, even as they complained instituters unfairly neglected their writings and favorite dragons.

The few amateurs who focused on particular dragons were considered boring, and amateurs who actually fought dragons were considered dangerous, to be avoided.  If an amateur actually managed to dispatch a dragon, the Oompas nearby trusted to report on the incident were usually instituters, who would if possible take full credit.  (If the amateur’s role could not be denied, he’d be thanked for his lucky assistance to the institute’s grand plan. To get more recognition, he’d have to dispatch several dragons or join the institute.)

Question: Biases afflict both amateur and instituter dragon judgments. Perhaps do-nothing amateurs are less biased, but so what?  Isn’t it do-somethings’ opinions that matter?

Added 16May: This story was inspired seeing amateurs indignant that professionals do not engage their brief writings on difficult complex topics (e.g., many worlds, zombies, Fermi question, nano/robot econ, disagreement, market manipulation).

GD Star Rating
Tagged as:

Science Doesn’t Trust Your Rationality

Followup toThe Dilemma: Science or Bayes?

Scott Aaronson suggests that Many-Worlds and libertarianism are similar in that they are both cases of bullet-swallowing, rather than bullet-dodging:

Libertarianism and MWI are both are grand philosophical theories that start from premises that almost all educated people accept (quantum mechanics in the one case, Econ 101 in the other), and claim to reach conclusions that most educated people reject, or are at least puzzled by (the existence of parallel universes / the desirability of eliminating fire departments).

Now there’s an analogy that would never have occurred to me.

I’ve previously argued that Science rejects Many-Worlds but Bayes accepts it.  (Here, "Science" is capitalized because we are talking about the idealized form of Science, not just the actual social process of science.)

It furthermore seems to me that there is a deep analogy between (small-‘l’) libertarianism and Science:

  1. Both are based on a pragmatic distrust of reasonable-sounding arguments.
  2. Both try to build systems that are more trustworthy than the people in them.
  3. Both accept that people are flawed, and try to harness their flaws to power the system.

Continue reading "Science Doesn’t Trust Your Rationality" »

GD Star Rating

The Failures of Eld Science

Followup toInitiation Ceremony, If Many-Worlds Had Come First

This time there were no robes, no hoods, no masks.  Students were expected to become friends, and allies.  And everyone knew why you were in the classroom.  It would have been pointless to pretend you weren't in the Conspiracy.

Their sensei was Jeffreyssai, who might have been the best of his era, in his era.  His students were either the most promising learners, or those whom the beisutsukai saw political advantage in molding.

Brennan fell into the latter category, and knew it.  Nor had he hesitated to use his Mistress's name to open doors.  You used every avenue available to you, in seeking knowledge; that was respected here.

"- for over thirty years," Jeffreyssai said.  "Not one of them saw it; not Einstein, not Schrödinger, not even von Neumann."  He turned away from his sketcher, and toward the classroom.  "I pose to you to the question:  How did they fail?"

The students exchanged quick glances, a calculus of mutual risk between the wary and the merely baffled.  Jeffreyssai was known to play games.

Continue reading "The Failures of Eld Science" »

GD Star Rating