Philip Tetlock’s Long Now Talk

Philip Tetlock, author of the book Expert Political Judgment, gave a talk a couple of weeks ago for the Long Now Foundation’s Seminars about Long-Term Thinking.  I listened to the podcast.  Tetlock has been collecting expert’s judgements for a couple of decades in order to evaluate what makes it possible for people to make good predictions.

The only attribute of a person’s outlook that seems to correlate with better prediction ability is having an eclectic outlook; what Tetlock calls being a fox rather than a hedgehog from Archilochus’ phrase, "The fox knows many things, but the hedgehog knows one big thing." Foxes are less likely to make extreme predictions, but when they do, they’re better calibrated.

There were a couple of interesting questions, which are worth mentioning because you won’t find the material in the book.  At about 47 minutes, Stewart Brand asks whether any of the experts were notably better than the others.   Tetlock responds that no one in is sample was reliably right, and then volunteers that there are mechanisms that improve people’s performance.  Brand and Tetlock continue to talk about prediction markets and Surowiecki’s Wisdom of Crowds and how aggregation helps improve forecasts, particularly when there are significant numbers of Hedgehogs in the sample.

At the end of the Q&A, Brand pressed Tetlock pretty hard to give his assessment of the expert’s views of the state of events in Iraq.  Worth listening to, whatever your views.

GD Star Rating
loading...
Tagged as:
Trackback URL:
  • Ben Hill

    Another person that I think would interest people reading this blog.

    NASSIM NICHOLAS TALEB
    en.wikipedia.org/wiki/Nassim_Taleb

    edge.org/3rd_culture/bios/taleb.html

    He is especial good at finacial skepticism and people who make finacial prediction.

  • eric

    What’s funny is that he assumes that Gorbachev was going to liberalize the Soviet Union irrespective of what Reagan was doing…but that’s an aside

  • http://pancrit.org Chris Hibbert

    Hmm. My recollection from the talk was that he said that one study group (at Exxon/Mobile?) had done a bunch of scenarios, and identified the rise of Gorbachev as an early indicator that liberalization was coming. That sounds prescient to me, but I find it plausible that Soviet watchers of the day could have figured it out. I’d guess Tetlock wouldn’t have brought it up if it wasn’t verifiable from some public record somewhere.