Tag Archives: Personal

Debating Yudkowsky

On Wednesday I debated my ex-co-blogger Eliezer Yudkowsky at a private Jane Street Capital event (crude audio here, from 4:45; better video here [as of July 14]).

I “won” in the sense of gaining more audience votes — the vote was 45-40 (him to me) before, and 32-33 after the debate. That makes me two for two, after my similar “win” over Bryan Caplan (42-10 before, 25-20 after). This probably says little about me, however, since contrarians usually “win” such debates.

Our topic was: Compared to the farming and industrial revolutions, intelligence explosion first-movers will quickly control a much larger fraction of their new world. He was pro, I was con. We also debated this subject here on Overcoming Bias from June to December 2008. Let me now try to summarize my current position.

The key issue is: how chunky and powerful are as-yet-undiscovered insights into the architecture of “thinking” in general (vs. on particular topics)? Assume there are many such insights, each requiring that brains be restructured to take advantage. (Ordinary humans couldn’t use them.) Also assume that the field of AI research reaches a key pivotal level of development. And at that point, imagine some AI research team discovers a powerful insight, and builds an AI with an architecture embodying it. Such an AI might then search for more such insights more efficiently than all other the AI research teams who share their results put together.

This new fast AI might then use its advantage to find another powerful insight, restructure itself to take advantage of it, and so on until it was fantastically good at thinking in general. (Or if the first insight were super-powerful, it might jump to this level in one step.) How good? So good that it could greatly out-compete the entire rest of the world at the key task of learning the vast ocean of specific knowledge and insights useful for functioning in the world. So good that even though it started out knowing almost nothing, after a few weeks it knows more than the entire rest of the world put together.

(Note that the advantages of silicon and self-modifiable code over biological brains do not count as relevant chunky architectural insights — they are available to all competing AI teams.)

In the debate, Eliezer gave six reasons to think very powerful brain architectural insights remain undiscovered:

  1. Human mind abilities have a strong common IQ factor.
  2. Humans show many specific mental failings in reasoning.
  3. Humans have completely dominated their chimp siblings.
  4. Chimps can’t function as “scientists” in human society.
  5. “Science” was invented, allowing progress in diverse fields.
  6. AGI researchers focus on architectures, share little content.

My responses: Continue reading "Debating Yudkowsky" »

GD Star Rating
loading...
Tagged as: , ,

Me on Freakonomics

For five minutes near the end (48:45 to 53:45) of this hour long Freakonomics radio show on “The Folly of Prediction,” I discuss promising applications of prediction markests. We end it this way:

Dubner: So that sounds very logical, very appealing; how realistic is it?

Hanson: Well it depends on there being a set of customers who want this product. So, you know, if prediction markets have an Achilles heel it is certainly the possibility that people don’t really want accurate forecasts.

GD Star Rating
loading...
Tagged as: ,

NYC Meetup Tuesday 7p

I’ll be in New York City this Tuesday evening 7-11p, at 60 West 23rd Street, Apt. 904. Katja Grace of Meteuphoric will atttend and my esteemed ex-co-blogger Eliezer Yudkowsky, now at Less Wrong, plans to join us later. Please join us if you can.

Added 29June: Meetup was great; thanks to all ~50 of you for coming, and to our hosts for hosting.

GD Star Rating
loading...
Tagged as:

Wolfers Gets Loopy

Over the years I’ve not only met folks who do drugs, I’ve met folks who’ve had deep mystical experiences on drugs. They have told me that their drug experiences made them feel sure the physical world we see around us just can’t be all there is — they’ve touched something deeper and more important. When asked how exactly a weird drug experiences could possibly count as evidence on basic physics, they have little coherent to say. It seems their subconscious just told them this abstract conclusion, and they can’t not believe a cocksure subconscious. Even one on drugs.

Druggies might say such things in private, but it is much rarer to hear a professional physicist say them in public. Odd then to hear professional economist Justin Wolfers say his near-mystical parenting experience makes him doubt standard econ:

I learned economics in my twenties, before I became a dad. … Hard math and complex models … exploring the basic idea … that people are purposeful, analytic decision makers. … I had always believed in the analytic self; I was rational, calculating, and tried to make smart decisions. Of course real people don’t use math, but I figured that we’re still weighing costs and benefits just as our models say. …

Today, I’m not so sure. My feelings toward my daughter Matilda aren’t easily expressed in analytic terms. … Her laugh is the greatest joy, and it thrills me that she shares it with me. … She’s central not only to my life, but to who I am. There’s something new and strange about all this. Today, I feel the powerful force of biology. It’s visceral; it’s real; it’s hormonal, and it’s not in our economic models. I’m helpless in the face of feelings that overwhelm me.

Yes, I know that a twenty-something reader will cleverly point out that I just need to count kids as a good which yields utility, or perhaps we need to add a state variable to the utility function as in rational addiction models. But that’s not the point. I’m surprised by how little of this I’ve consciously chosen. While the economic framework accurately describes how I choose an apple over an orange, it has had surprisingly little to say about what has been the most important choice in my life.

I’m a committed neoclassical economist. … But what kind of economists would we be if we learned our economics only after we were parents? It’s an interesting thought experiment, and truth is, I don’t know the answer. … Slivers of evidence—my own introspection, conversations with other economist-parents … —all tell me that it would be different. (more)

I don’t need to speculate – I am exactly that kind of economist. I started econ grad school with two kids, ages 0 and 2, and had no undergrad econ. I’ve seen a lot of the parenting cycle – my youngest graduates from high school tomorrow. My kids are central to who I am, and I’ve known well feelings that are visceral, hormonal, and that overwhelm me.

But none of that makes me doubt the value of neoclassical econ. How could it? First, econ makes sense of a complex social world by leaving important things out, on purpose – that is the point of models, to be simple enough to understand. More important, econ models almost never say anything about consciousness or emotional mood – they don’t at all assume people choose via a cold calculating mindset, or even that they choose consciously.  As long as choices (approximately) fit certain consistency axioms, then some utility function captures them.  So how could discovering emotional and unconscious choices possibly challenge such models?

Having an emotional parenting experience is as irrelevant to the value of neoclassical econ as having a mystical drug experience is to the validity of basic physics. Your subconscious might claim otherwise, but really, you don’t have to believe it.

Added 11p: Wolfers is usually an excellent economist, and here he seems to realize he is acting a bit loopy. This suggests a “religious” scenario, where someone tries to show devotion via a willingness to believe extreme things. Wolfers feels a new strong attachment to his family, and shows it by a willingness to change related beliefs in an extreme way. Being an economist, one of the biggest beliefs he can sacrifice on this altar is his belief in the standard economic framework. So Wolfers says that his new family attachment has made him question this framework.

Added 22June: Wolfers responds here.

GD Star Rating
loading...
Tagged as: , ,

Seeking Alien Trash

I was interviewed by Seth Shostak (minutes 15:45 to 23:00 of this show) on possible observational consequences of my game theory model of interstellar colonization. (Previous posts on this here, here, here.)

The bottom line is that even if an alien colonization wave once passed this way, our astronomical theory and observation abilities are probably still just too weak to see the telltale signs of such a wave.

GD Star Rating
loading...
Tagged as: ,

First Cryonics Hour

Me two years ago:

I hereby offer to talk for one hour on any subject to anyone who can show me they’ve newly signed up for cryonics. You can record the conversation, publish it, and can sell your time to someone else.

Stuart Armstrong has signed up for cryonics, and then redeemed my offer. Congrats Stuart! We talked for an hour, and he recorded the conversation. If he does something with that recording, I’ll post a link here.

Any other takers?

GD Star Rating
loading...
Tagged as: ,

Beware Men With Sticks

menwithsticks
Credit: Tom Munnecke

GD Star Rating
loading...
Tagged as:

5 Million Visits

Today we had our five millionth visit to Overcoming Bias, at least as measured by sitemeter. Woo and hoo … :)

GD Star Rating
loading...
Tagged as: ,

How US States Vary

Ken Lee just recieved his Ph.D. in economics from GMU; I was his thesis advisor; his thesis is here. I am impressed enough with Ken’s thesis that I’ll take the next few posts to describe some of his main findings.  The first finding I’ll describe: The main way that US states vary is in their health.

Ken collected 81 features of states, 56 cultural rankings and 25 demographic variables (listed below), and did a factor an analysis on them.  A factor analysis finds a few linear combinations of features that can explain the most variance in whole set of features; the variation of all the features could result from variation in just a few behind-the-scenes factors, plus error.

The biggest factor, explaining 27% of the variance between US states, was health – some states are just healthier than others, and this fact can explain many other things about those states.  Here are the three biggest factors:

  1. (27% of variance): Top five features: “low cancer deaths, low cardiovascular deaths, low smoking rates, low levels of unnecessary medical care, low obesity rates,” Also: “high well-being index, high exercise rates, healthiest, low mortality rates for blacks and whites, higher in education (IQ Rank, Percentage of Graduates, and Smartest), higher in health (Healthiest, Exercise Frequency, and Percentage with No Insurance), and lower in crime rates (Crime Rate and Violent Crime Rate) rankings.” Map: Factor 1
  2. (15% of variance): Top five features: “low occupational death rates, high in women’s rights, high in primary care physicians per capita, high in amount of fruit eaten per capita, low in percentage on poverty.” Also: “low in teen births, high on $ spent on K-12 education, high $ for teacher salaries, smartest … a higher percentage of people in the 25-44 age group, higher income, high college graduation rate, and higher urbanization.” Map:
    Factor 2
  3. (14% of variance): Top five features: “low rates of infections (HIV, STD), high in IQ, low overall crime rates, high in graduates, low in those having no health insurance.” Also: “low in violent crime, healthiest, low in percentage urban … regular church attendance, a high regard for religion, worse overall state economic health, high manufacturing employment, and high farming output.” Map: Factor 3

To me, factor 1 seems mainly about health, factor 2 seems about left (~forager) idealism  – fruit, women’s rights, safety rules, helping the poor, and spending lots on docs and teachers — and factor 3 seems about right (~farmer) idealism — rural, religious, low crime, sexual restraint, make real stuff, finish what you start.

The fact that health is the biggest factor says that health is very important, even beyond its direct benefits. And the fact that health and a tendency to spend on docs are largely independent says that medicine isn’t very important for health, and there should be enough variation among states to study just how important it is.

Here are those 81 state features:

Continue reading "How US States Vary" »

GD Star Rating
loading...
Tagged as: , ,

Two Recent Talks

  1. On April 27, I talked at Harvard Business School on information accounting: audio, slides.
  2. On May 5, I talked in Geneva on the economics of artificial intelligence: audio, slides.
GD Star Rating
loading...
Tagged as: