Malatesta Estimator

We frequently encounter competing estimates of politically salient magnitudes. One example would be the number of attendees at the 1995 “Million Man March”.  Obviously, frequently the estimates emanate from biased observers seeking to create or dispel an impression of strength.  Someone interested in generating a more neutral estimate might consider applying what I would call the Malatesta Estimator, which I have named after its formulator, the 14th Century Italian mercenary captain, Galeotto Malatesta of Rimini (d. abt. 1385). His advice was: “Take the mean between the maximum given by the exaggerators, and the minimum by detractors, and deduct a third” (Saunders 2004).  This simplifies into: the sum of the maximum and the minimum, divided by three.  It adjusts for the fact that the minimum is bounded below by zero, while there is no bound on the maximum.  Of course, it only works if the maximum is at least double the minimum.

In the case of the Million Man March, supporters from the Nation of Islam claimed attendance of 1.5 to 2 million.  The Park Service suggested initially that 400,000 had participated.  The Malatesta Estimator therefore yields an estimate of 800,000.  We can calibrate this by comparing it with an estimate by Dr. Farouk El-Baz and his team at the Boston University Remote Sensing Lab.  Dr. El-Baz and his team used samples of 1 meter square pixels from a number of overhead photos to estimate the density per pixel, and then calculated an estimate for the entire area.  Their estimate was 837,000, with 20% error bounds giving a range from 1 million to 670,000.

Saunders, Frances Stonor. 2004. The Devil’s Broker: Seeking Gold, God, and Glory in Fourteenth-Century Italy. (New York: HarperCollins), p. 93.

BU Remote Sensing Lab Press Release: http://www.bu.edu/remotesensing/Research/MMM/MMMnew.html

Accessed 14 December 2006.

GD Star Rating
loading...
Tagged as: , ,
Trackback URL:
  • http://procurementinvestor.blogspot.com/ David Rotor

    Shh. This is prime time recruiting for MBA grads, and the consultancies, I-banks, and fund managers are busily putting their candidates through “case” interviews and the such. “How many phone booths are there in New York? What’s the market size for iPods in Mexico? I’d estimate that the chance a MBA grad is going to use the phrase “Malatesta Estimator” in an interview tomorrow is about 100%.

    PS – I conned a friend into giving me a guess of 25%. Yes, that means it’s likely that there is a 42% probability of the phrase being used tomorrow.

    Cheers!

    David Rotor

  • http://www.aleph.se/andart/ Anders Sandberg

    Googling, I just found one application, estimating the amount of Venezuelan oil:
    http://fallbackbelmont.blogspot.com/2006/01/venezuela-and-peak-oil.html

    It seems to work well. Given the initial numbers in this article (30-50,000 vs 200,000) and the estimate based on occupation density (60,000) the estimator does well (76,000).
    http://dir.salon.com/story/news/feature/2003/01/24/crowds/index.html

    I wonder for what probability distributions of variables and claims the estimator works best? If the minimum is K1 times the variable and the maximum is K2 times, the estimator becomes unbiased when K1+K2=3. Do we have any reason to think that this is a common occurence? In the above examples K1=~0.5, K2=~2 and K1=~0.5,K2=~6.

  • http://profile.typekey.com/tschoegl/ Adrian Tschoegl

    David: I teach at a B-school and am responsible in a very small way for loosening those hordes. Unfortunately, the subject I teach, management, doesn’t really lend itself to the dissemination of the Malatesta Estimator. I will have to proseltyize among some of my colleagues so that I can drive the probability to 1.
    Anders: I am uncomfortable using the term “probability distribution” with respect to the data to which one would apply the estimator. The data we observe are subjective estimates where the persons making the estimate have vested interests in the magnitude of their estimates, and are not using a neutral methodology. In the oil case you linked to, I noticed that in most cases the estimates would not have met the criterion that K2 be equal to or greater than K1. In fact, they were often quite close, presumably because all parties were geologists using standard textbook methods. In the crowd estimation case the estimator worked, at least before some proponents decided to come up with absurd estimates. I guess the Malatesta requires biased estimates not totally out of touch with reality.

  • http://www.aleph.se/andart/ Anders Sandberg

    If I want to convince you that there were many supporters at my latest rally for protection of footnotes, I cannot name an arbitrarily high number. You have a prior estimate of how likely the size would be (given the issue), and at some point the probability that my claim is just a lie will become significantly larger than the probability that the claim is true. So I should ideally keep below this number if I want to be believed.

    Maybe we can estimate my believability as the ratio between the probability of the claimed size and the probability of a lie. If the later is constant, my most believable claim should be what maximizes your prior. But to me, I want to maximize the believability *and* claimed number. A reasonable strategy might be to maximize the number times believability, i.e. x*P(x demonstrators|I claim y, your priors). If you deduce this, you will revise your estimate downwards, and so on. I think this can be solved for a given initial probability distribution of demonstration sizes (say a lognormal). Similarly fro deliberate underestimations.

  • http://profile.typekey.com/tschoegl/ Adrian Tschoegl

    Anders, you are probably right if we can limit our Max and Min estimates to people who are acting rationally. There are complications though. One is pronouncements by persons who seek to be dramatic and have no concern with being believed. A second issue is the problem of “many” or “gazillions”. In the Bible and the Middle East one finds frequent use of the number 40, e.g., Ali Baba and the Forty thieves, Moses wandering in the desert for 40 years, 40 paras equals one piastre, etc. Possibly or apparently in some ur-Semitic language the word for 40 and the word for myriad sounded alike, perhaps modulo vowels. Some size estimates may be nothing more than a loose way of saying many, many, many supporters. I suspect that in these cases something like a Benford’s Law will be at work, so that we get disproportionately many estamiates that begin with the number 1, i.e., one hundred, one thousand, etc.