Comments on: Why so little model checking done in statistics? http://www.overcomingbias.com/2007/09/one-thing-that.html Overcoming Bias is economist Robin Hanson’s blog, on honesty, signaling, disagreement, forecasting, and the far future. Sat, 11 Feb 2012 22:21:13 +0000 hourly 1 http://wordpress.org/?v=3.1.3 By: Deus Ex Macchiato » Model risk in economics and finance http://www.overcomingbias.com/2007/09/one-thing-that.html#comment-433560 Deus Ex Macchiato » Model risk in economics and finance Sun, 27 Sep 2009 09:58:36 +0000 http://prod.ob.trike.com.au/2007/09/why-so-little-model-checking-done-in-statistics.html#comment-433560 [...] at Overcoming Bias, there is a discussion of model checking in the economics literature: One thing that bugs me is that there seems to be so little model checking done in statistics. [...] [...] at Overcoming Bias, there is a discussion of model checking in the economics literature: One thing that bugs me is that there seems to be so little model checking done in statistics. [...]

]]> By: Hopefully Anonymous http://www.overcomingbias.com/2007/09/one-thing-that.html#comment-415160 Hopefully Anonymous Sun, 23 Sep 2007 17:56:03 +0000 http://prod.ob.trike.com.au/2007/09/why-so-little-model-checking-done-in-statistics.html#comment-415160 g, I think my post reflects awareness of that possibility. My request to Andrew in my September 22, 2007 at 01:27 PM post stands. Readers (Andrew included) can make their own judgments as to the merit of my request. g, I think my post reflects awareness of that possibility. My request to Andrew in my September 22, 2007 at 01:27 PM post stands. Readers (Andrew included) can make their own judgments as to the merit of my request.

]]> By: g http://www.overcomingbias.com/2007/09/one-thing-that.html#comment-415159 g Sun, 23 Sep 2007 15:48:34 +0000 http://prod.ob.trike.com.au/2007/09/why-so-little-model-checking-done-in-statistics.html#comment-415159 HA, you might be seeking status without consciously seeking status. I think Eliezer's question meant "are you sure you aren't fooling yourself?" rather than "are you sure you aren't lying to us?". HA, you might be seeking status without consciously seeking status. I think Eliezer’s question meant “are you sure you aren’t fooling yourself?” rather than “are you sure you aren’t lying to us?”.

]]> By: Hopefully Anonymous http://www.overcomingbias.com/2007/09/one-thing-that.html#comment-415158 Hopefully Anonymous Sun, 23 Sep 2007 15:28:27 +0000 http://prod.ob.trike.com.au/2007/09/why-so-little-model-checking-done-in-statistics.html#comment-415158 Eliezer, haha. My internal sense is that I'm seeking persistence, and that rationally status-seeking behavior on my part should be completely subordinate to that goal. Eliezer,
haha.
My internal sense is that I’m seeking persistence, and that rationally status-seeking behavior on my part should be completely subordinate to that goal.

]]> By: Andrew http://www.overcomingbias.com/2007/09/one-thing-that.html#comment-415157 Andrew Sat, 22 Sep 2007 18:39:22 +0000 http://prod.ob.trike.com.au/2007/09/why-so-little-model-checking-done-in-statistics.html#comment-415157 Eliezer, Yes, that's what I'm talking about. Eliezer,

Yes, that’s what I’m talking about.

]]> By: Eliezer Yudkowsky http://www.overcomingbias.com/2007/09/one-thing-that.html#comment-415156 Eliezer Yudkowsky Sat, 22 Sep 2007 18:01:50 +0000 http://prod.ob.trike.com.au/2007/09/why-so-little-model-checking-done-in-statistics.html#comment-415156 Sounds like a putdown to me, HA. Sure you're not seeking status? Andrew, the sense I know of model checking is the <a href="http://en.wikipedia.org/wiki/Model_checking" rel="nofollow">theorem-proving</a> one, but that's obviously not what you mean here. Googling "data-based model checking" didn't turn up much. The impression I get is that you want the authors to write a simulation which uses the model fitted to the data to output new data, and then graph the new data and the real data side-by-side. Is this correct? Sounds like a putdown to me, HA. Sure you’re not seeking status?

Andrew, the sense I know of model checking is the theorem-proving one, but that’s obviously not what you mean here. Googling “data-based model checking” didn’t turn up much. The impression I get is that you want the authors to write a simulation which uses the model fitted to the data to output new data, and then graph the new data and the real data side-by-side. Is this correct?

]]> By: Hopefully Anonymous http://www.overcomingbias.com/2007/09/one-thing-that.html#comment-415155 Hopefully Anonymous Sat, 22 Sep 2007 17:27:34 +0000 http://prod.ob.trike.com.au/2007/09/why-so-little-model-checking-done-in-statistics.html#comment-415155 Great post, Andrew. I'd like to see more of this from you, and less moralizing or positive self-positioning (particularly of the variety that's not carefully derived from empiricism). I don't think your post in the comments such as "I don't hold meetings to signal my status" add value the way your OP here does. Great post, Andrew. I’d like to see more of this from you, and less moralizing or positive self-positioning (particularly of the variety that’s not carefully derived from empiricism).

I don’t think your post in the comments such as “I don’t hold meetings to signal my status” add value the way your OP here does.

]]>