Discussion about this post

User's avatar
Overcoming Bias Commenter's avatar

Shouldn't only asking the questions you expect to give a positive answer be considered a kind of bias? Not one that merits some sort of punishment, but a bias nonetheless.

Expand full comment
Overcoming Bias Commenter's avatar

RE the meta-finding that sponsored drug studies more frequently have positive answers regarding the treatments of the sponsors - this not necessarily indicative of twisting the truth and is better explained as a form of editorial control over research questions. That is, if you spend money developing a drug, you're going to try to develop uses of it that you have a pretty good feeling in advance WILL WORK, and you'll ask limited questions appropriate to that. You can have a better than 50% sense of whether something will work before you investigate it with rigor to get a MUCH better than 50% answer that it works. So I would argue the effect we're seeing is more the result of conservative investigations than bias, and this is not inappropriate. But it's worth thinking of ways to distinguish the two possibilities.

Expand full comment
13 more comments...

No posts

Ready for more?