Saturday, March 3

Scientific bias

John Ioannidis of the University of Ioannina in Greece offered mathematical "proof" that most published research results are wrong. Now, statisticians using similar methods found—not surprisingly—that the more researchers reproduce a finding, the better chance it has of being true...

Using simple statistics, without data about published research, Ioannidis argued that the results of large, randomized clinical trials—the gold standard of human research—were likely to be wrong 15 percent of the time and smaller, less rigorous studies are likely to fare even worse.

Among the most likely reasons for mistakes, he says: a lack of coordination by researchers and biases such as tending to only publish results that mesh with what they expected or hoped to find.
Yes, I know that
The odds that a finding is correct increase every time new research replicates the same result, according to a study published in the current PLoS Medicine.
But the trouble is people trumpet the initial findings.

No comments: