Study: Scientists ask statisticians to fudge results

You won’t believe the things scientists ask statisticians to do.

When statisticians responded to a survey about the kinds of requests they received from biomedical scientists, a number of them reported “inappropriate requests” like throwing out or ignoring inconvenient data points and otherwise finding ways to make things look like the scientist got a desired result, rather than the truth.

The survey was created by an epidemiologist at NYU, who, according to a story in the CBC, was shocked when a statistician told him of frequent requests to help cook the books. The epidemiologist decided to investigate whether this sort of thing was widespread.

Four particularly popular types of inappropriate requests were reported by at least 20 percent of the 390 statisticians who responded to the survey:

The statisticians didn’t have to say whether they accepted any of these requests. But the results did show that many medical researchers are open about such transgressions, despite being antithetical to the progress of science, and likely to contribute to misleading medical information.

The survey helps explain why so many results in biomedical research can’t be reproduced, said Steven Goodman, a professor of medicine and policy at Stanford University, and coauthor of an editorial piece that ran with the survey results in the Annals of Internal Medicine. Does it mean scientists are committing misconduct, or trying to?

Goodman said that the definition of scientific misconduct is currently limited to fabricating or falsifying data and plagiarism, but the public might benefit from a wider definition that included deliberate manipulation of data and statistics. Statistical tricks may be a lot more common than outright falsification. If they both lead to false outcomes and impressions, the harm to potential patients is the same.

The survey was published in the wake of a new scandal in behavioral science — another field troubled with flawed findings. Brian Wansink, a business professor at Cornell, had been a star of academia and the TED talk circuit for his research on overeating — with lots of catchy claims, such as the notion that people eat more rice from a white plate than a black one.

Last month Cornell accused him of misconduct and fired him. He conceded minor flaws but said he had committed no serious transgressions.