Psychology research is often questionable, study finds

 

 

SCIENTIFIC studies about how people act or think can rarely be replicated by outside experts, said a study that raised new questions about the seriousness of psychology research.

A team of 270 scientists tried reproducing 100 psychology and social science studies that had been published in three top peer-reviewed US journals in 2008.

Just 39 percent came out with same results as the initial reports, said the findings in the journal Science.

The study topics ranged from people's social lives and interactions with others to research involving perception, attention and memory.

No medical therapies were called into question as a result of the study, although a separate effort is under way to evaluate cancer biology studies.

"It's important to note that this somewhat disappointing outcome does not speak directly to the validity or the falsity of the theories," said Gilbert Chin, a psychologist and senior editor at the journal Science.

"What it does say is that we should be less confident about many of the original experimental results." Study co-author Brian Nosek from the University of Virginia said the research shows the need for scientists to continually question themselves.

"A scientific claim doesn't become believable because of the status or authority of the person that generated it," Nosek told reporters.

"Credibility of the claim depends in part on the repeatability of its supporting evidence," he told reporters.

Problems can arise when scientists cherry-pick their data to include only what is deemed "significant," or when study sizes are so small that false negatives or false positives arise.

Nosek said scientists are also under pressure to publish their research regularly and in top journals, and the process can lead to a skewed picture.

"Not everything we do gets published. Novel, positive and tidy results are more likely to survive peer review and this can lead to publication biases that leave out negative results and studies that do not fit the story that we have," he said.

"If this occurs on a broad scale, then the published literature may become more beautiful than the reality." Some experts said the problem may be even worse that the current study suggested.

John Ioannidis, a biologist at Stanford University in Palo Alto, California, told Science magazine that he suspects about 25 percent of psychology papers would hold up under scrutiny, about the same "as what we see in many biomedical disciplines," he was quoted as saying.

One study author who participated in the project as both a reviewer and reviewee was E.J. Masicampo, assistant professor at Wake Forest College in North Carolina.— AFP

Leave a Reply