Bad Political Science

Daniel Engber should become a full time science critic.* Over at Slate, he eviscerates the latest sloppy fMRI study of the political brain, which was published in the Times on Sunday:

To liken these neurological pundits to snake-oil salesmen would be far too generous. Their imaging study has not been published in any science journal, nor has it been vetted by experts in the field; it can't rightly be called an "experiment," since the authors weren't testing any particular hypothesis; and the arbitrary conclusions they draw from the data aren't even consistent with their own previous research.

He goes on to point out all the internal contradictions in this latest batch of experiments. The basic moral is that our political beliefs are a complicated psychological phenomenon, and are very difficult to reduce into a set of reliable cortical causes. I think the other element at work here is the allure of neuroscientific explanations, regardless of their validity. The only reason this middling science was featured in the NY Times was because they had pretty pictures of the brain that somehow justified their banal political explanations. Brain imaging is an essential scientific tool, but, like all tools, it only works under specific conditions. When the technology is used to answer the wrong kind of questions, what you end up getting is lots of sloppy experimental interpretation dressed up as rigorous science.

*Why don't we have science critics? We have music critics and literary critics and dance critics and architecture critics...Wouldn't it be great to also have knowledgeable people point out the flaws and achievements of the latest scientific papers? And yes, I did write an article on this idea a few years ago in Seed, although it seems to have been lost by Google.

More like this

There is a must-read paper in Nature about the limits of functional MRI as an experimental tool by one of its pioneers, Nikos Logothetis. (Also discussed by Jonah and Vaughan.) This paper is pretty technical, but Logothetis hits the important points of what it is we think we are actually…
I've been distracted lately — it's end of the world semester time — and so I didn't have time to comment on this recent PNAS paper that reports on dramatic sex differences in the brains of men and women. Fortunately, I can just tell you to go read Christian Jarrett, who explains most of the flaws…
Dave over at Cognitive Daily beat me to this (curse you, Dave!), but I wanted to point everyone to an article in Seed Magazine by Paul Bloom, titled "Seduced by the Flickering Lights of the Brain." If you can't tell from the title, the article is on the lure of imaging studies, and the sense that…
The Society for Neuroscience meeting is coming up, taking place in San Diego in the midst of all the furor and flames. While I'm not going to the meeting, I was reminded of a funny fake science poster I saw at SFN back in 2004: "Joint Encoding of Motion and Music in a Neuron in the Sea Monkey…

Why don't we have science critics?

...because science is the unquestionable word of God?

"Why don't we have science critics?"

We do. It's called peer review.

even most fMRI studies in real journals are pretty terrible

I think most scientific studies would benefit from the involvement of a sociologist. Sort of a bee-watcher-watcher.

The Gaurdian has this wonderful series called Bad Science written by Ben Goldacre which seems to fit the bill. In his most recent article he does a quite through fisking of homeopathy.