Equal time in science -and- distinguishing science from non-science

Johnathan Wolff publishing in the Guardian cites the case of Naomi Oreskes as to why the equal time idea of journalism doesn't work for science:

I learned to shut my mouth on the topic after hearing a lecture from a San Diego philosopher of science, Naomi Oreskes, who reported the results of a review of the scientific literature on global warming. Not one peer-reviewed scientific article, of the hundreds she surveyed, denied that the earth was warming or that human action was at least partially responsible. The sceptics, she argued, were largely members of independent thinktanks, often sponsored by companies with vested interests, publishing their own reports without external review.

A little later, Oreskes published her findings in the leading journal Science, and was immediately shot down by bloggers, journalists and thinktankers, who mixed insults about her honesty with more plausible-sounding complaints about her methodology. Oreskes replied, with great restraint, that she would wait for the peer-reviewed criticisms.

But if Oreskes is right, why do so many people think there is an active scientific debate? One reason is that few people appreciate the difference between peer-reviewed journals and thinktank reports. But even worse, she argued, is the influence of the media: you knew that was coming, didn't you?

In fact, she makes an excellent point. Journalistic ethics require balance. In reporting political arguments, each claim must be countered so that a lively debate can take place and readers come to their own views (well, that's the theory). Oreskes suggests that journalists have mistakenly applied the same ethical code to scientific reporting. Whenever a story on climate change is produced, a maverick nay-sayer is rolled out for the sake of balance. But this misleads the public into thinking that a few lone voices have equal weight to the scientific orthodoxy.

The same thing happened when a scientific consensus was forming around the theory that HIV causes Aids. A small number of scientists questioned the hypothesis and received a disproportionate share of attention. The false appearance of wide scientific disagreement gave policy-makers in some countries an excuse to delay the introduction of prevention and treatment programmes, with tragic results.

How well equipped are we non-scientists to understand scientific discussions? We all study science for a few years, but learn - or at least remember - very little about methodology. Science is presented as a body of known truths. As adults, though, we need to know not the atomic number of chlorine, but how to assess evidence for or against a theory. (Emphasis mine.)

1) I agree with Wolff that science possesses no strong impulse to equal time, and that this is probably good. We don't do equal time because scientific debate is conducted through the screen of peer review. A system where all ideas would receive equal weight would lack such a filter.

Though some people would argue that this screen out dissonant views, this has not been my experience with the system in practice. What the system in practice screens out is views without evidence or views that require ad hominem attacks to make them sound reasonable. I have never heard of a paper that was denied access to a journal on the grounds that the evidence it showed was unfortunate -- most of those papers get fast-tracked to the best journals because everyone likes the publicity.

Someone might respond: what about papers denying evolution and advocating intelligent design? An argument based on the absence of evidence is not equivalent to an argument based on the presence of evidence. To get in a journal you have to propose counter-evidence, not just a counter-argument.

2) Non-scientists often seemed bewildered by the difference between scientific and journalistic discourse, but I have always found them very easy to distinguish. It is not done -- as some have suggested -- by looking at the origin of the information because some scientists do spout nonsense that isn't science from time to time and some journalists make scientific arguments. And, even though I noted above that the process is intrinsic to science, peer-review is not always a perfect guide to scientific validity (although it is a pretty good one)

From a practical point of view, here are two handy principles by which a scientific argument is identified:

  • 1) A scientific argument is based on evidence and only evidence. By evidence, I mean experiment, derivation of conclusions from experiments, or explication of mathematical or logical principles derived from experiment.
  • 2) A scientific argument is never based on evaluation of the merits of the speaker, the ideological background of the institution where the speaker works, or the social history of the field.

If you find an argument that violates either of those two principles, it is not a scientific one -- even if it is being spoken by a scientist.

(Incidentally, I have never read Oreskes article, so I cannot say anything about the validity of that particular example.)

Hat-tip: Peer-to-Peer

Tags

More like this

When Klaus-Martin Schulte attacked Naomi Orestes and she responded, there was quite a lot of blosopheric response to it. If you look no further than scienceblogs.com, there were no less than eight direct responses (and some lively comments as well): one, two, three, four, five, six, seven and…
The DI has, predictably, issued a press release spinning yesterday's announcement from the board of the Biological Society of Washington. Also predictably, it contains several misrepresentations. That's what you have to do when the facts are against you, so it's hardly a surprise. The distortions…
Many readers will no doubt know the 2004 paper in Science by historian of science Naomi Oreskes, a paper which discussed the consensus position regarding anthropogenic climate change. Predictably, the paper received much vitriol from the climate contrarians and denialists. Now, a medical research…
I know some of the others (among them Jason) have talked about this, but I thought I would mention it. The May 4th issue of Cell has an article by Laura Bonetta about scientific blogging. Money quote: The concept of scientists reaching out to a lay audience is not new. "Scientists are an…

As far as newspapers are concerned, I just don't think journalistic integrity really comes into play anymore. I don't think they present opposing views to maintain ethical 'balance'. I think they do it to avoid pissing off the large number of scientifically ignorant readers who choose to believe various nonsense for political or religious reasons. If the newspaper stands to make more money catering to their ignorance than reporting honestly, I doubt they even think twice.

"A scientific argument is based on evidence and only evidence. By evidence, I mean experiment, derivation of conclusions from experiments, or explication of mathematical or logical principles derived from experiment."

I think I agree with the "sentiment" you express here, but in point of fact, there is no mathematical or logical principle that is "derived from experiment." For example, there is no need to refer to empirical data to utterly demolish a scientific argument that is illogical or that involves errors of calculation.

By bob koepp (not verified) on 11 Jul 2007 #permalink

The Oreskes study is essentially a construct to try and re-inforce the idea of "consensus" and "beyond debate", when the opposite is the case. It has however been used time and time again, including by Al Gore, to try and deny any debate exists.

Dr Benny Peiser of Liverpool University, analysed all abstracts listed on the ISI databank for 1993 to 2003 using the same keywords ("global climate change") as the Oreskes study. Of the 1247 documents listed, only 1117 included abstracts (130 listed only titles, author(s)' details and keywords).

Peiser says, "Oreskes claims to have analysed 928 abstracts she found listed on the ISI database using the keywords "climate change". However, a search on the database using the keywords "climate change" for the years 1993 - 2003 reveals that almost 12,000 papers were published during the decade in question.

What happened to the countless research papers that show that global temperatures were similar or even higher during the Holocene Climate Optimum and the Medieval Warm Period when atmospheric CO2 levels were much lower than today; that solar variability is a key driver of recent climate change, and that climate modeling is highly uncertain?

He further says, "...it is beyond doubt that a sound and unbiased analysis of the full ISI databank will find hundreds of papers (many of which are written by the world's leading experts in the field) that have raised serious reservations and outright rejection of the concept of a "scientific consensus on climate change". The truth is, that there is no such thing!"

By Harbinger (not verified) on 11 Jul 2007 #permalink

but in point of fact, there is no mathematical or logical principle that is "derived from experiment."

EVERY mathematical and logical principle is derived from experimental observations. The experiments usually take place inside the cranium, so many people find them easy to overlook, but they're no less real for that.

By Caledonian (not verified) on 14 Jul 2007 #permalink

Caledonian: I think that needs a bit more explication than you've given it. The ontological status of mathematical truths is deep water and not amenable to blanket statements like that. What is the experiment that, say, algebraic geometry flows from?