Poll the experts!

Do you remember the age before polling in politics? I don't. Today we bemoan the emphasis on polls and idealize the past, before candidates knew in scientific and statistically significant detail the temperature of the democratic water. But no one is going to ban polls in the near future, for every person who complains about survey data there are hundreds who are clicking refresh over & over to find the most recent tracking results on their website of choice.

I think something similar is necessary for the sciences (or scholarship in general). Is George Lakoff a laughing stock (as Chris would have us believe), or a thinker of gigantic Aristotelian proportions? I suppose if you were a cognitive scientist you'd know, your sample of individuals in the field with whom you'd engaged in personal communication would be vast and you could get a sense of the direction that the wind was blowing. But for someone outside the field you basically have to trust someone on the inside and hope they aren't misleading you (or, themselves). Is multi-level selection the next big thing in evolutionary biology, as Bora claims, or is it a relatively marginal and muddled field, my own general perception? Bora has made the Kuhnian claim that multi-level selection's day will come when the older scientists die off, but how do we know that his perception is correct? One's own sample is obviously going to be biased toward those with whom one is on common ground with, perhaps there are enormous social science departments steeped in conceptual metaphor theory that Chris as no knowledge of because he is boxed within his old fashioned world of symbolicists?

I think my point is pretty clear here: in the sciences quite often lay persons are in the position where they know with great confidence that a theory is absolutey accepted at its level of precision (e.g., Newtonian Mechanics) or totally rejected (e.g., the Aether theories). It is as if our knowledge of allele frequencies was certain with any degree of confidence only if they were operationally fixed (i.e., greater than 99%) or very rare or non-existent (i.e., less than 1%). Not only would my proposal help the public, I think it could give scientists some perspective about their position within their discipline.

Tags

More like this

In The Hopeless Monster? Not so fast! Bora says: In a back-and-forth with a commenter, Coyne defends himself that he is talking about the changes in genes, not evolution. This just shows his bias - he truly believes that evolution - all of it - can be explained entirely by genetics, particularly…
Bora made two quick references to "group selection" today. I don't have much time...and shouldn't be blogging, but I want to make a few quick points before this topic goes down the memory hole (I know, unnecessary caveat, but I am driven by personal guilt in expressing it, not public shame). For…
George Lakoff has published two new political books, Whose Freedom?: The Battle Over America's Most Important Idea, and Thinking Points: Communicating Our American Values and Vision, as follow ups to his Moral Politics and Don't Think of an Elephant. I haven't read either of the new books (my New…
In the previous entry, I made some disparaging remarks about conceptual metaphor theory (CMT), and George Lakoff specifically. I also noted that, in my experience,, the psycholinguist Raymond Gibbs, Jr. is the only one in the cognitive linguistics who seriously addresses the evidence and…

This is one of those things (like hotornot) that is just waiting for a sensible implementation to happen. Certainly the demand is large - everyone wants and has always wanted a way get an accurate sense of the consensus/majority view within a discipline on a topic, and how it is evolving.

One potential hitch:
i. such a system would have to be anonymous to let people say possibly nasty things about big people. No grad student or untenured faculty member is going to risk saying something bad about the latest idea of a superstar prof. Consider only how much trouble resulted from the candid comments people made about Yau for the New Yorker.

ii. On the other hand, you want the opinion of 'sane' people, not crackpots.

The two seem to tug in opposite directions. One possible compromise might be to restrict to people with .edu email addresses, but I don't really want to know what (say) a student in cosmology thinks about nanotech. You need lists of people allowed to comment on specific fields, which clearly bumps into the anonymity requirement.

Perhaps the operation of various academic job market rumor mills provides organizational tips?

Lakoff is a very smart man who is busy publishing a great deal of politically motivated garbage. Much of his recent work on conservatives is JUNK SCIENCE. His work on metaphor is very nice but not the best work on the topic. Garnter, Holland and others have made a greater contribution to the field than Lakoff.