Where Economists Dare to Tread

Over at The Frontal Cortex, Jonah has a blog referring to a WSJ article impugning economic jurisdiction in questions outside the traditional bounds of economics. Specifically, the article cites a paper recently publicized by Cornell University claiming to establish a causal link between early childhood television viewing and autism. The thrust of the article is that the statistical tools used by economists are ill-equipped to address such questions and should be treated as suspect by the natural sciences.

The answer, as with all things, is a bit of yes and a bit of no.

I would like to begin by stressing that I do not intend to support the particular TV-autism paper cited in the WSJ. I have read the paper and find it both bad science and bad economics. First among my concerns is that the author purports to use an instrumental variable (IV) analysis in establishing a link between early television watching and autism, and then does not use that technique. He uses precipitation as a proxy variable instead of an instrumental variable, which changes both the meaning and the significance of his results. Whereas an IV regression may have indeed provided some information about the link between TV watching and autism, this proxy regression tells us nothing about it. There's your bad science. The bad economics comes in when he makes recommendations to parents based on the results of his study. A pharmaceutical researcher wouldn't immediately prescribe a new drug to every cancer patient in the country on the basis of one experiment. Economics is at its best when it is descriptive rather than normative until the best prescription is overwhelmingly demonstrated.

That said, I fear that people who readily dismiss potential economic contributions are throwing the proverbial baby out with the bath-water. Properly applied, econometric techniques can give us a very good idea of correlation and perhaps even causation between statistical events. Even the much-maligned instrumental variable approach, if carefully constructed and convincing, can offer some information about relationships among observed data relatively cheaply and quickly.

The statistics used by economists were developed over decades as a way to get around the fact that economists can't perform controlled experiments. You can't just call up a central bank somewhere and say, "Hey, would you mind raising the interest rate .25% suddenly? I'd like to see what happens." So we have to make use of data born of so-called "natural" experiments--those that occur either by natural events or government policy--to tease out causal relationships and explanations. We've gotten pretty good at it, with a few caveats. Firstly, none of these techniques is 100% foolproof. There can always be something else that explains the observed outcomes lurking in the background to foil our neat little regressions. This is where peer review and repeated analysis can be a saving grace. For every economist who publishes a model to explain the causal effect of A on B, there's another who looks at the results and says, "Hey, but what about THIS?". Over time, with enough heads together, we can hopefully converge on an explanatory model that satisfies just about everyone, and then start thinking about what we can do with the results.

Secondly, as the saying goes, "there are lies, damned lies, and statistics". It is very easy to use numbers to obfuscate complexity, as in the TV-autism paper. This is where we need qualified people to evaluate research methods and results to separate the good science from the bad before it gets too far. It is very easy for the media to seize hold of a soundbite from a particular paper and make it seem as if the result in question were sacrosanct, when in fact the opposite is true. I often feel that the misrepresentation of what economics can and can't show is what encourages such widespread scepticism of the discipline amongst researchers in other fields.

So, having said all that, what is it that I claim economics has to offer the natural sciences? Jonah hinted at this in his post, as have some of his commenters, but the quick and relatively easy preliminary examination of hypotheses strikes me as one of the biggest contributions econometric techniques can make. No regression, however subtle, will ever substitute for a controlled experiment. But in an time when scientific research is getting more and more expensive, it makes sense to try to find ways to eliminate spurious hypotheses before embarking on huge, controlled studies. And with modern statistics collection practices, we have mountains of data ripe for analysis. In the case of the TV-autism link, it would probably be quite time-intensive and difficult to experimentally establish (or not) a causal link. If someone were to do the actual IV regression on the idea and find no significant relationship, perhaps the time and funds could be better spent pursuing another avenue of autism research. This applies to other areas as well. Indeed, it applies to all the areas mentioned by the article as questionable venues of economic pursuit: education, politics, history, epidemiology. How useful economics is in these areas is more a question of proper application than intellectual turf.

****************************

Finally, I hope Jonah will forgive me for jumping all over what was probably just a throwaway comment, but I have to take this opportunity to clear up one of the fundamental misunderstandings lay people often have about economics. Namely, this whole business of "rationality". No economist anywhere will ever, EVER tell you that human beings are rational. That's just silly, and most of us consider ourselves quite reasonable people. The concept of "ideal rationality" is a tool. It is a simplifying assumption that we ascribe to the agents in our theoretical models because it makes analysis easier. After looking at our analytical results, we consider what would happen if we relaxed these assumptions, and whether or not the outcomes change significantly (and what it means if they do). It's perhaps a facile comparison, but think of it as keeping animals in cages in a laboratory. Maybe the lab environment changes things and maybe not (depending on what you're studying), but it sure makes it a hell of a lot easier to work with them.

Tags
Categories

More like this

Last year, a Cornell University economist named Michael Waldman noticed a strange correlation: the more precipitation a region received, the more likely children were to be diagnosed with autism. [This] soon led Prof. Waldman to conclude that something children do more during rain or snow --…
A few months ago, I offered a completely speculative hypothesis on television and autism: So how might TV be one of the causes of the "autism epidemic"? A possible answer focuses on the way the newborn brain organizes itself in response to the stimuli it receives. If an infant's world is suffused…
Steve Levitt links to this article by Will Dobbie and Roland Fryer on an educational innovation to improve the education of ethnic minority children. Dobbie and Fryer write: Harlem Children's Zone (HCZ) is arguably the most ambitious social experiment to alleviate poverty of our time. We [Dobbie…
Our story begins with this article by Sanjay Kaul and George Diamond: The randomized controlled clinical trial is the gold standard scientific method for the evaluation of diagnostic and treatment interventions. Such trials are cited frequently as the authoritative foundation for evidence-based…

Well said, Kara. I'd just like to add that quite a few of our econometric tools were actually developed jointly with natural scientists. And if they thought we're worthy of being their collaborators, we can't be all bad.

A couple of things...

1) Another use for instrumental variables is in cases where an experiment cannot be ethically performed. I could sit children in a room and have them watch TV for 4,000 to see if they get autism. That would solve the problem once and for all. Unfortunately, I doubt people would give up their children for such an experiment.

2) This issue of rationality and who assumes what I feel like scientists always trip over. One, I agree with Kara. I don't think that economists assume that human beings are perfectly rational. I get the sense that they assume that human beings are self-interested, but this does not imply that they are necessarily good at getting what they want.

Two, I have discovered that what you mean by rational often depends heavily on what time scale you are talking about. Here's an example.

I train rats at the moment. We train them to perform certain tasks in exchange for rewards, and then we change the rules on them and train them on new tasks. Sometimes when we do this the rats cling to the old way of training.

Is the rat being irrational?

Yes and no. Yes, in the sense that changing to the new set of rules will yield more immediate reward. No, in the sense that it's biology follows an evolutionarily-specified plan that makes it cling to what it has already learned. This clinginess has been selected for because over the course of the lifetime of the this trait will on balance yield more reward even if in the short-term it does not.

Asking whether human beings are perfectly rational -- even with respect to how they achieve what they want -- is not a precise question. You have to specify what they want and the time scale that they have to achieve it. Only in that context can you even compute their probability of attaining it and determine whether that was the best way.

At the risk of being repetitive, I also think Kara's discussion is quite "on the mark."....I would quibble however with the evidently general consensus that humans are not rational. I think human beings are quite rational, given the caveat that that rationality is based on learning that may be false (in computer lingo: Garbage In, Garbage Out) and our information inputs are filtered quite a bit by perceptual emotional filters, some rose-colored, some quite the opposite. That is why sometimes an individual human being, when adding 2 + 2 comes up with 4, and sometimes he/she comes up with 3 or 5. The mathematics are correct in all cases based on the immediate mental frame of reference. That's why every human being feels that their actions/beliefs are completely rational and in consonance with the facts at hand..........In the purest sense, they are.