Jack O’Toole at Political
Professional offered some thoughtful criticism in a post last
Monday. Mr. O’Toole makes two main points. First, he’s
concerned about methodology:
Like most people, I’ve always had reservations about studies that are
more interested in counting than context. That’s how one media
watchdog group managed to name Saving Private Ryan the most violent
movie of 1998, and another wound up arguing that a popular sitcom was
among television’s most violent programs — based almost entirely on a
single fantasy episode in which the lead characters played the roles
of The Three Stooges. These results were generated using essentially
the same methodology as that employed by LIP, and demonstrate the
weaknesses inherent in this type of study.
I agree that the Lying in Ponds method is simple, and that
the results should be viewed with caution. But the examples cited
above seem to be a result of either a small sample size or an
anomalous data point. I’ve previously noted those issues in
connection with Collin
Levey and Colbert
King. I average together two different methods which combine the
partisanship scores from individual columns into a final score to try
to minimize those potential problems — it was reassuring that the top
three were identical with either method (Total PI
and Median PI).
Second, Mr. O’Toole argues that Paul
Krugman’s score is inflated because of his subject matter:
Paul Krugman’s column is about economics. He disagrees with the
dominant wing of the Republican party on economic issues. As a result,
he’s inevitably going to “win” any simple numbers game like Lying in
Ponds’ — just as, say, Pat Robertson would if he were hired by a
major newspaper to write on abortion policy twice a week. Of course,
Krugman could improve his scores dramatically by inserting the phrase
Unlike high-minded Republicans such as John McCain from time to time,
but that fact merely demonstrates just how flawed the LIP methodology
really is.
It’s a plausible hypothesis, but one that doesn’t hold up under
inspection. Mr. Krugman wrote many columns on non-economic topics in
2002, and they’re just as partisan as the economics columns.
There was an anti-Republican screed on the church
and state issue, an anti-Republican screed on Trent
Lott, an anti-Republican screed on climate
policy, an anti-Republican screed on forest
policy, an anti-Republican screed on drilling
in Alaska, an anti-Republican screed on French
elections (huh?), and many more. Have you detected a pattern? It’s
really necessary to go to the Paul Krugman
page and scroll down through the column statistics to get a
feeling for the remarkable consistency. While it’s right to have a
healthy skepticism about counting methods such as this one, I believe
that the basis for Mr. Krugman’s 2002 partisanship score is extremely
solid, suffering from neither small sample size (99 columns) nor
by the effect of anomalous data points.