Lying in Ponds

Wednesday 22 June 2005

Challenging the Pundits

Ken Waight @ 6:45 am

If I were to try to evaluate the accuracy of a set of pundits in addition to their partisanship, how would I do it? I evaluate every partisan reference in every column, but obviously I can’t investigate every factual assertion in every column for accuracy. Many bloggers spend hours of their time picking apart the columns of their least-favorite pundit. What if Lying in Ponds could serve as a clearinghouse by keeping a record of substantive challenges to each columnist, along with a defense made in their behalf and the final outcome of the issue?

Perhaps I could find interested bloggers or others to choose the role of either critic or defender of a single pundit. When a critic thinks they’ve found a substantive problem of accuracy or fairness, they could write up a challenge (limited to no more than one per month), which they could post on this website and/or their own. Then the defender would be expected to post a response, and I would forward the issue to the pundit or to their editor if appropriate. Then I would monitor the outcome of each challenge, to document whether the columnist ultimately issues a correction or rowback, offers a defense, or is unresponsive.

To illustrate the concept with a true but non-substantive example, here’s the way a challenge to William Safire back in 2002 might have looked:

Challenge: In his column of 24 January 2002, William Safire referred to “the failure of a dog named Silver Blaze to bark” in a Sherlock Holmes story. As any Holmes fan knows, Silver Blaze was the name of the missing racehorse in the story, not the famous but unnamed dog that didn’t bark.

Defense: If the dog in the story was unnamed, then perhaps its name actually was Silver Blaze, just like the horse! Why couldn’t someone give the same name to a horse and a dog? And who cares anyway?

Result: In a subsequent column entitled “Holmes’s Horse’s Dog” (7 February 2002), Mr. Safire corrected his error, after hearing from “no fewer than 753 irate Holmes fans”.

A portion of a table summarizing these challenges for a single pundit might look something like this:

Column Challenge Defense Result
Pouring Gasoline on the Fire
12 April 2002
The author claims that current gas prices are at a record high, but they were higher in the 1980’s when adjusted for inflation. Agreed. Forwarded to the author and editorial page editor, but no response has been received and no correction issued.
The American Pastime
30 March 2002
The claim was made that Barry Bonds is currently the best player in baseball, when it’s obvious that Albert Pujols is actually the best player. That’s purely a matter of opinion. Not substantive enough to pursue.
That Dog Won’t Bark
24 January 2002
The horse’s name was Silver Blaze, not the dog. The dog was unnamed. Who cares anyway? Correction issued in 7 February 2002 column.

When accumulated over many months or years, tables for each pundit may help highlight substantial differences in accuracy or responsiveness.

Boxscore

Powered by WordPress

Bad Behavior has blocked 136 access attempts in the last 7 days.