What the Dog Saw [132]
Similarly, all quarterbacks drafted into the pros are required to take an IQ test — the Wonderlic Personnel Test. The theory behind the test is that the pro game is so much more cognitively demanding than the college game that high intelligence should be a good predictor of success. But when the economists David Berri and Rob Simmons analyzed the scores — which are routinely leaked to the press — they found that Wonderlic scores are all but useless as predictors. Of the five quarterbacks taken in round one of the 1999 draft, Donovan McNabb, the only one of the five with a shot at the Hall of Fame, had the lowest Wonderlic score. And who else had IQ scores in the same range as McNabb? Dan Marino and Terry Bradshaw, two of the greatest quarterbacks ever to play the game.
We’re used to dealing with prediction problems by going back and looking for better predictors. We now realize that being a good doctor requires the ability to communicate, listen, and empathize — and so there is increasing pressure on medical schools to pay attention to interpersonal skills as well as to test scores. We can have better physicians if we’re just smarter about how we choose medical school students. But no one is saying that Dan Shonka is somehow missing some key ingredient in his analysis; that if he were only more perceptive he could predict Chase Daniel’s career trajectory. The problem with picking quarterbacks is that Chase Daniel’s performance can’t be predicted. The job he’s being groomed for is so particular and specialized that there is no way to know who will succeed at it and who won’t. In fact, Berri and Simmons found no connection between where a quarterback was taken in the draft — that is, how highly he was rated on the basis of his college performance — and how well he played in the pros.
The entire time that Chase Daniel was on the field against Oklahoma State, his backup, Chase Patton, stood on the sidelines, watching. Patton didn’t play a single down. In his four years at Missouri, up to that point, he had thrown a total of twenty-six passes. And yet there were people in Shonka’s world who thought that Patton would end up as a better professional quarterback than Daniel. The week of the Oklahoma State game, the national sports magazine ESPN even put the two players on its cover, with the title “CHASE DANIEL MIGHT WIN THE HEISMAN” — referring to the trophy given to college football’s best player. “HIS BACKUP COULD WIN THE SUPER BOWL.” Why did everyone like Patton so much? It wasn’t clear. Maybe he looked good in practice. Maybe it was because this season in the NFL a quarterback who had also never started in a single college game is playing superbly for the New England Patriots. It sounds absurd to put an athlete on the cover of a magazine for no particular reason. But perhaps that’s just the quarterback problem taken to an extreme. If college performance doesn’t tell us anything, why shouldn’t we value someone who hasn’t had the chance to play as highly as we do someone who plays as well as anyone in the land?
4.
Picture a young preschool teacher, sitting on a classroom floor surrounded by seven children. She is holding an alphabet book, and working through the letters with the children, one by one: “A is for apple.…C is for cow.” The session was taped, and the videotape is being watched by a group of experts, who are charting and grading each of the teacher’s moves.
After thirty seconds, the leader of the group — Bob Pianta, the dean of the University of Virginia’s Curry School of Education