The NFL draft gives professional football coaches a chance to pluck a promising but unformed talent—a young Tom Brady or Peyton Manning perhaps—from college football. But how do coaches spot the next big star? The answer, according to a new data-driven study of draft picks, is that they rely on a whole lot of luck.
Cade Massey, an assistant professor of organizational behavior at Yale University, analyzed thousands of draft picks to see if some teams are consistently better at picking good players, and therefore more skillful at draft picks. The answer? “It’s all about chance,” says Massey.
Massey presented his findings last week at the 2011 MIT Sports Analytics Conference, an event that focused on the growing use of analytics in sports. Nowadays sports franchises crunch numbers not only to evaluate players’ performance, but also to better manage ticket sales, handle labor relations, cope with player injuries, and even to make coaching decisions.
Prior to the draft, teams spend ample time researching new players and determining who might best fit their team’s needs. While Massey says this preparation is, of course, not meaningless, coaches and other team personnel involved in the draft put too much value on it. “The data shows that chance, or uncertainty, plays a bigger role than skill in drafting players,” says Massey.
Massey’s study looked at how many games drafted players started during their first five years in the league, and how much a player was paid when he became a free agent in his sixth or seventh year in the league. Using 17 years worth of data, Massey determined that no team is especially good at picking good players consistently—not even the New England Patriots, a team that is credited with sophisticated drafting methods and consistently smart draft choices. While each pick is not necessarily a “roll of the dice,” says Massey, people underestimate the role uncertainty plays. Massey says teams should adapt their strategies, although it isn’t clear exactly how. “It does not mean you cannot do anything, it just means you should think differently.”
Massey plans to take his analysis a step further and look at the differences within a given draft year; and to use a more sophisticated economic model to measure a player’s value and adjust for different player positions. He plans to publish a paper on his work in the next four to five weeks, prior to the 2011 NFL draft. “I am saying something more extreme than anything that has been said before, and I think it will eventually change some teams’ behavior,” he says.
How AI is reinventing what computers are
Three key ways artificial intelligence is changing what it means to compute.
These weird virtual creatures evolve their bodies to solve problems
They show how intelligence and body plans are closely linked—and could unlock AI for robots.
A horrifying new AI app swaps women into porn videos with a click
Deepfake researchers have long feared the day this would arrive.
Surgeons have successfully tested a pig’s kidney in a human patient
The test, in a brain-dead patient, was very short but represents a milestone in the long quest to use animal organs in human transplants.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.