The Undoing Project: A Friendship that Changed the World(6)



He didn’t think of his model as “the right answer” so much as “a better answer.” Nor was he so naive as to think that the model would pick players all by itself. The model obviously needed to be checked and watched—mainly because there was information that the model wouldn’t be privy to. If the player had broken his neck the night before the NBA draft, for instance, it would be nice to know. But if you had asked Daryl Morey in 2006 to choose between his model and a roomful of basketball scouts, he’d have taken his model.

That counted as original, in 2006. Morey could see that no one else was using a model to judge basketball players—no one had bothered to acquire the information needed by any model. To get any stats at all, he’d had to send people to the offices of the National Collegiate Athletic Association (NCAA), in Indianapolis, to photocopy box scores of every college game over the past twenty years, then enter all that data by hand into his system. Any theory about basketball players had to be tested on a database of players. They now had a twenty-year history of college players. The new database allowed you to compare players to similar players from the past, and see if there were any general lessons to be learned.

A lot of what the Houston Rockets did sounds simple and obvious now: In spirit, it is the same approach taken by algorithmic Wall Street traders, U.S. presidential campaign managers, and every company trying to use what you do on the Internet to predict what you might buy or look at. There was nothing simple or obvious about it in 2006. There was much information Morey’s model needed that simply was not available. The Rockets began to gather their own original data by measuring things on a basketball court that had previously gone unmeasured. Instead of knowing the number of rebounds a player had, for instance, they began to count the number of genuine opportunities for rebounds he’d had and, of those, how many he had snagged. They tracked the scoring in the game when a given player was on the court, compared to when he was on the bench. Points and rebounds and steals per game were not very useful; but points and rebounds and steals per minute had value. Scoring 15 points a game obviously meant less if you had played the entire game than if you had played half of it. It was also possible to back out from the box scores the pace at which various college teams played—how often they went up and down the court. Adjusting a college player’s stats for his team’s pace of play was telling. Points and rebounds meant one thing when the team took 150 shots a game and something different when it took just 75. Just adjusting for pace gave you a clearer picture of what any given player had accomplished than the conventional view did.

The Rockets collected data on basketball players that hadn’t ever been collected before, and not just basketball data. They gathered information on the players’ lives and looked for patterns in it. Did it help a player to have two parents in his life? Was it an advantage to be left-handed? Did players with strong college coaches tend to do better in the NBA? Did it help if a player had a former NBA player in his lineage? Did it matter if he had transferred from junior college? If his college coach played zone defense? If he had played multiple positions in college? Did it matter how much weight a player could bench-press? “Almost everything we looked at was nonpredictive,” says Morey. But not everything. Rebounds per minute were useful in predicting the future success of big guys. Steals per minute told you something about the small ones. It didn’t matter so much how tall a player was as how high he could reach with his hands—his length rather than his height.

The model’s first road test came in 2007. (The Rockets had traded their picks in 2006.) Here was the chance to test a dispassionate, unsentimental, evidence-based approach against the felt experience of an entire industry. That year, the Rockets held the 26th and the 31st picks in the NBA draft. According to Morey’s model, the odds of getting a good NBA player with those picks were, respectively, 8 percent and 5 percent. The chance of getting a starter was roughly one in a hundred. They selected Aaron Brooks and Carl Landry, both of whom became NBA starters. It was an incredibly rich haul.? “That lulled us to sleep,” said Morey. He knew that his model was, at best, only slightly less flawed than the human beings who had rendered the judgments about job applicants since time began. He knew that he suffered from a serious dearth of good data. “You have some information—but often from a single year in college. And even that has problems with it. Apart from it’s a different game, with different coaches, different levels of competition—the players are twenty years old. They don’t know who they are. So how are we supposed to?” He knew all this and yet he thought maybe they had figured something out. Then came 2008.

That year the Rockets had the 25th pick in the draft and used it to pick a big guy from the University of Memphis named Joey Dorsey. In his job interview, Dorsey had been funny and likable and charming—he’d said when he was done playing basketball he intended to explore a second career as a porn star. After he was drafted, Dorsey was sent to Santa Cruz to play in an exhibition game against other newly drafted players. Morey went to go see him. “The first game I watch he looks terrible,” said Morey. “And I’m like, ‘Fuck!!!!’” Joey Dorsey was so bad that Daryl Morey could not believe he was watching the guy he’d drafted. Perhaps, Morey thought, he wasn’t taking the exhibition seriously. “I meet with him. We have a two-hour lunch.” Morey gave Dorsey a long talk about the importance of playing with intensity, and making a good impression, and so on. “I think he’s going to come out the next game with his hair on fire. And he comes out and sucks the next game, too.” Fairly quickly, Morey saw he had a bigger problem than Joey Dorsey. The problem was his model. “Joey Dorsey was a model superstar. The model said that he was like a can’t-miss. His signal was super, super high.”

Michael Lewis's Books