The Undoing Project: A Friendship that Changed the World(54)
A certain town is served by two hospitals. In the larger hospital about 45 babies are born each day, and in the smaller hospital about 15 babies are born each day. As you know, about 50 percent of all babies are boys. The exact percentage of baby boys, however, varies from day to day. Sometimes it may be higher than 50 percent, sometimes lower.
For a period of 1 year, each hospital recorded the days on which more than 60 percent of the babies born were boys. Which hospital do you think recorded more such days? Check one:
— The larger hospital
— The smaller hospital
— About the same (that is, within 5 percent of each other)
People got that one wrong, too. Their typical answer was “same.” The correct answer is “the smaller hospital.” The smaller the sample size, the more likely that it is unrepresentative of the wider population. “We surely do not mean to imply that man is incapable of appreciating the impact of sample size on sampling variance,” wrote Danny and Amos. “People can be taught the correct rule, perhaps even with little difficulty. The point remains that people do not follow the correct rule, when left to their own devices.”
To which a bewildered American college student might reply: All these strange questions! What do they have to do with my life? A great deal, Danny and Amos clearly believed. “In their daily lives,” they wrote, “people ask themselves and others questions such as: What are the chances that this 12-year-old boy will grow up to be a scientist? What is the probability that this candidate will be elected to office? What is the likelihood that this company will go out of business?” They confessed that they had confined their questions to situations in which the odds could be objectively calculated. But they felt fairly certain that people made the same mistakes when the odds were harder, or even impossible, to know. When, say, they guessed what a little boy would do for a living when he grew up, they thought in stereoypyes. If he matched their mental picture of a scientist, they guessed he’d be a scientist—and neglect the prior odds of any kid becoming a scientist.
Of course, you couldn’t prove that people misjudged the odds of a situation when the odds were extremely difficult or even impossible to know. How could you prove that people came to the wrong answer when a right answer didn’t exist? But if people’s judgments were distorted by representativeness when the odds were knowable, how likely was it that their judgments were any better when the odds were a total mystery?
* * *
Danny and Amos had their first big general idea—the mind had these mechanisms for making judgments and decisions that were usually useful but also capable of generating serious error. The next paper they produced inside the Oregon Research Institute described a second mechanism, an idea that had come to them just a couple of weeks after the first. “It wasn’t all representativeness,” said Danny. “There was something else going on. It wasn’t just similarity.” The new paper’s title was once again more mystifying than helpful: “Availability: A Heuristic for Judging Frequency and Probability.” Once again, the authors came with news of the results of questions that they had posed to students, mostly at the University of Oregon, where they now had an endless supply of lab rats. They’d gathered a lot more kids in classrooms and asked them, absent a dictionary or any text, to answer these bizarre questions:
The frequency of appearance of letters in the English language was studied. A typical text was selected, and the relative frequency with which various letters of the alphabet appeared in the first and third positions of the words was recorded. Words of less than three letters were excluded from the count.
You will be given several letters of the alphabet, and you will be asked to judge whether these letters appear more often in the first or in the third position, and to estimate the ratio of the frequency with which they appear in these positions. . . .
Consider the letter K
Is K more likely to appear in
____the first position?
____the third position?
(check one)
My estimate for the ratio of these two values is:________:1
If you thought that K was, say, twice as likely to appear as the first letter of an English word than as the third letter, you checked the first box and wrote your estimate as 2:1. This was what the typical person did, as it happens. Danny and Amos replicated the demonstration with other letters—R, L, N, and V. Those letters all appeared more frequently as the third letter in an English word than as the first letter—by a ratio of two to one. Once again, people’s judgment was, systematically, very wrong. And it was wrong, Danny and Amos now proposed, because it was distorted by memory. It was simply easier to recall words that start with K than to recall words with K as their third letter.
The more easily people can call some scenario to mind—the more available it is to them—the more probable they find it to be. Any fact or incident that was especially vivid, or recent, or common—or anything that happened to preoccupy a person—was likely to be recalled with special ease, and so be disproportionately weighted in any judgment. Danny and Amos had noticed how oddly, and often unreliably, their own minds recalculated the odds, in light of some recent or memorable experience. For instance, after they drove past a gruesome car crash on the highway, they slowed down: Their sense of the odds of being in a crash had changed. After seeing a movie that dramatizes nuclear war, they worried more about nuclear war; indeed, they felt that it was more likely to happen. The sheer volatility of people’s judgment of the odds—their sense of the odds could be changed by two hours in a movie theater—told you something about the reliability of the mechanism that judged those odds.