The three questions that predict how patient you are Image: Rmrfstar, CC BY 2.5

The three questions that predict how patient you are

A bat and a ball cost 1.10 dollars in total. The bat costs 1.00 dollar more than the ball. How much does the ball cost? An answer comes to mind at once, and for most people it is 10 cents. It is wrong: if the ball were 10 cents the bat would be 1.10 and the pair 1.20. The ball costs 5 cents. Almost everyone who gets it wrong can see the mistake within seconds of being shown it. The question is a test of whether you check the answer that came to mind, and it turns out that whether you do predicts a good deal about how you make economic decisions.

The test

Shane Frederick, then at the Massachusetts Institute of Technology and now at the Yale School of Management, published the Cognitive Reflection Test in 2005 in the Journal of Economic Perspectives. It has three items. The second: if it takes 5 machines 5 minutes to make 5 widgets, how long would it take 100 machines to make 100 widgets? The intuitive answer is 100 minutes; the correct answer is 5, because each machine takes 5 minutes to make one widget regardless of how many machines there are. The third: in a lake there is a patch of lily pads that doubles in size every day, and it takes 48 days to cover the whole lake; how long does it take to cover half? The intuitive answer is 24 days; the correct answer is 47. Each item has the same structure. An answer presents itself without effort, it is wrong, and finding the right one requires noticing that the first answer should be checked and then doing a small calculation.

Frederick gave the test to 3,428 people, most of them students, over 26 months. The average score at MIT was 2.18 out of 3; at Princeton 1.63; at Harvard 1.43; at the University of Michigan's Dearborn campus 0.83; at the University of Toledo 0.57. Across the whole sample about a third scored zero and about 17 per cent scored three. The scores are far below what one would expect for questions whose arithmetic a ten-year-old can do, and the distribution of wrong answers is the point: the wrong answers are overwhelmingly the specific intuitive ones, 10 cents, 100 minutes, and 24 days, rather than a scatter of errors. People were answering a different, easier question than the one asked, which is what Unit 13 of the masterclass means by a heuristic.

What the score predicts

The test would be a party trick if that were all. Frederick's paper reports what else the high and low scorers did. Asked whether they would rather have 3,400 dollars this month or 3,800 next month, 60 per cent of the high scorers chose to wait and 35 per cent of the low scorers did; the implied annual interest rate of the second option is over 200 per cent, so waiting was the financially sensible choice. On a series of such questions the high scorers were consistently more patient, in the sense of having a lower discount rate for money over short horizons. The same was true, though more weakly, for questions about real goods. Interestingly, the pattern reversed for long horizons and large sums, where low scorers were about as patient as high scorers, which suggests that what the test measures is the tendency to override an impulse rather than a different valuation of the future.

On risk, the high scorers were more willing to take a gamble when the gamble was a good one. Offered a certain 500 dollars or a 15 per cent chance of 1,000,000, 60 per cent of the high scorers took the chance and 19 per cent of the low scorers did. On the loss side the high scorers were less willing to gamble to avoid a sure loss. In the language of Unit 14, high scorers behaved more like expected value maximizers and low scorers more like prospect theory predicts, with risk aversion for gains and risk seeking for losses. Frederick also found that the score related to patience and risk-taking even after controlling for general measures of ability such as test scores, which is why the test has been used in hundreds of studies since as a short measure of reflective thinking.

Two systems

The paper frames the result in terms that Kahneman later made famous: a fast system that produces answers automatically and a slow system that can check them when it is engaged. The test measures the disposition to engage the slow system when the fast one has already produced something plausible. The framing is a description rather than a theory of the brain, and Unit 13 presents it as such, next to Herbert Simon's older idea of bounded rationality and Gerd Gigerenzer's argument that fast heuristics are often the best rule available. What the test demonstrates beyond argument is that people with the same ability differ in whether they check, and that the difference matters for choices about money.

A worked number

Suppose you score zero, as about a third of Frederick's sample did, and suppose you are offered a choice like the one above once a year for forty years: a sum now or a sum about 12 per cent larger in a month. A person who always takes the sum now forgoes 12 per cent on each occasion. Reinvested at an ordinary return of 4 per cent a year, the forgone 12 per cent on a sum of 3,400 dollars is about 400 dollars a year, which over forty years compounds to roughly 40,000 dollars. The test takes two minutes. The habit it measures, of pausing before accepting the first answer, is worth learning, and the first step is to know that the first answer is usually the easy one.

Where it leads

The Cognitive Reflection Test is the research spotlight of Unit 13 of the masterclass, Heuristics, Biases, and Bounded Rationality, which opens the Advanced + Behavioural Economics masterclass by stating what the standard model assumes about how people decide and then testing each assumption. The three items appear in the unit with their intuitive and correct answers, and the quiz of the unit, in keeping with its subject, contains several questions whose first apparent answer is wrong. The unit's weekly dataset is Gapminder's Worldview Upgrader, a quiz of a different kind that shows how systematically people's intuitions about the world are off.

Study the economy properly

The Economics Masterclass: weekly units, quizzes, a final exam, and a certificate.
About the program