(2) If it takes 5 machines 5 minutes to make 5 widgets, how long would it take 100 machines to make 100 widgets? _____ minutes

(3) In a lake, there is a patch of lily pads. Every day, the patch doubles in size. If it takes 48 days for the patch to cover the entire lake, how long would it take for the patch to cover half of the lake? _____ days

Have your answers? They might be wrong. They’re probably wrong; especially if you developed your answers quickly. But don’t feel down: Dr. Shane Frederick of Yale University administered this Cognitive Reflection Test to 3,428 people over a 26-month period beginning in January of 2003. The results? The mean score was 1.24 questions correct out of 3. Of the respondents, 33% answered zero questions correctly and only 17% answered all questions correctly. Among those questioned by Frederick and his colleagues were students at MIT, Harvard, and Princeton Universities (1)*.

Why did students from some of the most prestigious universities in the world answer these questions incorrectly?

They certainly don’t lack in IQ or educational background and opportunities; and, notice the instructions: there was no time limit. In his book Thinking, Fast and Slow, Dr. Daniel Kahneman discusses two systems for processing information (a “dual processing” theory). System 1, as Kahneman describes it, “operates automatically and quickly, with little or no effort and no sense of voluntary control.” System 2 “allocates attention to the effortful mental activities that demand it, including complex computations.” He goes on to state that questions requiring only intuition (System 1) are answered quickly, with very little thought, and with “cognitive ease”. If you got them wrong, you probably answered the three questions at the beginning of this article using System 1. Questions that require more thought, or “cognitive strain”, activate our more deliberate and effortful system of processing (System 2).

So how do we know whether to use System 1 or System 2 when confronted with information?

According to Kahneman, System 1 carries out assessment automatically and a decision is made regarding whether extra effort is needed to activate System 2. The poor scoring on the three-question Cognitive Reflection Test mentioned above is due to the fact that only System 1 was activated within many of the 3,428 students. Therefore, intuition was primarily responsible for the answers given. This can cause errors in thinking when confronted with such questions that appear to only require our automatic response, but actually require effortful consideration (2).

So how do we activate System 2 when information like that of the Cognitive Reflection Test is presented?

A different set of researchers took the Cognitive Reflection Test to college students once again – though this time to a much smaller sample of 40. This time half of the students received the questions in a normal, easily legible font. The responses recorded were very similar to the original scores. For the other group of students, they made the questions harder to read. They decreased the size of the font and presented it in a washed-out gray print (2).

The results were striking: When the questions were presented in the harder-to-read font, 65% of students answered all questions correctly; an improvement of 48%. Of those who took the original assessment, 90% made at least one error. That number dropped to 35% with at least one error when the font was harder to read; a decrease of 55%. Performance was actually better when reading was made more difficult. Why? One explanation is the increased cognitive strain. The less legible font encourages the System 2 level of processing, which is slower and more deliberate, and is more likely to reject the intuitive answer from System 1 (3).

How could the results of the Cognitive Reflection Test be applied to the classroom?

As an educator, I am always looking for ways to improve my student’s cognition and retention of material. Could just changing to a less-legible font during presentations, on graphic organizers, and on quizzes/tests really improve my student’s scores? One school district in Ohio experimented to find out.

Six different classes of children aged 15-18, ranging from the sciences to humanities were used in this study. The classes also ranged from regular classes to Advanced Placement classes. All teachers involved were blind to the hypothesis of the study and were required to have two sections of each class. One class would be used as the control and all handouts and PowerPoint presentations would be presented in a legible font. The experimental group would have the same handouts and PowerPoint materials presented in the following “disfluent” fonts: