Shut Up and Listen to Your Students refsmmat.com

Educational innovation in the past few years has focused on new ways to deliver lectures and textbooks. With Udacity, Coursera, OpenCourseWare and Khan Academy we can watch well-made lectures delivered by professional educators; with Inkling, iBooks and CK-12 we can read textbooks on our laptops and tablets. We can deliver knowledge to thousands of students with a single website. But we haven’t stopped to consider a simple question:

Will it help us learn?

After all, we’ve been using the same educational model for hundreds of years – since before books were invented. We have professors concoct explanations of scientific concepts, deliver them by lecture, create their own diagrams on the chalkboard, and answer student questions. Videos and interactive textbooks are merely new flavors of the same techniques.

We can all agree that science education needs improvement; new articles appear every few months bemoaning its poor state. Much of the recent innovation focuses on bringing science and math to the masses through online videos and interactive textbooks. But our fundamental model of teaching is broken. We don’t need videos and flashy ebooks. We need to stop lecturing. Shut up and listen to your students.

Traditional lectures We have a traditional model of teaching: the professor understands the subject and devises an explanation of the crucial concepts and facts the students need to understand. The professor delivers this explanation as a lecture, standing in front of the class and narrating it to the students. The students, if they are attentive and the explanation is good, will now understand the concepts, and they’ll do some homework for practice. Essentially, the professor is an explanation delivery device, and the students are explanation receptacles. We like professors that devise particularly clear or elegant explanations, and professors like students that pay attention. We innovate by finding new ways to deliver explanations in videos and textbooks and exploring new ways to keep student attention. So, how well is this model doing? Let’s look at physics, because I’m a physics major and I’ve been sufficiently bored to research the field in depth.

Evaluating physics teaching In physics, there’s a conceptual test of introductory Newtonian mechanics called the Force Concept Inventory. We can administer this test before and after a course to determine how much benefit the students get out of the class. We use something called the normalized gain: \[\langle g \rangle = \frac{\%\langle \mbox{post} \rangle - \% \langle\mbox{pre}\rangle}{100 - \% \langle \mbox{pre} \rangle }\] The normalized gain tells us how much scores improved, out of how much they could possibly have improved. A student who gets eight out of ten questions right the first time (\(\% \langle\mbox{pre}\rangle = 80\%\)) and nine out of ten the second time (\(\% \langle\mbox{post}\rangle = 90\%\)) has improved half as much as he could have. There have been many surveys of normalized gain in regular old lecture-style introductory physics classes. The largest available sample, including 2,084 students, gives this result: \[\langle g \rangle = 0.23 \pm 0.04\] That is: students started off with a gap in their knowledge. At the end of the semester, they had filled about a quarter of it. The FCI isn’t particularly hard – many instructors refused to use its questions on exams on the grounds that they’re too easy. It’s not that students already knew too much about physics, either. Initial scores were often lower than 50%. So what causes these low gains? Something in our lecture model is broken, but what? In short: the problem is misconceptions.

Misconceptions Misconceptions are like cockroaches. You have no idea where they came from, but they’re everywhere – often where you don’t expect them – and they’re impervious to nuclear weapons. Many scientific concepts contradict what we experience day-to-day, or don’t relate to our experience at all. To learn science, you need a strong foundation of basic concepts. And students come to your class with their own ideas about those basic concepts – and in science, their ideas are usually wrong. Very, very wrong. Here’s a fun list of misconceptions students often have in introductory physics courses: Students think force is always necessary to sustain motion, no matter how many times you repeat Newton’s First Law

Students confuse velocity and acceleration ( \(a = \frac{dv}{dt}\) )

) Students confuse force and momentum ( \(F= \frac{dp}{dt}\) )

) Students don’t believe in “passive” forces, such as normal forces, despite hearing Newton’s Third Law in their first week of class A teacher can’t communicate with students without a shared vocabulary; when students have such deep misconceptions about fundamental concepts, your explanations cannot work! Students will try to combine their broken ideas with your misunderstood explanations, and they will succeed – in producing incoherent and often self-contradictory mental models of reality. Even worse, students with misconceptions often believe that lectures agree with them. Students who watch lectures contradicting their misconceptions report greater confidence in their misconceptions afterwards, and do no better on simple tests of their knowledge. Often they report not paying much attention, because the lectures allegedly cover concepts they already “know.” (Professors often lament that students don’t ask them questions. “I can’t tell if you’re confused if you don’t ask me questions!” But you can’t trust students to recognize they hold misconceptions. And when students do ask questions, professors often respond before they can finish, not realizing that the question comes from a deeper misconception.) We can see this in action in the classroom when students watch lecture demonstrations. Demonstrations are a cornerstone of the introductory physics experience, but do they help?

Lecture demonstrations Lecture demonstrations show real-world applications, turning abstract concepts into concrete ones, and they spark questions from the students. They appeal to students who think visually, and they’re generally good fun. (Who wouldn’t want to put a cinderblock on their professor’s chest and smash him with a sledgehammer?) Hence, lecture demos should be a good thing. But we can test this. Suppose you have two classes: one which sees the lecture demo and hears an explanation of it from their professor, and one which never sees the demo. At the end of the semester, you ask them to (a) predict the outcome of an experiment just like the lecture demo, and (b) explain that outcome. You compare the students in each class against each other. This was tried in a 2004 study: Improvement over the control group, which did not see the demo. Simply watching the demo provided no statistically significant benefit in student ability to explain the demonstration’s results, although they became slightly better at predicting its outcome. Yay, our students can remember what they saw! But only 24% of the students who watched the demo could explain it. This is worrisome, but it fits with our misconception hypothesis. Students with misconceptions view lecture demos and don’t realize their misconception doesn’t fit with reality – they just invent horrible new misconceptions to make the new data fit in. But perhaps we can alter how demonstrations are used to prevent this. The study actually used lecture demos three different ways: Just show the demo and let students observe Ask students to predict the outcome before the demo Have students predict the outcome, observe the demo, then discuss the results with their peers Each group also heard an explanation of the demo from their professor afterward. The result: Comparison between the three methods, in terms of improvement over the no-demo control group. Correct explanation rate in the “discuss” group is still just 32%. Students forced to make predictions were able to correct their misconceptions and produce correct explanations in far greater rates. The predictions forced their hands: it is easy to rationalize what you see after the fact, but it is much harder when you have seen your concrete prediction falsified. How can we extend this success to the classroom?

Lecture inversion Students should learn before class. Class is a time to diagnose problems and fix misunderstanding. Professors and teachers should force students to confront their misconceptions. How to do this? One popular method is peer instruction, a method largely devised by professor Eric Mazur of Harvard University. The basic method is simple: Use pre-class readings/videos to cover the material

Use class to review basic concepts, then ask conceptual questions

Students choose answers and discuss before you explain the correct answer

Listen to students as they discuss, to spot problems The miracle of textbooks – and iPads, and video lectures, and so on – is that students can learn from a carefully-crafted explanation that is developed once and widely distributed, rather than forcing professors to devise their own lectures. Professors can instead focus on drawing out the misconceptions and exterminating them by forcing students to make predictions, discuss concepts with peers, and see when they’re wrong.

Does it work? Several universities have compared interactive teaching and peer instruction to their conventional lectures: Harvard: improved from \(\langle g \rangle = 0.25\) to \(\langle g \rangle = 0.62\)

to John Abbot College: improved from \(\langle g \rangle = 0.33\) to \(\langle g \rangle = 0.50\)

to University of British Columbia (quantum physics course): improved from \(\langle g \rangle \approx 0.53\) to \(\langle g \rangle \approx 0.79\) (estimated)

to (estimated) A survey of 48 courses at various colleges and high schools: \(\langle g \rangle \approx 0.23 \pm 0.04\) for traditional courses, and \(\langle g \rangle \approx 0.48 \pm 0.14\) for interactive courses These results show a decided advantage for peer instruction and similar interactive courses over traditional courses, for both introductory physics and quantum mechanics. The method has also been tried in introductory chemistry, mathematics and biology, to great success. Now, if you’re still having a hard time believing this, then I have one more study. In this study, students taught in an interactive inquiry-based course (where students discover concepts for themselves, guided by a professor or teaching assistants) were compared against honors physics students, engineering students, and non-science majors, all taught in traditional lecture-based courses. They were evaluated on four questions. Two were synthesis questions, requiring the students to predict – without calculations – what would happen in a simple electric circuit when various bits were added or removed. The other two questions were analysis questions, asking for computations of resistance and current in a simple circuit. Here are the results: Inquiry-based physics students outperform engineers. The inquiry-based students creamed everyone else on the synthesis questions, and were only bested by honors physics students on the analysis questions. The honors students were great at churning through equations (for the analysis questions) but didn’t understand the concepts well enough to answer the synthesis questions. You might wonder what kind of students were in the inquiry-based physics class. Physics majors? No. Engineers? No. Science majors? No. It was an introductory physics course for elementary education majors. Really.

Conclusions Lectures are not a substitute for hands-on teacher-student time, no matter how you deliver them. Coursera, Udacity and Khan Academy can be great supplementary resources, but students will not significantly improve their understanding without active engagement with a live teacher. I don’t expect the wave of new online resources to bring substantial benefit to science and mathematics students. By engaging your students, drawing out their misconceptions, and listening to them, you can make them perform better. Writing better textbooks or giving better lectures can never replace interactive teaching. Shut up and listen to your students.