1 of 15

Marianna Ruggerio

Auburn High School

Rockford, IL

An Intervention for Multiple Choice

This work is supported in part by NSF DRL 20-10188

2 of 15

In 2018 5.2% of students earned a 5 on the AP Physics 1 Exam

6.8% vs 2.5%

3 of 15

“Typical” gaps in

APPC and AB Calc

4 of 15

58 out of 17589

5 of 15

What if… we remove the multiple choice?

6 of 15

Multiple Choice Expectations vs Reality

Previous experiences expect that students automatically know the answer

Students taught to read everything carefully, including all answer choices before selecting an answer

It’s not the free response, so no reason to write!

Physics problems are rarely questions where the answer is automatically known, obvious or intuitive.

Reading all of the answer choices can lead to more confusion

Physics problems often require diagramming and mathematical reasoning to obtain a valid solution with evidence.

7 of 15

8 of 15

Intervention: Goaless Problems

9 of 15

10 of 15

Students work through the goalless version of the test

After 1-5 days students take the exam

Repeat for every unit exam; remove the intervention for the last exam

Intervention Process

11 of 15

I know what you’re thinking…

“Doesn’t this inflate everyone’s scores?

12 of 15

No.

13 of 15

Results Kinematics Exam �Pretest vs Kinematics Test

14 of 15

Results - Intervention Removed

Pretest vs Momentum Exam (Jan)

15 of 15

Thank You! Questions?

  1. Goalless problems from the multiple choice are used 1-5 days prior to exam for student discussion
  2. Exam has same items
  3. Intervention seems to improve scores of students who generally perform well in class, but poorly on exams
  4. Intervention closes some of the gap between male and female students

@msruggerio

Blog

Slides