Constructed Response Scoring Training – Social Studies

Winter 2023

Social Studies—�Short Constructed Responses (SCRs)

• Social Studies SCRs are all worth 2 points.
• Students type responses into a response field.
• Responses are limited to 475 characters
• Responses are scored by human raters.
• Raters are trained to score one item at a time.
• Rater training consists of:
• Prompt and Rubric
• Anchor Set
• Practice (Training) Set
• Qualification Set

2

Annotations

• Explain how the response meets the score-point criteria
• Apply the language of the rubric
• Focus on strengths and/or weaknesses of the response
• Are written in the present tense and in the active voice
• Have straightforward language and syntax
• May reference parts of the student response in quotations

​

​

3

Social Studies SCR Prompt

4

Social Studies SCR Rubric

5

Anchor Set

6

Anchor Responses

• Designed to exemplify the rubric score-point descriptions
• Agreed upon by an educator committee
• Further define the range that exists within each score point
• The “backbone” of scoring

​

​

7

8

Score: 0

The student response (“to get earns from many thing you dont own”) does not correctly define the economic policy of mercantilism. The student does not attempt to explain how mercantilism helped cause the American Revolution.

Anchor 0A

9

Score: 0

The student response (“is a way the usa maked money with imports and exports”) does not correctly define the economic policy of mercantilism. The student does not attempt to answer how it helped cause the American Revolution.

Anchor 0B

10

Score: 1

The student response (“ways that products/crops were sold and traded, like factories, crops and shipping”) fails to correctly identify the economic system of mercantilism. The student correctly identifies a colonial response to mercantilism (“boycotting the taxes on imported goods”).

Anchor 1A

11

Score: 1

The student response (“us would give raw materials to britain would turn into manufactured goods and trade whit the US and the Us could only trade with britain”) adequately defines the economic policy of mercantilism. The student does not explain how mercantilism helped cause the American Revolution.

Anchor 1B

12

Score: 2

The student response (“territory is only allowed to trade with their mother-country”) correctly defines the economic policy of mercantilism. The student also provides a correct effect of British policy (“salutary neglect”) explaining how mercantilism helped cause the American Revolution.

Anchor 2A

13

Score: 2

The student response (“send them materials … make those materials into goods and sell them”) adequately explains the policy of mercantilism. The student also provides an example of resentment over unfair laws as a cause of the American Revolution.

Anchor 2B

Practice Set

14

Practice Responses

• Practice (Training) Responses
• Designed to define score-point ranges
• May include borderline papers
• May include alternate, correct ways to answer the prompt
• For this exercise:
• Vote on a score in the poll
• Facilitator will reveal score and annotation

​

​

​

15

16

Practice Response A

17

Practice Response A

Score: 1

The student response (“a strong government takes control … forces it to only trade with them”) fails to correctly define the economic policy of mercantilism. The student provides an example of restricted colonial trade as a cause of the American Revolution.

18

Practice Response B

19

Score: 2

The student response (“motherland … to make new goods from raw materials and selling them back to the colonies”) correctly defines the economic policy of mercantilism. The student also provides an example of resentment over unfair laws and taxes as a cause of the American Revolution.

Practice Response B

20

Practice Response C

21

Score: 0

The student response (“to give profit”) fails to provide a definition of mercantilism. The student does not provide an example of how mercantilism helped cause the American Revolution.

Practice Response C

22

Practice Response D

23

Score: 2

The student response (“you buy (import) as little as posible and sell (export) as much as possible”) correctly explains the economic policy of mercantilism. The student provides an example (“Great Britain restricted the American colonies trade”) as a cause of the American Revolution.

Practice Response D

24

Practice Response E

25

Score: 1

The student response does not adequately define the economic policy of mercantilism. The student provides an example (“tax or tariff was put on any imported goods … anger people”) of how mercantilism helped cause the American Revolution.

Practice Response E

Qualification Set

26

Qualification Responses

• Qualification Responses
• Given to raters after training but before scoring
• Raters must achieve 8 out of 10 exact agreement to qualify to score (on 1 out of 2 sets)
• Training should be sufficient to score all responses in the set
• For this exercise:
• Score 5 responses independently
• Facilitator will reveal scores and annotations after everyone has completed the set

​

​

27

28

Qualification Response A

29

Qualification Response B

30

Qualification Response C

31

Qualification Response D

32

Qualification Response E

33

Score: 0

The student response (“when America is growing”) does not correctly define the economic policy of mercantilism. The student response (“by noticing its independence”) does not provide a cause of the American Revolution.

Qualification Response A

34

Score: 2

The student response (“a mother country importing less than it exports … to increase profit”) correctly defines the economic policy of mercantilism. The student provides an example of restricted colonial trade (“freedom to trade”) as a cause of the American Revolution.

Qualification Response B

35

Score: 1

The student response (“export goods and sell them … more than you import”) adequately explains the economic policy of mercantilism. The student does not provide a clear example of did how mercantilism helped cause the American Revolution.

Qualification Response C

36

Score: 1

The student response (“colonies sent raw materials … Britain would send back manufactured goods”) correctly describes the economic policy of mercantilism. The student fails to provide a clear example mercantilism helped cause the American Revolution.

Qualification Response D

37

Score: 2

The student response (“that benefits the mother country”) correctly describes the economic policy of mercantilism. The student provides a clear example of restriction of trade as a cause of the American Revolution.

Qualification Response E

Questions?

38

Next Steps

• Breakout rooms
• Response selection (Anchor, Practice, Qualification)
• Annotate selected responses
• Train your item!

​

​

39