1 of 73

Trainers put the Likert scale on the entry door with a pencil/tape or string:

I can define the term “assessment literacy”

Use the letter “AM” to mark current reality - With quantifiers of “I’ve never heard it, I have a general idea, I could direct quote Stiggins himself!”

2 of 73

Welcome!

  1. Please mark the entry question (on the center door)
  2. Sit with your same level and content colleagues.
  3. Fill out a name tag with your name, school and grade/content.

3 of 73

Sound Assessment Institute

Day 1 Open - October 2019 Cadre

4 of 73

Moving the Mission

Our promise is to engage, inspire and prepare all students to lead, learn and contribute toward a just society, both local and global.

5 of 73

Ensuring Equity - Guaranteed & Viable Curriculum

District Guaranteed and Viable Core Curriculum

Unit summative assessments of priority standards

Projection Map of standards, prioritized and grouped by unit, with timelines

+

=

6 of 73

Data Teams

The purpose of the Data Teams process is to improve instruction by using data to regularly analyze the impact of classroom instructional strategies and practices on student outcomes - and to do that collaboratively, through professional conversations.

7 of 73

Data Teams

This work - learning and using sound assessment practices, lives in Step 1 of the Data Teams Process.

8 of 73

District Guaranteed and Viable Core Curriculum

Unit summative assessments of priority standards

Deconstructed standards

Standard specific language and forms & function(s)

Projection Map of standards, prioritized and grouped by unit, with timelines

Instructional Strategies

Materials

Formative Assessments

Building Data Team

Unit and Lesson Mapping

9 of 73

Questions Surfacing Through This Work

Shared Understanding of Proficiency

  • What does it mean to be proficient on a standard?
  • What standards need to be commonly assessed, measured and graded?

Confusion about Data Teams in general

  • When will be ready to cycle?
  • Step 1 is the necessary foundation for Steps 2-7
  • Rumors - are Data Teams going away?

10 of 73

This Work

  • As more teachers go through this process, the easier it will be to come to consensus on proficiency questions.
  • Five Days is a long time to be out of the classroom - the long term outcome of Equitable outcomes for all students outweighs the short term impacts.
  • Equitable support for All students is worth it.

  • Our Asks:
    • Set aside questions and frustrations
    • Make this time worth it for you
    • EdEx will ask for feedback and make adjustments along the way

11 of 73

Assessment Cadre

Day 1: Keys to Quality Introduction

Woodburn School District

October 2019

SIGNAL WORD: Sound Design + Do it Right, Use it Well!

12 of 73

Meet your Trainers

Ali Hurd

Andrea Sande

Missi Thurman

Meagan Kimball

www.EducationalExcellence.org

13 of 73

Who’s in the Room?

Introduce yourself, your current position and tell what is the worst way you have had to spend money as an adult...barring medical expenses!

14 of 73

OBJECTIVES FOR THE DAY

  • Improve the Link Between Data Teams and Quality Assessments
  • Introduce Keys to Quality Assessment - Key 1: Clear Purpose and Key 2: Clear Targets
  • Begin to Build Shared Understanding of Key 3: Sound Design
  • Provide an opportunity for reflection & work time

4

15 of 73

Give One, Get One

What is one aspect of assessment you feel confident with and one you are hoping to learn during this series?

5

16 of 73

The Plan

Working together as teams to put

new learning into practice.

17 of 73

Why Norms?

“The establishment and adherence to team norms helps build team discipline, trust between team members, and supports a safe environment…”

18 of 73

Proposed Starter Norms:

  1. This is a safe learning place
  2. We will seek to understand before making assumptions
  3. Pull your own learning wagon
  4. Be mindful about time
  5. Add a “support member chair”
  6. Utilize Decision Rules
  7. Anything else?

Talk as a team. How do you want to go about making decisions? Consensus? Fist to Five? Majority? Other?

With the cardstock, make a table tent with your grade level and/or content on one side and your decision rule on the other.

19 of 73

Managing our Work Time:

Colorful Cups

We are making steady progress, no questions at this time

We are making some progress, but have a question/s

We are stuck and need help ASAP

We are moving on to our next unit/assessment

20 of 73

Work Time Monitoring

3

21 of 73

Connecting to Data Teams:

An Input Chart

22 of 73

23 of 73

24 of 73

NO

?

Yes, but...

25 of 73

26 of 73

27 of 73

28 of 73

Let’s Pause to Reflect!

Turn and Talk:

What is the connection between data teams and quality assessment? Why do they matter to each other?

29 of 73

Key 2:

6

Key 1:

Key 3:

Key 4:

Key 5:

30 of 73

That’s great...

but why do I need to know this?

31 of 73

Life in the World of Assessment

Thought Processes?

Criteria?

Flexible Thinking?

Skills?

Efficiency?

32 of 73

“When I refer to assessment literacy, I'm not thinking about a large collection of abstruse notions unrelated to the day-to-day decisions that educators face. “

“On the contrary, assessment-literate educators need to understand a relatively small number of common sense measurement fundamentals, not a stack of psychometric exotica.”

- W. James Popham

Educational Leadership: Improving Professional Practice: “All About Accountability / Needed: A Dose of Assessment Literacy”

33 of 73

Which means…

We’ve distilled these ideas down to the basics.

If we present it here, it’s because you need it!

34 of 73

Key One Question: Clear Purpose

Summative or Formative?

Dylan Wiliam: Plane Analogy

  • Formative: ongoing, improves achievement and supports learning
    • FORMAL and INFORMAL processes
  • Summative: to measure, verify learning, check program effectiveness

Remember, no one assessment can fill everyone’s information needs!

35 of 73

Assessment List

  • SBAC assessments
  • Progress Monitors/Quiz
  • Classwork
  • Pre-assessment
  • End of Unit Assessment
  • Ticket out the Door/Exit Tickets
  • State Writing Assessment
  • Homework
  • English Language Proficiency Assessment

7

36 of 73

Work Time: Shared Example

Looking at the shared example...

  • Does it appear to be formative or summative?
  • Which stakeholder needs are likely being met by the way it is used?

8

37 of 73

Team Time:

Your Own Assessment Work Time

  • What type of assessment are you making?
    • Formative or Summative

  • Which stakeholder needs, need to be met by the assessment you create?
    • Consider ideal use

38 of 73

Time for a break!

Please come back in 10 minutes

39 of 73

Key to Quality Two: Clear Targets

  • Learning Targets make it clear to the teacher & the student the purpose of the instruction
  • There are different kinds of targets
  • Classroom assessments must reflect the learning targets: what was taught, what students had the opportunity to learn, or what students will have opportunity to learn

Hint: This matters!

40 of 73

What are the Five Types of Targets?

  • Knowledge Targets

  • Reasoning Targets
  • Skill Targets
  • Product Targets
  • Disposition Targets

9

41 of 73

I can explain how incentives influence choices.

I can develop a model to illustrate the role of photosynthesis.

I can identify strategies for establishing and maintaining a good credit rating.

I can engage in informed and respectful deliberation and discussion of issues, events, and ideas.

I believe there can be more than one right answer to a problem.

I can predict the motion of orbiting objects in the solar system.

I can present information clearly, concisely, and logically.

I recognize the importance of treating others with respect including gender expression.

Name that Target Type!

K=Knowledge S=Skill

R=Reasoning P=Product

D=Disposition

10

42 of 73

Review: Types of Learning Targets

Record Key Words & Sketch to Remember

43 of 73

Five Types of Learning Targets

  • Knowledge Targets: Factual information, procedural knowledge, and conceptual understandings underpinning each discipline
  • Reasoning Targets: Thought processes students are to learn to do well within a range of subjects
  • Skill Targets: Demonstration or physical skill-based performance is at the heart of the learning
  • Product Targets: Where creation of a product is the focus of the learning. Specifications for quality of the product itself are the focus of teaching and assessment
  • Disposition Targets: Attitudes, motivations, and interests that affect students’ approach to learning

10

44 of 73

I can explain how incentives influence choices.

I can develop a model to illustrate the role of photosynthesis.

I can identify strategies for establishing and maintaining a good credit rating.

I can engage in informed and respectful deliberation and discussion of issues, events, and ideas.

I believe there can be more than one right answer to a problem.

I can predict the motion of orbiting objects in the solar system.

I can present information clearly, concisely, and logically.

I recognize the importance of treating others with respect including gender expression.

R

P

S

K

R

D

S

D

Self Reflection: Take a moment to revise based on any new learning!

45 of 73

46 of 73

K =

K targets

R =

K + R targets

S =

K + R + S targets

P =

K + R +S*+P targets

(*Not always S)

If a standard is knowledge then…

If a standard is reasoning then…

If a standard is a skill then…

If a standard is a product then…

*Disposition can both stand alone or be paired with any other target type.

47 of 73

Work Time: Shared Example

Looking at the shared example...

  • Are the targets clear?
  • What are the target types?
  • Are they labeled/categorized correctly?

8-9

48 of 73

Work Time:

On Your Own Assessment

Looking at your standards...

  • Are the targets clear?
  • What are the target types?
  • Are they labeled/categorized correctly?
  • Revise as needed

49 of 73

Key Three:

Sound Design Competencies

Learning targets are translated into assessments that yield accurate results.

  • Design assessments to serve intended formative and summative purposes.
  • Select assessment methods to match intended learning targets.
  • Understand and apply principles of sampling learning appropriately.
  • Write and/or select assessment items, tasks, scoring guides, and rubrics that meet standards of quality.
  • Know and avoid sources of bias that distort results.

50 of 73

  1. Alignment to the Standard
    1. Read the full standard
    2. Glance over the assessment, taking note of matches/mismatches to the nouns & verbs of the standard

Shared Example: Sound Design

“Look Fors”

2. Target Sampling: Look at each question individually and

mark the part of the standard it addresses (add tallies for

those covered more than once)

    • Note elements that are not covered at all or are too heavily weighted (could sway results)

11

51 of 73

Target Matched to Question Example

ATOD-CC Explain short and long term effects of alcohol, tobacco, inhalants, and other drug use, including anabolic steroids, performance enhancing drugs and controlled substances.

11

52 of 73

Work Time:

On Your Own Assessment

  • Alignment to the Standard, read the full standard.
    • Does it match/mismatch the nouns & verbs of the standard?
  • Look at each question individually and mark the part of the standard it addresses (add tallies for those covered more than once)
    • Note elements that are not covered at all or are too heavily weighted

53 of 73

Lunch

54 of 73

Key Three:

Sound Design Competencies

Learning targets are translated into assessments that yield accurate results.

  • Design assessments to serve intended formative and summative purposes.
  • Select assessment methods to match intended learning targets.
  • Understand and apply principles of sampling learning appropriately.
  • Write and/or select assessment items, tasks, scoring guides, and rubrics that meet standards of quality.
  • Know and avoid sources of bias that distort results.

55 of 73

It’s Time for a Race!

Quick Brainstorm-

Write down every method you

can think of for assessing…

When you have 10, stand up!

Ready? Go!!!

4

56 of 73

Assessment Methods

  • Selected Response

Students select the correct or best response from a list provided.

  • Personal Communication

Students share what they have learned through structured and unstructured interactions with teachers.

  • Performance Assessment

Students complete a task that is evaluated by judging the level of quality using a rubric.

  • Written Response

Students construct an answer in response to a question or task rather than to select the answer from a list.

Where did the majority of the methods you brainstormed fall?

16

57 of 73

Target Method Match

Selected Response

Written Response

Performance Assessment

Personal Communication

Knowledge

Reasoning

Skill

Product

Yes? No? Maybe?

12

58 of 73

59 of 73

Roadmaps to Learning

Common Core State Standards

Identify desired results.

(Targets)

Determine acceptable evidence. (Assessment)

Plan learning experiences and instruction. (Strategies and Lessons)

60 of 73

61 of 73

A Real Life Example

A Real Life Example

62 of 73

If CFAs are the tool we are going to use� then how do we do it right… �so we can use it well?

63 of 73

Target Method Match

Selected Response

Written Response

Performance Assessment

Personal Communication

Knowledge

Good

Strong

Partial

Strong

Reasoning

Good*

Strong

Partial*

Strong

Skill

Partial/Poor*

Poor

Strong

Partial

Product

Poor

Poor*

Strong

Poor

17

64 of 73

Work Time: Shared Example

Looking at the shared example...

  • What methods are used?
  • Do they match the target types?
  • Are the methods selected the most efficient way to get actionable information?

9

65 of 73

Work Time:

On Your Own Assessment

If you have an assessment you are working from:

  • What methods are used?
  • Do they match the target types?
  • Are the methods selected the most efficient way to get actionable information?
  • What changes do you want to make?

If you don’t have an assessment you are working from, look at your targets . . .

  • What methods might you use for each target type?
  • Which of these methods are the most efficient way to get accurate and actionable information?

66 of 73

Ticket out the door for break

Write down 1-2 questions (on separate sticky notes) and place them on the corresponding poster.

67 of 73

68 of 73

69 of 73

#informalassessment

#masterchefonfacebook

#TMMmatters

The Real EdEx Team

@TheRealEdExTeam

In 140 characters or less, record your biggest Ah-Ha moment for today. Be ready to share out.

#assessmentcadre

#shareyoursmarts

12

70 of 73

Zooming Out!

Start a brainstorm chart:

What formative assessments did you experience today?

71 of 73

Zooming Out!

How could you use/adapt to use these types of assessment strategies in your classroom/school?

72 of 73

Coming Soon!

  1. Assessment Plans
  2. Sample Size

73 of 73

THANK YOU

Your feedback is important to us.

Please fill out the last page of your

participant packet.

We read every response!

Ready for more? Buy this Book & READ it!

43