1 of 35

Just the Facts:

Accountability for Classroom Teachers

Chris Julian

2 of 35

Goals & Agenda

  • Build Understanding of Texas Accountability System to assist teachers in decision making.

  • Warm-up
  • A-F Overview
  • Domain 1 (Student Performance) Overview
  • Domain 2B (Relative Performance) Overview
  • Domain 2A (Growth) Overview
  • Domain 3 (Closing the gaps) Explanation

STAAR Alt. 2 counts the same as STAAR!

TELPAS is calculated only in Domain 3

High School- CCMR & Graduation is not included in this conversation

3 of 35

Tools & Resources

www.cfbisd.edu/assessment

Eduphoria Help

Lead4ward

4 of 35

5 of 35

Mastery Tracker

6 of 35

Learning Target

  • Participants will walk away with 3 key concepts that impact all aspects of instruction.
  • Participants will be able calculate A-F scores for any grade, content level, or campus.
  • Participants will explore ways to connect A-F to decisions made in the classroom.

7 of 35

Getting to know you!

  • Fist to 4 - Please rank your level of understanding of the A-F system.
    • 4 - Extremely knowledgeable
    • 3 – Very knowledgeable
    • 2 – Somewhat knowledgeable
    • 1 – Very limited knowledge

Share with your table,

Name, grade, experience, why you ranked your understanding as you did.

8 of 35

Norms

  • Have fun
  • Problem solve
  • Lean into discomfort
  • Engage actively
  • Ask questions
  • Make connections with others

9 of 35

Start with the WHY?

  • Discuss with a partner!
    • And share out…

  • Why has the state adopted an A-F Accountability system?

10 of 35

Overall Rating

  • Intent
  • Communication
  • Implications

11 of 35

overall rating

  • 30% on Domain III
  • 70% on the better of Domain I or Domain II
  • Since Domain II is the better of Part A or Part B
  • 70% of the overall rating will be based on the BEST of
    • Domain I
    • Domain II – Part A
    • Domain II – Part B

Best

Score

OR

OR

Domain III

30%

Better of

Domain I

or

Domain II

70%

Domain 1

Domain 2A

Domain 2B

12 of 35

Comprehension Check

Fill in the blanks

  • Campus’ final letter grade equals the highest score from domain ___ or ___ multiplied by ___ and the domain ___ score multiplied by ___.

  • Domain 2 score equals the high score from Domain ___ or ___.

13 of 35

Domain 1 Performance

  • Calculating a Domain 1 Score
    • Approaches + Meets + Masters
    • Meets + Masters
    • Masters
    • Divide by 3 =
    • Component Score
  • Scaling Component Scores to Letter Grades

14 of 35

STAAR Performance

87 + 52 + 18 = 157

157 ÷ 3 = 52.3

Student Achievement Score = 52

15 of 35

Reflection Question

  • Which performance levels carry the most weight in the calculation of Domain 1 (Approaches, Meets or Masters)?

  • Understanding this system and how Domain 1 is calculated, what are the implications for classroom teachers?

16 of 35

Scaling

  • Nobody knows what a 52 represents for a component score, but we all know that an “A” is good and an “F” is bad.

17 of 35

Scaling Activity

  • I need 10 Volunteers

18 of 35

scaling of domain scores

the solution …

… convert the domain scores to a common scale!

  • Order 2016-17 scores from highest to lowest
  • Determine
    • Top 10%
    • Next 20%
    • Next 40%
    • Next 20%
    • Bottom 10%
  • Scale the Domain Scores
    • A = 90 to 100
    • B = 80 to 89
    • C = 70 to 79
    • D = 60 to 69
    • F = Below 60

Domain

I

Domain

II

Part A

Domain

II

Part B

Domain

1

19 of 35

Knowledge Check?�Fill in the blanks!

  • The Domain 1 Component score is calculated by adding together the percentage of scores at __________, ___________, and __________ and dividing by ___.

  • This score is then scaled (curved) based on 2022 STAAR performance.

  • The lowest scaled score possible is a _____ and the highest scaled score is a ____.
  • Across the state, scaled scores between 70 and 79 (C’s) represent ___ % of total scores across the state.

20 of 35

Reflective Question

  • Since scores across the state are scaled every 5 years and not every year, this means that every school across the state could be an “A” hypothetically.

  • Since 2023 is a re-scaling year, which holds more weight this year?
    • How each campus performs compared to last year or
    • How each campus performs compared to every other campus in the state?

21 of 35

School Progress Domain� Relative Performance

  • Methodology
    • For each district/campus, look at 2 measures
      1. Domain I Score
        • STAAR Performance Only, OR
        • Average of STAAR Performance and CCMR
      2. % EcoDis Students
    • Compare

Relative Performance

ACTUAL Domain I Score

to

PREDICTED Domain I Score

(for a district/campus with the same % EcoDis)

22 of 35

1. TEA maps actual data for campuses and districts based on 2 variables

    • Student Achievement Score (y axis)
    • Fall Snapshot % of EcoDis students (x axis)

Student Achievement

(STAAR Performance or Average of STAAR Performance and CCMR)

x axis

y axis

2. TEA then ran a quadratic regression analysis to generate a curved “line of best fit”

3. TEA then determined performance bands based on distances above or below the “line of best fit”

23 of 35

Gray Band: Actual Performance is in the Range of “Average” (or Predicted) Performance

Green Band: Actual Performance is WAY above “Average” (or Predicted) Performance

Blue Band: Actual Performance is WELL above “Average” (or Predicted) Performance

Yellow Band: Actual Performance is WELL below “Average” (or Predicted) Performance

Orange Band: Actual Performance is WAY below “Average” (or Predicted) Performance

Student Achievement

(STAAR Performance or Average of STAAR Performance and CCMR)

24 of 35

Student Achievement

(STAAR Performance or Average of STAAR Performance and CCMR)

What about 2 campuses with the SAME Domain I Score, but different %ages of EcoDis?

Domain I Score = 66

?

?

C

A

25 of 35

Knowledge Check �Fill in the blanks

  • A Campus’s Domain 2B score is provided based on two criteria or factors, on the X axis is the percentage of students classified as ________ ________ and on the y axis is the __________ score.

26 of 35

Part A: Academic Growth

  • Methodology
    • Calculate based on Reading and Math combined results (beginning at Grade 4)
      • Reading tests: Grades 4-English II
      • Math tests: Grades 4-Algebra I
      • High School- Welcome to the growth party!
    • Must have a test that aligns by subject and grade
      • In 2023 English & Spanish will count towards growth
    • Success =
      • Maintain Performance Level
      • Meet STAAR Progress

Academic Growth

27 of 35

Domain II – Part A��Academic Growth (Illustrated using a Single Test)

28 of 35

Domain II – Part A��Academic Growth (Illustrated using a Single Test)

29 of 35

Reflection Question

  • Understanding how the growth scores are calculated, what does this mean for the classroom teacher?

30 of 35

Changes in 2023

31 of 35

Accelerated Instruction Bonus

32 of 35

Knowledge Check �Fill in the blanks

Knowledge Check �Fill in the blanks

  • A Campus’s Domain 2A score is calculated by dividing the total number of tests that did better than the year before and dividing by the _________________.

  • A 2019 Campus progress point is determined by comparing each students performance from _____ STAAR to _____ STAAR (or STAAR Alt. 2).

  • Starting in 2023, ____ points are added to this score for every student that moves from _______ _____ _________ to Approaches, Meets or Masters.

33 of 35

Reflection Question

  • Knowing how growth is calculated, how may this impact how we talk to our students about their performance on STAAR, MAP or Interim Assessments?

34 of 35

Closing the Gaps

  • 30% of the total rating is Domain 3
  • Federal Accountability requires that a minimum of 30% of a campus’ state accountability rating hold us accountable for sub-groups and special populations.

35 of 35

Contact Me

  • julianc@cfbisd.edu
  • 972-968-6541