1 of 39

�Iowa Statewide Assessment of Student Progress

Statewide Curriculum Network �

Catherine Welch

Stephen Dunbar

University of Iowa

2 of 39

Today’s Presentation

Review Performance Standards Adoption Process 

​

Examine Impact Data

Next Steps

Discussion and Questions

3 of 39

Process for Standard Setting

4 of 39

Standard Setting Methodology

Extended Modified (Yes/No) Angoff Method

    • Standards-based method
    • Content-based judgments from experienced educators
    • Allows for different item types and scores and multiple performance levels
    • Successfully used for recommending standards for multiple assessment programs

5 of 39

6 of 39

What is Standard Setting?

ISASP General Session

6

Lower

Higher

Proficient

Advanced

Not Yet Proficient

Cut Scores

7 of 39

Panelists by Content and Grade Level

Grades

ELA

Math

Science

3-4

19

18

​

5-6

15

11

11

7-8

13

11

11

9

12

9

​

10

12

10

11

11

12

10

​

Total Panelists

83

69

33

8 of 39

Panelists by District Size and Location

​

ELA

Math

Science

Panelists

Percent

Rural

31

22

12

40.6%

Urban

21

20

7

30.0%

Suburban

21

16

10

29.4%

Small

18

16

10

27.5%

Medium

27

17

9

33.1%

Large

28

25

10

39.4%

9 of 39

Panelists by Gender and Race/Ethnicity

​

​

ELA

Math

Science

Panelists

Percent

State Percent*

Gender

Female

70

53

17

78.7%

75.7%

​

Male

13

12

13

21.3%

24.3%

Race/Ethnicity

African American

4

1

​

​

​

​

​

​

​

Hispanic

2

1

1

​

Asian

1

​

​

​

Minority

​

​

​

5.7%

2.5%

​

White

76

60

29

94.2%

97.5%

*Condition of Education, 2018 Annual Report

10 of 39

Panelists by Years of Experience

Years of Teaching

ELA

Math

Science

Less than 5

7

4

2

6 to 10

15

7

4

11 to 15

13

14

2

16 to 20

18

8

8

More than 20

31

33

16

11 of 39

Experience with Student Populations

​

ELA

Math

Science

Students receiving mainstream special education services

74

60

22

Students receiving self-contained special education services

32

23

6

Students who are English learners

50

43

18

12 of 39

13 of 39

English Language Arts�Cut Scores

14 of 39

Mathematics Cut Scores

15 of 39

Science Cut Scores

16 of 39

Examining Impact Data

17 of 39

Impact

398

447

18 of 39

Impact

Advanced

Proficient

Not-Yet-Proficient

398

447

19 of 39

Impact of ELA Cut Scores

20 of 39

Impact of Mathematics Cut Scores

21 of 39

Impact of Science Cut Scores

22 of 39

Comparing ISASP Performance to Previous State Performance

ISASP

Prior to ISASP

Full implementation of Iowa Core

Implementation of Iowa Core underway

Customized assessment aligned to Iowa Core

National assessment

ELA assessments in reading, writing and language

ELA assessed through reading

Grade specific assessments

Overlapping grade levels

Spring testing

All year testing

Standard setting using expert judgment and best practice methodologies

Standard setting using statistical procedures

23 of 39

Next Steps

24 of 39

Reports and Interpretation

Online

Access governed by user roles

Districts/Schools can print locally

Paper

Available for printing by Pearson

Window for availability and costs will be posted to the ISASP portal

Support/training materials for interpretation and use will be posted to the portal

25 of 39

Support for Interpretation

    • Accessing ISASP Results
    • Interpreting ISASP Results for Educators
    • Interpreting ISASP Results for Families (English and Spanish)

What information is available?

    • ISASP Portal (webinar and support materials)

Where do I find this information?

    • Available when reports are released

When will this information be available?

26 of 39

 

​

State Board of Education Meeting

September 12, 2019

 Validate Scales and Cut Scores

​

Rescore and Validate Student Data File

​

 Review and Approve Student Data File

​

  Generate Online Reports and Validate

​

  Release Reports to Districts

October 2019

27 of 39

Student Report�Page 1

  • Scale Score
  • Proficiency Level
  • Proficiency Level Descriptor

28 of 39

  1. Student Information
  2. Performance Meter – Provides a graphic of the student’s achievement level
  3. Scale Score
  4. Achievement Level
  5. Description of Performance

​

B

C

D

E

A

29 of 39

Achievement Levels

30 of 39

Student Report�Page 2

  • Domain Scores
  • Percent Correct

31 of 39

  1. Iowa Core Domains
  2. Percent Correct

A

B

32 of 39

Interpreting Domain Scores

​

Student

% Correct

State

% Correct

Operations and Algebraic Thinking

40

59

Number and Operations in Base Ten

60

58

Number and Operations -- Fractions

80

50

Measurement and Data

48

51

Geometry

57

64

33 of 39

Roster Reports

  • Mathematics, Science and ELA
  • ELA includes Reading and Language/Writing
  • By Grade
  • By Class/School/District

34 of 39

  1. ELA Total = Average of Reading and Language/Writing
  2. Students with valid scores
  3. Explanations for results that are not reported

A

B

C

35 of 39

36 of 39

Summary�Report

  • School
  • District
  • State

37 of 39

38 of 39

Additional Information

Iowa Percentile Ranks

Posted to ISASP Portal

Provides a point of reference

Growth

Available after 2020 data

College Readiness Information

Validity study

Link to ACT

39 of 39

�