1 of 33

PVAAS Update:

Building Your “PVAAS Toolbox”

PAIU- CC (in-person meeting)

November 16, 2023

and the PVAAS Statewide Team for PDE presents

Today’s slides will be posted in the chat. For a copy by email, contact pdepvaas@iu13.org

Watch for a survey link after today’s session!

2 of 33

Today’s Areas of Focus:

Outline the most common questions
Provide professional learning resources to support your work
Explore the new student data features in PVAAS

Connect available data to your work with leaders

Questions? Email pdepvaas@iu13.org

2

3 of 33

Common Questions

Here’s what’s been hitting our inbox. What have you heard?

Questions? Email pdepvaas@iu13.org

3

4 of 33

Common Question #1

Why can’t I access the Projection Summary?

To view projection summaries, LEAs had to submit their PIMS Student Enrollment templates by the October 5 deadline. The next deadline for submission was November 9.

Projections for individual students are available in PVAAS, using other reports, such as in the NEW Student Report and the Custom Student Report which can be used to manually create a projection summary.

Questions? Email pdepvaas@iu13.org

4

5 of 33

Common Question #2

Why can’t I see teacher-specific data?

Only a few account types have automatic access to teacher reporting (District Admin, School Admin). LEAs can provide access to other account holders by managing access.

Questions? Email pdepvaas@iu13.org

5

6 of 33

Common Question #3

Why didn’t a teacher receive a teacher value-added report?

There may be teachers who had verified rosters within the spring 2023 roster verification system but may not have received 2023 teacher-specific reporting.

There are criteria to receive teacher-specific reporting, such as

N count of at least 11
“FTE” N count of at least 6 – this means the equivalent of 6 students at 100%

Reminder: students verified at less than 10% instructional responsibility are excluded.

Questions? Email pdepvaas@iu13.org

6

7 of 33

Common Question #4

Is this a statewide trend in GRADE/SUBJECT?

We are not seeing trends of more Yellow/Red or more Blues in any grade or subject statewide.

Reminder: when Public Access for 2023 is released, districts can view this via statewide or regional scatterplots.

SY2022-2023 Scatterplots posted on PDE PVAAS Statewide Data page soon!

Questions? Email pdepvaas@iu13.org

7

8 of 33

Professional Learning

Mark your calendars!

The spring webinar series has been released.

Questions? Email pdepvaas@iu13.org

8

9 of 33

Webinars

Visit PDE PVAAS Professional Learning for the full listing of webinars!

Questions? Email pdepvaas@iu13.org

9

10 of 33

Roster Verification Webinars

Visit PDE PVAAS Roster Verification page for the webinars and registration links!

Questions? Email pdepvaas@iu13.org

10

11 of 33

Student Reporting

Accessing student data has never been easier!

Questions? Email pdepvaas@iu13.org

11

12 of 33

Student Data Answers…

What is the student’s achievement trend based on state (and local) assessment data?
What growth did the educational system have as the student moved from year to year?
Did the student meet or exceed their predicted score, based on the student’s prior achievement?
How is this student predicted to perform on upcoming assessments?

(PSSA, Keystone, AP, PSAT, SAT, ACT, ACCESS for ELLs)

12

Questions? Email pdepvaas@iu13.org

12

13 of 33

To Inform Decision-Making

Has past instructional programming been working for this student?
Should this student continue to receive instructional supports or enrichment?
Should this student be recommended to receive instructional supports or enrichment?
Should this student’s programming be modified?
Is this student on a path to proficiency (or above)?

13

Questions? Email pdepvaas@iu13.org

13

14 of 33

Visualize Data in Two Perspectives

Looking Back

Determining Effectiveness:

VALUE-ADDED GROWTH Data

Tracking �Student Progress:

TESTING History

Looking Forward

Planning for Students’ Needs:

Student PROJECTIONS �to Achievement

Questions? Email pdepvaas@iu13.org

14

PVAAS has many different types of data and reporting available for educators each serving its own purpose. However, you can basically visualize PVAAS data in two larger ways– "looking back" and "looking forward". Throughout today’s presentation, look for these symbols on the slides as a visual reminder of what type of data we’re demonstrating. As we progress through the use and purposes for the data, you’ll find that multiple data sets could be helpful in informing your decisions– and that’s correct! While we will demonstrate some connections to data and your work today, the possibilities for data use are endless!

There is Value-added, or growth data, information that lets you “look back” at student performance. Here we use the image of a "rearview mirror" to indicate that PVAAS allows us to "look back" on our impact on student performance in previous years…it helps schools to evaluate the effectiveness of the district and the school - the effectiveness of curriculum, assessment and instruction. How much growth did groups of students make in the past school year? In fact, Pennsylvania’s value-added reporting for teachers falls into this "looking back" side of the PVAAS reporting.�
There is also the Projection data that let's you “look forward.” Here we use the image of the looking through the windshield showing the road ahead, what type of future student performance is likely…it helps schools plan for the future. Are students on a path to proficiency or higher? OR do we need to adjust the programming for the student?

Both of these views of data are important when planning for your work in instructional programming.

15 of 33

Interactive Design

15

Questions? Email pdepvaas@iu13.org

15

16 of 33

As We Explore PVAAS Today…

We will use a demo account to model:

UN: AllStarDA.Admin21

PW: 2023PennDemoSite

You can use your unique login credentials to explore YOUR data OR join us in the demo account!

Questions? Email pdepvaas@iu13.org

16

As we explore PVAAS today, I will use the PVAAS demo account. You can join me in demo data by logging in using the credentials on the screen. Of course, if you have your own username and password, you can log in as yourself to see students in your school. Either way works!

As I give you a moment to log in, I’ll explain how we’ll move through the next portion. I’ll jump into demo data to show you some navigation tips. You’re welcome to follow along on your own screen or just watch me explore– the choice is yours. Then, I will invite you to investigate a student. On the next slide, I have some questions for your consideration– I’ll get to those in just a minute. Remember that our intention is to connect the data to a purpose. These questions will help guide the purpose for consider testing history for a student. Everyone logged in? Ok, let’s show a quick demo [go to demo site to provide a brief navigational overview].

[NOTE: ask participants to keep copy of demo account credentials or their own close by for continued exploration throughout session.]

17 of 33

PVAAS Reports Menu

17

pvaas.sas.com

Questions? Email pdepvaas@iu13.org

17

18 of 33

NEW! Testing Information Tile

18

Questions? Email pdepvaas@iu13.org

18

19 of 33

Testing History & Past Predicted

19

Questions? Email pdepvaas@iu13.org

19

20 of 33

Normal Curve (Bell Curve)

Bell Curve

Questions? Email pdepvaas@iu13.org

20

21 of 33

Normal Curve Rotated

Bell Curve

Questions? Email pdepvaas@iu13.org

21

22 of 33

Where is the score?

Bell Curve

Questions? Email pdepvaas@iu13.org

22

23 of 33

What do you see in 2022?

23

Questions? Email pdepvaas@iu13.org

23

24 of 33

What do you see in 2023?

24

Questions? Email pdepvaas@iu13.org

24

25 of 33

Reveal Future Projected

Questions? Email pdepvaas@iu13.org

25

26 of 33

Projections to Future Assessments

Questions? Email pdepvaas@iu13.org

26

27 of 33

Student Projections Data Tile

27

Questions? Email pdepvaas@iu13.org

27

28 of 33

How can this data be used to inform student-level decision making?

Questions? Email pdepvaas@iu13.org

28

29 of 33

NEW! Value-Added History Data Tile

29

Questions? Email pdepvaas@iu13.org

29

30 of 33

Key Colors to Know

* Moderate Evidence

** Significant Evidence

GREEN is NOT ENOUGH to increase student performance for groups of students with a history of lower achievement!

Questions? Email pdepvaas@iu13.org

30

Light Blue or Dark Blue signifies that on average your group of students is outpacing or exceeding the growth standard. (Light blue doesn’t mean a little growth and dark blue does not mean a lot of growth--- it's the amount of evidence that this group is gaining ground.)

Red or yellow shows an indication that your students, on average, are falling behind in relation to the other students who tested in the state.

Green means that your group of students on average maintained their growth in relation to others in the state. People often ask us if green is “good”. We would say, “that depends”. If you have students with a history of higher achievement, you might be satisfied with green.

However, if you have a group of students that has a history of lower achievement that green shows that they are maintaining their low achievement. We are going to guess that you aren’t striving for maintaining lower achievement!

31 of 33

Student Report Desk Reference

Access on the PVAAS Virtual Library Shelf

Questions? Email pdepvaas@iu13.org

31

32 of 33

What connections can you draw between these data sets and the MTSS framework?

Questions? Email pdepvaas@iu13.org

32

33 of 33

Thank you!

The mission of the Department of Education is to ensure that every learner has access to a world-class education system that academically prepares children and adults to succeed as productive citizens. Further, the Department seeks to establish a culture that is committed to improving opportunities throughout the commonwealth by ensuring that technical support, resources, and optimal learning environments are available for all students, whether children or adults.

and the �PVAAS Statewide Team for PDE

For more information about PVAAS, visit PDE’s website at www.education.pa.gov

For questions about PVAAS, contact the PVAAS Statewide Team at pdepvaas@iu13.org