Universal SEB Screening:
Data-Based Decision Making
Developed by Niki Kendall on Behalf of the DE-PBS Project
Credits and Background
The DE-PBS Project serves as a technical assistance center for the Delaware DOE to actualize the vision to create safe and caring learning environments that promote the social-emotional and academic development of all children.
The statewide initiative is designed to build the knowledge and skills of Delaware educators in the concepts and evidence-based practices of Positive Behavior Support (PBS) as a Multi-tiered System of Support (MTSS).
https://www.delawarepbs.org/universal-screening/
Please take note:
Objectives
After viewing this webinar, you will be able to:�
Installing a Universal SEB Screener Series
Key Webinars in this Series:
Bonus Content for Enhanced Learning:
Universal Screener Installation Action Steps
System supports for a data-driven culture
Data-driven culture: “a learning environment within a school or district that includes attitudes, values, goals, norms of behavior and practices, accompanied by an explicit vision for data-use by leadership that emphasizes the importance and power that data can bring to the decision-making process” (Mandinach, 2012)
Set aside TIME for collaborative data analysis and planning of instructional strategies
Schedule a block of time to review the data!
12. Create data reports
Sample team communication plan
Topic | Responsible Team Member | Frequency | Recipient | Method |
Schoolwide (Tier 1) screening | Screening coordinator/administrator | Within a month | All staff | Staff meeting |
Grade-level screening results | Screening coordinator/administrator | Within a month | Grade/Classroom Staff | Grade-level PLC meetings |
Schoolwide (Tier 1) screening results | Tier 1 team leader/student advisor | Within a month | All students | Student advisory |
Schoolwide (Tier 1) screening results | Screening coordinator/administrator | Within a month | All families | Newsletter |
Concerns about screening results and plans for follow-up | School based behavioral health staff | Within 1-2 weeks | Individual students | In-person |
Concerns about screening results and plans for follow-up | School based behavioral health staff | Within 1-2 weeks | Individual families | In-person or by phone |
Key considerations for reporting the results from your screener
Buros Center for Testing–Spencer Foundation Project Scholars (2020). SocialEmotional Learning Assessment Technical Guidebook.
#7 Make the data understandable
Before creating data reports for your users, consider the following five questions:
What do you want to show?
Distribution
Table
Comparison
How do the values compare to each other (exact values)?
Teacher Last Name | Grade | # of students screened | # of students at-risk | Percent At- Risk |
Shaffer | 5 | 25 | 14 | 56% |
Triggs | 4 | 26 | 13 | 50% |
Ells | 2 | 26 | 7 | 27% |
Memphis | 1 | 28 | 7 | 25% |
Barrett | 2 | 25 | 5 | 20% |
Cassidy | 4 | 21 | 4 | 19% |
Ulrich | 4 | 28 | 5 | 18% |
von der Embse, et al. (2022)
How is the data distributed?
How do the values compare to each other among categories?
How do the values compare to each other other over time?
Visual best practices
most important data
Emphasize
graphs for legibility
Orient
overloading graphs
Avoid
# of colors and shapes
Limit
through important text
Inform
Unger, 2017
13. Prioritize needs and act on data
“Effective data use requires going beyond the numbers and their statistical properties to make meaning of them. Teachers who engage in data-based decision making must translate the data into actions that inform instruction”
(Mandinach, 2012, p. 73).
A quick review of Regulation 508 Multi-Tiered System of Support (MTSS)
Purpose of 14 DE Admin. Code § 508.6.1.1 - 508.6.1.1.4:
�Essential Components:
Procedures:
Tier 1: 80% Decision Rule
School/Grade:
→If 80% of students are not responding to universal schoolwide SEB practices, evaluate and look for ways to improve.
Subgroups:
→If 80% of students in a subgroup (race, gender, disability status) are not responding to universal SEB practices, evaluate and look for ways to improve�
Classrooms:
→If 80% of students in a class or grade are not responding to universal classroom SEB practices, evaluate and look for ways to improve
Tip: Use the interpretation guidance from the test publisher. For example, the SAEBRS recommends only using the total score to determine risk and the subscales for problem solving. So the 80% rule would only apply to the total score!
80% Decision Rule: Schoolwide
→If 80% of students are not responding to universal schoolwide SEB practices, evaluate and look for ways to improve.
Next steps:
von der Embse, et al. (2022)
80% Problem Solving: School/Grade
80% rule: | Fall screening data indicates that 68% of our 6th graders self reported difficulties with social behavior. |
Identify the problem: | After meeting with a group of students and reviewing our discipline data (50% of ODRs involved peer to peer conflict), the primary need is relationship skills (solving conflicts with peers). |
Set Measurable Goal: | # lessons taught�Reduction in ODRs for peer-to-peer conflict Decrease %age of students who self-report social behavior problems to 50% by winter screening |
Proposed Solution and Action Plan: | Solving conflict skills will be added to the school’s SEB expectations and advisory teachers will be supported to deliver lessons on conflict resolution |
Fidelity Monitoring Plan: | A weekly google form will be completed by advisory teachers that reports which SEB lessons have been taught. |
Monitor Outcome vs Goal: | What outcome data do you see as a result? Did you achieve the goal, or do you need to revise a component of your problem-solving process? |
80% Decision Rule: Classroom
Teacher Last Name | Teacher First Name | Grade | Percent of students meeting benchmark |
Shaffer | Sarah | 5 | 44% |
Triggs | Taylor | 4 | 50% |
Ells | Erica | 2 | 73% |
Memphis | Marsha | 1 | 75% |
Barrett | Bob | 2 | 80% |
Cassidy | Cara | 4 | 81% |
Ulrich | Uma | 4 | 82% |
von der Embse, et al. (2022)
→If 80% of students in a class or grade are not responding to universal classroom SEB practices, evaluate and look for ways to improve.
Next steps:�
Example classroom quick start guide
Wichita Public School’s 80% Decision Rule for SAEBRS Screener: “When 20% or more of the students in a class come up At Risk on the Total Behavior Score, utilize the quick reference guide as a springboard to get started with classroom-based support ideas”
Wichita Public Schools (2020)
Melanie Barbas, Colonial School District
80% Decision Rule: Subgroups
At or Above Benchmark:
55% of students with IEPs are at/above benchmark as compared to 85% of all other students without IEPs.
Sample Data: Pennsylvania Training and Technical Assistance Network (2021)
Risk Ratio Calculator (Wisconsin PBIS Network)
Digging Deeper into the Data: Subgroups
At Risk Risk Index:
AT Risk Risk Ratio:
Students with IEPs = 0.15/0.07 or 2.14
Students with IEPs are 2 times more likely to be at risk when compared with students without IEPs.
Sample Data: Pennsylvania Training and Technical Assistance Network (2021)
Risk Ratio Calculator (Wisconsin PBIS Network)
80% Rule Problem Solving: Subgroup
Trend in screener results: | Fall screening data indicates that students with IEPs are 2 times more likely to be at high risk for SEB challenges than students without disabilities in the school. |
Identify the problem: | Explore schoolwide data with big 5 questions (what time of day, what is the need, where is it happening, when is it happening) for your subgroup, in this case, students with IEPs. How do individuals impacted by the data trend and/or root cause (e.g., families, students, educators) interpret the results? |
Set Measurable Goal: | What do you hope to impact? |
Create Proposed Solution and Action Plan: | Consider first: What Tier 1 strategies might be available to support students with IEPs to access T1 SEB supports? How might we strengthen these supports or access to them? |
Monitor Outcome vs Goal: | What outcome data do you see as a result? Did you achieve the goal, or do you need to revise a component of your problem-solving process? |
Subgroup Decision Rules
Student Problem Solving
1. Cast a wide net to identify students who may need more
2. Identify which students to explore (e.g., highest 20% of students on a screener)
3. Confirm which students need support (e.g., debrief with student/teacher, record review)
4. (as needed) Dig deeper into student needs (e.g., observations, additional assessments or interviews)
5. Identify a goal for change
6. Determine next steps (i.e., match a student to a support/intervention)
Some students may need Tier 2 support�
Some students may need more support/monitoring at Tier 1
Some students will need more intensive help
Student Problem Solving Conversations
Understand student needs:
In what areas is the student not meeting SEB expectations?
Do academic needs need to be addressed because they underlie the student’s SEB challenges?
Confirm student needs support:
Does the student have support for the need? Do they want support? What do their teacher or parent recommend?
Identify a goal for change:
What is the specific SEB need, with who, when, where, and why does it occur?
For identified needs, what is our goal for the student?
�Determine next steps:
What interventions/supports do we have (or need) to help the student reach the goal?
�
Some students will need more intensive help
Some students may need Tier 2 support�
Some students may just need more support/monitoring at Tier 1
Student Debrief Tips
Help Me Grow (2019)
Fairfax County Public Schools (n.d)
Student Debrief Tips Continued
Help Me Grow (2019)
Fairfax County Public Schools (n.d)
SEB Screening Tracking Tool
Tips:
Adapted from Wichita Public Schools
Systems Problem Solving
Use your data to inform group interventions:�
Considerations: screening for risk of suicide, self-harm, or harm to others
If there are individual items on your selected universal SEB screener that are indicative of risk for suicide, self harm, or harm to others:�
Greenberg, J. (2022)
Considerations: screening for risk of suicide, self-harm, or harm to others
14. Evaluate your screener implementation
3 questions to ask while evaluating your screener:
Adapted from Glover & Albers, 2007
Get student feedback!
Source: William Henry Middle School
Screening Coordinator Checklist (implementation steps)
Adapted from Michigan’s Integrated Behavior and Learning Support, 2020
Questions?
References
Buros Center for Testing–Spencer Foundation Project Scholars (2020). Social-emotional learning assessment technical guidebook. https://buros.org/pdfs/SEL_Guidebook.pdf
Fairfax County Public Schools. (n.d.). SEL Screener Report and Guide. Retrieved from� https://www.fcps.edu/student-tests-and-assessments/student-assessment-details/social-emotional-screener/score-report
Glover, T. A., & Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45(2), 117-135. https://doi.org/10.1016/j.jsp.2006.05.005
Greenberg, J. (2022). 988 Suicide & Crisis Lifeline. Columbia Protocol app. Retrieved from https://cssrs.columbia.edu/wp-content/uploads/Columbia_Protocol.pdf
Help Me Grow. (2019). Sharing screening results with families. https://helpmegrowsmc.org/wp-content/uploads/2019/11/Screening-Conversation-Guide-10.15.19.pdf
Mandinach, E. B. (2012). A perfect time for data use: Using data-driven decision making to inform practice. Educational Psychologist 47(2), 71-85. https://doi.org/10.1080/00461520.2012.667064
Pennsylvania Training and Technical Assistance Network (2021). Interpreting your universal screening: Highlights of building a multi-tiered system of supports for mathematics. https://www.pattan.net/CMSPages/GetAmazonFile.aspx?path=~%5Cpattan%5Cmedia%5Cpublications%5C2019%20accessible%20pdfs%5Cmtss_math_webinar_series.pdf&hash=7af8ca7074a81d5d5564ceeada8f19824c529ed38f791b0d45364cec366af512
Simonsen, B., Putnam, R., Yaneck, K., Evanovich, L., Shaw, S. Shuttleton, C. Morris, K., & Mitchell, B. (February, 2020). Supporting students with disabilities within a PBIS framework. Center on PBIS, University of Oregon. www.pbis.org.
Squires, J., Twombly, E., Bricker, D., & Potter, L. W. (2009). Sharing screening results with families. ASQ-3 User's Guide.
Unger, K. (2017). Visualizing your data effectively. https://www.nefrsef.org/forms/2018-forms/2018-Visualizing-your-data-effectively.pptx
von der Embrose, N., Eklund, K., Kligus, S., & Rutherford, K. (2022). Screen to intervene: Integrating mental health across tiers. University of South Florida, School Mental Health Collaborative, University of Wisconsin-Madison. https://drive.google.com/file/d/1RYTSflALPgUBhwMXKiAJvLKuKHejpqAV/view
Wichita Public Schools. (2020). Social, academic, and emotional behavior risk screener (SAEBRS) [PowerPoint slides]. https://www.usd259.org/cms/lib/KS01906405/Centricity/Domain/1568/District%20SAEBRS%20Training%20Sept%202020.pptx
Wisconsin RTI Center. (2019, February 13). Risk ratio calculator [Excel spreadsheet]. https://www.wisconsinrticenter.org/resources/risk-ratio-calculator/