1 of 39

�School-wide PBIS�Tiered Fidelity Inventory (TFI)�Tier I Items Analysis�

Version 3.0

February 2019

Access the audio on the slides by clicking on the audio icon

2 of 39

Intended Use of the Training Materials

  • Training materials and documents regarding administration of the School-wide PBIS Tiered Fidelity Inventory (TFI) are intended to be used to prepare coaches and facilitators who will be guiding administration and use of the TFI with school teams.

3 of 39

Purpose of this Video:

  • Tier I Item Analysis: Understand each of the items in the TFI to assist in coaching teams to complete the TFI.
    • Tier I: 15 Items
    • Tier II: 13 Items
    • Tier III: 17 Items

4 of 39

TFI Format: Feature Name

Feature

Possible Data Sources

Scoring Criteria

Feature Name: Detailed description of the feature

Data sources that may be helpful in scoring

0= Description of feature not being implemented

1= Description of feature being partially implemented

2=Description of the feature being fully implemented

Main idea:

An explanation of the main idea for this feature

.

5 of 39

Quick Check: Feature Name

Team Assessment:

  • Question
  • Documentation
  • Process
  • Product
  • Data

Scoring:

0 = Description of feature not being implemented

1 = Description of feature being partially implemented

2 = Description of the feature being fully implemented

Reflective questions to focus the conversation:

6 of 39

Tier 1: Building a Strong Foundation

Subscale: Teams

Subscale: Implementation

Subscale: Evaluation

Click on each item you want to focus on, or go through the entire PowerPoint:

7 of 39

TFI Item: 1.1 Team Composition

Feature

Possible Data Sources

Scoring Criteria

Team Composition

Tier I team includes a Tier I systems coordinator, a school administrator, a family member, and individuals able to provide (a) applied behavioral expertise, (b) coaching expertise, (c) knowledge of student academic and behavior patterns, (d) knowledge about the operations of the school across grade levels and programs, and for high schools, (e) student representation.

•School organizational chart

•Tier I team meeting minutes

0 = Tier I team does not exist or does not include coordinator, school administrator, or individuals with applied behavioral expertise.

1 = Tier I team exists, but does not include all identified roles, or attendance of these members is below 80%.

2 = Tier I team exists with coordinator, administrator, and all identified roles represented, AND attendance of all roles is at or above 80%.

Main Idea:

Teams need people with multiple skills and perspectives to implement PBIS well. In order to score a 2 on this item, the team must include someone who will coordinate the team, an administrator, a family member, and individuals with the described skills who attend 80% of the meetings.

8 of 39

Quick Check: Team Composition

Team Assessment:

  • Coordinator
  • Behavioral expertise
  • Administrative authority
  • Family member
  • Coaching expertise
  • Knowledge about academic/ behavior outcomes
  • Knowledge about school operations
  • Student perspective included

Scoring:

0 = Tier I team does not exist or does not include coordinator, school administrator, or individuals with applied behavioral expertise.

1 = Tier I team exists, but does not include all identified roles or attendance of these members is below 80%.

2 = Tier I team exists with coordinator, administrator, and all identified roles represented, AND attendance of all roles is at or above 80%.

Are all necessary roles and functions represented on the team?

9 of 39

TFI Item 1.2: Team Operating Procedures

Feature

Possible Data Sources

Scoring Criteria

Team Operating Procedures:

Tier I team meets at least monthly and has (a) regular meeting format/agenda, (b) minutes, (c) defined meeting roles, and (d) a current action plan.

Tier I team meeting agendas and/or minutes

•Tier I meeting roles descriptions

•Tier I action plan

0 = Tier I team does not use regular meeting format/agenda, minutes, defined roles, or a current action plan.

1 = Tier I team has at least two but not all four features.

2 = Tier I team meets at least monthly and uses regular meeting format/agenda, minutes, defined roles, AND has a current action plan.

Main Idea:

Specific features are necessary to ensure meetings are effective for action planning and tracking progress.

10 of 39

Quick Check: Team Operating Procedures

Team Assessment:

  • Regular, monthly meetings
  • Consistently follow meeting format
  • Minutes taken during and disseminated after each meeting (or at least action plan items are disseminated)
  • Participant roles are clearly defined
  • Action plan current to the school year

Scoring:

0 = Tier I team does not use regular meeting format/agenda, minutes, defined roles, or a current action plan.

1 = Tier I team has at least two but not all four features.

2 = Tier I team meets at least monthly and uses regular meeting format/agenda, minutes, defined roles, AND has a current action plan.

What meeting procedures are currently in place at the Tier I level?

11 of 39

TFI Item 1.3: Behavioral Expectations

Feature

Possible Data Sources

Scoring Criteria

Behavioral Expectations:

School has five or fewer positively stated behavioral expectations and examples by setting/location for student and staff behaviors (i.e., school teaching matrix) defined and in place.

•TFI Walkthrough Tool

•Staff handbook

•Student handbook

0 = Behavioral expectations have not been identified, are not all positive, or are more than five in number.

1 = Behavioral expectations are identified but may not include a matrix or be posted.

2 = Five or fewer behavioral expectations exist that are positive, posted, and identified for specific settings (i.e., teaching matrix) AND at least 90% of staff can list at least 67% of the expectations.

Main Idea:

Having school-wide, positive expectations is among the best ways to establish a positive social culture.

12 of 39

TFI Walkthrough: Appendix A

13 of 39

Quick Check: Team Behavioral Expectations

Team Assessment:

  • Has the team identified five or fewer behavioral expectations?
  • Do they include examples by location/setting?
  • Are they publicly posted throughout the school?

Scoring:

0 = Behavioral expectations have not been identified, are not all positive, or are more than five in number.

1 = Behavioral expectations are identified but may not include a teaching matrix or be posted.

2 = Five or fewer behavioral expectations exist that are positive, posted, and identified for specific settings (i.e., teaching matrix), AND at least 90% of staff can list at least 67% of the expectations.

Does the school have positive behavioral expectations?

14 of 39

TFI Item 1.4: Teaching Expectations

Feature

Possible Data Sources

Scoring Criteria

Teaching Expectations:

Expected academic and social behaviors are taught directly to all students in classrooms and across other campus settings/locations.

•TFI Walkthrough Tool

•Professional development calendar

•Lesson plans

•Informal walkthroughs

0 = Expected behaviors are not taught.

1 = Expected behaviors are taught informally or inconsistently.

2 = Formal system with written schedules is used to teach expected behaviors directly to students across classroom and campus settings, AND at least 70% of students can list at least 67% of the expectations.

Main Idea:

Teaching the expected behaviors to students is critical in establishing a positive school culture.

15 of 39

Quick Check: Teaching Expectations

Team Assessment:

  • Are regularly scheduled times identified for teaching expectations at least once per school year?
  • Is there a documented teaching schedule?
  • Are the behavioral expectations taught to all students across all school settings (e.g., cafeteria, hallways, classrooms, etc.)?

Scoring:

0 = Expected behaviors are not taught.

1 = Expected behaviors are taught informally or inconsistently.

2 = Formal system with written schedules is used to teach expected behaviors directly to students across classroom and campus settings, AND at least 70% of students can list at least 67% of the expectations.

What is the system for teaching behavioral expectations to all students?

16 of 39

TFI Item 1.5: Problem Behavior Definitions

Feature

Possible Data Sources

Scoring Criteria

Problem Behavior Definitions:

School has clear definitions for behaviors that interfere with academic and social success and a clear policy/procedure (e.g., flowchart) for addressing office-managed versus staff-managed problems.

•Staff handbook

•Student handbook

•School policy

•Discipline flowchart

0 = No clear definitions exist, and procedures to manage problems are not clearly documented.

1 = Definitions and procedures exist but are not clear and/or not organized by staff- versus office-managed problems.

2 = Definitions and procedures for managing problems are clearly defined, documented, trained, and shared with families.

Main Idea:

Operational definitions of problem behavior and consistent processes for responding to problem behavior improve the “predictability” of social expectations in the school.

17 of 39

Quick Check: Problem Behavior Definitions

Team Assessment:

  • Are problem behavior definitions written down and documented?
  • Do the definitions clearly differentiate between staff-managed and office-managed problem behaviors?
  • Are all staff and faculty members trained on the definitions?
  • Are the definitions shared with families?

Scoring:

0 = No clear definitions exist, and procedures to manage problems are not clearly documented.

1 = Definitions and procedures exist but are not clear and/or not organized by staff- versus office-managed problems.

2 = Definitions and procedures for managing problems are clearly defined, documented, trained, and shared with families.

What is the process for identifying problem behavior?

18 of 39

TFI Item 1.6: Discipline Policies

Feature

Possible Data Sources

Scoring Criteria

Discipline Policies:

School policies and procedures describe and emphasize proactive, instructive, and/or restorative approaches to student behavior that are implemented consistently.

•Discipline policy

•Student handbook

•Code of conduct

•Informal administrator interview

0 = Documents contain only reactive and punitive consequences.

1 = Documentation includes and emphasizes proactive approaches.

2 = Documentation includes and emphasizes proactive approaches, AND administrator reports consistent use.

Main Idea:

Preventative and positive approaches to discipline are the most effective.

19 of 39

Quick Check: Discipline Policies

Team Assessment:

  • Are disciplinary practices proactive and preventative?
    • Do they help keep children in school and in the classroom, or is there a reliance on exclusionary practices?
  • Is there clear documentation of discipline policies?
  • Do administrators report consistent use of proactive, preventative approaches?

Scoring:

0 = Documents contain only reactive and punitive consequences.

1 = Documentation includes and emphasizes proactive approaches.

2 = Documentation includes and emphasizes proactive approaches, AND administrator reports consistent use.

Do the discipline policies emphasize proactive, preventative disciplinary measures?

20 of 39

TFI Item 1.7: Professional Development

Feature

Possible Data Sources

Scoring Criteria

Professional Development:

A written process is used for orienting all faculty/staff on four core Tier I SWPBIS practices: (a) teaching school-wide expectations, (b) acknowledging appropriate behavior, (c) correcting errors, and (d) requesting assistance.

•Professional development calendar

•Staff handbook

0 = No process for teaching staff is in place.

1 = Process is informal or unwritten, is not part of professional development calendar, and/or does not include all staff or all four core Tier I practices.

2 = Formal process for teaching all staff all aspects of Tier I system, including all four core Tier I practices.

Main idea:

The key to PBIS implementation and sustainability is staff consistency. All staff members need to be informed and aware of goals, process, and measures.

21 of 39

Quick Check: Professional Development

Team Assessment:

  • Is there a faculty-wide orientation attended by all staff?
  • Does the orientation/training include all four core Tier I practices?
    • Teaching expectations
    • Acknowledging appropriate behavior
    • Correcting errors
    • Requesting assistance

Scoring:

0 = No process for teaching staff is in place.

1 = Process is informal/unwritten, not part of professional development calendar, and/or does not include all staff or all four core Tier I practices.

2 = Formal process is in place for teaching all staff all aspects of Tier I system, including all four core Tier I practices.

What is the system for training all staff members?

22 of 39

TFI Item 1.8: Classroom Procedures

Feature

Possible Data Sources

Scoring Criteria

Classroom Procedures:

Tier I features (school-wide expectations, routines, acknowledgements, in-class continuum of consequences) are implemented within classrooms and consistent with school-wide systems.

•Staff handbook

•Informal walkthroughs

•Progress monitoring

•Individual classroom data

0 = Classrooms are not implementing Tier I.

1 = Classrooms are informally implementing Tier I, but no formal system exists.

2 = Classrooms are formally implementing all four core Tier I features, consistent with school-wide expectations.

Main Idea:

PBIS expectations and consequences need to be integrated into the classroom systems. This improves consistency in behavior support practices across all adults.

23 of 39

Quick Check: Classroom Procedures

Team Assessment:

  • Do classroom procedures match proactive school-wide disciplinary practices?
  • Are all four core features of Tier I supports visible in the classroom?
    • System for teaching school-wide expectations
    • System for acknowledging appropriate behavior
    • In-class system for responding to inappropriate behavior
    • System for requesting assistance

Scoring:

0 = Classrooms are not implementing Tier I.

1 = Classrooms are informally implementing Tier I, but no formal system exists.

2 = Classrooms are formally implementing all core Tier I features consistent with school-wide expectations.

How has the school-wide system translated to classrooms?

24 of 39

TFI Item 1.9: Feedback & Acknowledgement

Feature

Possible Data Sources

Scoring Criteria

Feedback & Acknowledgement:

A formal system (i.e., written set of procedures for specific behavior feedback that is [a] linked to school-wide expectations and [b] used across settings and within classrooms) is in place and used by at least 90% of a sample of staff and received by at least 50% of a sample of students.

•TFI Walkthrough Tool

•Staff handbook

0 = No formal system for acknowledging students exists.

1 = Formal system is in place and is used by at least 90% of staff OR is received by at least 50% of the students.

2 = Formal system for acknowledging student behavior is used by at least 90% of staff AND received by at least 50% of the students.

Main Idea:

Students will sustain positive behavior only if there are regular strategies for continuous re-teaching and rewarding appropriate behavior. Formal systems are easier for teachers/staff to implement.

25 of 39

Quick Check: Feedback & Acknowledgement

Team Assessment:

  • Are students and staff interviewed at least once per year to see if they are receiving and distributing acknowledgements?
  • Are the acknowledgements linked to the school-wide expectations?
  • Are they distributed across all school settings?
  • When interviewed, do 90% of staff and 50% of the students report giving/receiving them?

Scoring:

0 = No formal system exists for acknowledging students.

1 = Formal system is in place and is used by at least 90% of staff OR received by at least 50% of students.

2 = Formal system for acknowledging student behavior is used by at least 90% of staff AND received by at least 50% of students.

What is the integrity of the school-wide system of acknowledgement?

26 of 39

TFI Item 1.10: Faculty Involvement

Feature

Possible Data Sources

Scoring Criteria

Faculty Involvement:

Faculty are shown school-wide data regularly and provide input on universal foundations (e.g., expectations, acknowledgements, definitions, consequences) at least every 12 months.

• PBIS Self-Assessment Survey

• Informal surveys

• Staff meeting minutes

• Team meeting minutes

0 = Faculty are not shown data at least yearly and do not provide input.

1 = Faculty have been shown data more than yearly OR have provided feedback on Tier I foundations within the past 12 months but not both.

2 = Faculty are shown data at least four times per year AND have provided feedback on Tier I practices within the past 12 months.

Main Idea:

The single factor most related to high sustainability of school-wide PBIS is the frequency with which DATA are presented to all school staff.

27 of 39

Quick Check: Faculty Involvement

Team Assessment:

  • Have the staff members been shown school-wide data at least four times during the year?
  • Have the staff members had an opportunity to provide feedback about the Tier I practices at least once a year?

Scoring:

0 = Faculty are not shown data at least yearly and do not provide input.

1 = Faculty have been shown data more than yearly OR have provided feedback on Tier I foundations within the past 12 months but not both.

2 = Faculty are shown data at least four times per year AND have provided feedback on Tier I practices within the past 12 months.

What are the feedback systems to regularly involve faculty?

28 of 39

TFI Item 1.11: Student/Family/Community Involvement

Feature

Possible Data Sources

Scoring Criteria

Student/Family/Community Involvement:

Stakeholders (students, families, and community members) provide input on universal foundations (e.g., expectations, consequences, acknowledgements) at least every 12 months.

• Surveys

• Voting results from parent/family meeting

• Team meeting minutes

0 = No documentation (or no opportunities) for stakeholder feedback on Tier I foundations exist.

1 = Documentation of input on Tier I foundations exists, but not within the past 12 months, or input exists but not from all types of stakeholders.

2 = Documentation exists that students, families, and community members have provided feedback on Tier I practices within the past 12 months.

Main Idea:

Schools need active engagement of students, families and faculty to be successful.

29 of 39

Quick Check: Student/Family/Community Involvement

Team Assessment:

  • Is there documentation of a process for receiving feedback at least annually from stakeholders about Tier I supports?
  • Does the documentation include input from students, families, and community members?
  • Was the most recent feedback within the past 12 months?

Scoring:

0 = No documentation (or no opportunities) exist for stakeholder feedback on Tier I foundations.

1 = Documentation of input on Tier I foundations exists, but not within the past 12 months, or input exists but not from all types of stakeholders.

2 = Documentation exists that students, families, and community members have provided feedback on Tier I practices within the past 12 months.

What are the feedback systems to regularly involve stakeholders?

30 of 39

TFI Item 1.12: Discipline Data

Feature

Possible Data Sources

Scoring Criteria

Discipline Data:

Tier I team has instantaneous access to graphed reports summarizing discipline data organized by the frequency of problem behavior events by behavior, location, time of day, and by individual student.

• School policy

• Team meeting minutes

• Student outcome data

0 = No centralized data system with ongoing decision making exists.

1 = Data system exists but does not allow instantaneous access to full set of graphed reports.

2 = Discipline data system exists that allows instantaneous access to graphs of frequency of problem behavior events by behavior, location, time of day, and student.

Main Idea:

Teams need the right information in the right form at the right time to make effective decisions.

31 of 39

Quick Check: Discipline Data

Team Assessment:

  • Is there a centralized data system to collect and organize behavioral data?
  • Does the system allow for instantaneous graphs of behavioral data?
  • Are the data organized to review all of the following: frequency of problem behavior, location, time of day, and student?

Scoring:

0 = No centralized data system with ongoing decision making exists.

1 = Data system exists but does not allow instantaneous access to full set of graphed reports.

2 = Discipline data system exists that allows instantaneous access to graphs of frequency of problem behavior events by behavior, location, time of day, and student.

How is data collected, organized and summarized for decision making?

32 of 39

TFI Item 1.13: Data-based Decision Making

Feature

Possible Data Sources

Scoring Criteria

Data-based Decision Making:

Tier I team reviews and uses discipline data and academic outcome data (e.g., curriculum-based measures, state tests) at least monthly for decision making.

• Data decision rules

• Staff professional development calendar

• Staff handbook

• Team meeting minutes

0 = No process or protocol exists, or data are reviewed but not used.

1 = Data are reviewed and used for decision making, but less than monthly.

2 = Team reviews discipline data and uses data for decision making at least monthly. If data indicate an academic or behavior problem, an action plan is developed to enhance or modify Tier I supports.

Main Idea:

When teams have access to reliable data, they are able to make better decisions that will enhance or modify Tier I systems.

33 of 39

Quick Check: Data-based Decision Making

Team Assessment:

  • Does the team have access to school-wide discipline data?
  • Does the team review the data at least monthly?
  • Is an action plan developed when data indicate an academic or behavioral problem?

Scoring:

0 = No process or protocol exists, or data are reviewed but not used.

1 = Data are reviewed and used for decision making but less than monthly.

2 = Team reviews discipline data and uses data for decision making at least monthly. If data indicate an academic or behavior problem, an action plan is developed to enhance or modify Tier I supports.

What is the system for accessing data necessary for decision making?

34 of 39

TFI Item 1.14: Fidelity Data

Feature

Possible Data Sources

Scoring Criteria

Fidelity Data:

Tier I team reviews and uses SWPBIS fidelity (e.g., SET, BoQ, TIC, SAS, Tiered Fidelity Inventory) data at least annually.

• School policy

• Staff handbook

• School newsletters

• School website

0 = No Tier I SWPBIS fidelity data are collected.

1 = Tier I fidelity data are collected informally and/or less often than annually.

2 = Tier I fidelity data are collected and used for decision making annually.

Main Idea:

Measuring fidelity is essential for maintaining high implementation of PBIS. Any Tier I fidelity measure is acceptable. Completing this Tiered Fidelity Inventory and creating an action plan meets the criteria for a “2” score.

35 of 39

Quick Check: Fidelity Data

Team Assessment:

  • Is the team assessing fidelity of implementation for Tier I?
  • Is the assessment completed at least annually?
  • Is the data used for decision making at least annually?

Scoring:

0 = No Tier I SWPBIS fidelity data are collected.

1 = Tier I fidelity data are collected informally and/or less often than annually.

2 = Tier I fidelity data are collected and used for decision making annually.

What role does fidelity data play in the actions of the Tier I team?

36 of 39

TFI Item 1.15: Annual Evaluation

Feature

Possible Data Sources

Scoring Criteria

Annual Evaluation:

Tier I team documents fidelity and effectiveness (including on academic outcomes) of Tier I practices at least annually (including year-by-year comparisons) that are shared in a usable format with stakeholders (staff, families, community, district).

• Staff, student, and family surveys

• Tier I handbook

• Fidelity tools

• School policy

• Student outcomes

• District reports

• School newsletters

0 = No evaluation takes place, or evaluation occurs without data.

1 = Evaluation is conducted but not annually, or outcomes are not used to shape the Tier I process and/or are not shared with stakeholders.

2 = Evaluation is conducted at least annually, and outcomes (including academics) are shared with stakeholders, with clear alterations in process based on evaluation.

Main Idea:

Implementation of the core components of PBIS is more likely if the Tier I team assesses the implementation status at least annually and provides “snapshot” reports to the staff, community, school board, etc.

37 of 39

Quick Check: Annual Evaluation

Team Assessment:

  • Is there an evaluation conducted of Tier I systems?
  • Does this happen annually?
  • Are the outcomes shared with all stakeholders (staff, families, community, district)?
  • Are the outcomes clearly linked to an action plan?

Scoring:

0 = No evaluation takes place, or evaluation occurs without data.

1 = Evaluation is conducted but not annually, or outcomes are not used to shape the Tier I process and/or not shared with stakeholders.

2 = Evaluation is conducted at least annually, and outcomes (including academics) are shared with stakeholders, with clear alterations in process based on evaluation.

What is the process for regularly assessing Tier I?

38 of 39

Evaluation Example

39 of 39

Questions?

Contact:

training@pbisapps.org

855-455-8194