Fidelity of Implementation

Fidelity of Implementation of Tier 1

Fidelity of Implementation is the delivery of an intervention, program or curriculum in the way in which it was designed to be delivered.  Schools not meeting the required level of fidelity of implementation will receive a Plan of Rapid Compliance to ensure the school moves towards making corrections in their level of fidelity.  The following are the FOI tools utilized in Tier 1.

FOI of the Core Instruction

The Comprehensive Literacy Program K-8 Fidelity of Implementation Rater’s Guide and the Comprehensive Math and Science Plan K-12 Mathematics Fidelity of Implementation Rater’s Guide are the tools used to determine the fidelity of implementation of core instruction.

FOI for PBIS

The PBIS District Support Team uses four PBIS tools at Tier 1 for identification of schools implementing with fidelity and developing sustainability. These tools include: Team Implementation Checklist (TIC), Self Assessment Survey (SAS), Benchmarks of Quality (BOQ) and the School-wide Evaluation Tool (SET).  A description of each as well as frequency of administration of each tool and cut scores follows.

PBIS Assessment Website

 

 PBIS Tier 1 Walkthrough: Form used by PBIS External Coach and other district staff to progress monitor implementation of Tier 1 PBIS at a school. Form looks for PBIS Expectations, area-specific posters, classroom rules posters, interviewing 5 students, and interview 5 staff of the expectations and teaching of behavioral lessons.

 

Team Implementation Checklist (TIC)

  • Frequency:Once per year
  • Minimal Score Needed: 80
  • Who: The PBIS Team

The TIC results are used by the Tier 1/Universal Team to adapt action plans to PBIS needs by monitoring the implementation and maintenance of PBIS systems.  TIC results help determine the most effective allocation of faculty, financial and other school resources.

Self-Assessment Survey (SAS)

  • Frequency: Annually (spring)
  • Minimal Score Needed: 80
  • Who: Entire Staff preferably

The SAS is completed when a school first begins adoption of PBIS framework and then annually (preferably in the spring) thereafter as part of the team’s action planning process.

Benchmarks of Quality (BoQ)

  • Frequency: Annually (spring)
  • Minimal Score Needed: 70
  • Who: PBIS Team

The BoQ consists of three documents: the Coach Scoring Form, the Scoring Guide, and the Team Member Rating Form.  The BoQ has a total possible score of 100.  This score is derived from the 3-8 items in each of the 10 subscales; (1) Teaming (2) Faculty (3) Commitment (4) Data Analysis (5) Expectations (6) Recognitions (7) Lesson Plans (8) Implementation Plan (9) Crisis Plan (10) Evaluation.

BoQ Webinar (PBIS Wisconsin)

Action Planning with BoQ (MPS PBIS Youtube)

School-wide Evaluation Tool (SET )

  • Frequency: Pre and post during the first year of implementation.   Randomly selected 20% of schools in year two and beyond.
  • Minimal Score Needed: 80/80 (Expectations Taught/Overall Implementation Average)
  • Who: District Team interviews Principal, randomly interviews 15 staff and students

The School-wide Evaluation Tool (SET) is a research-validated instrument that is designed to assess and evaluate the critical features of school-wide effective behavior support across an academic school year. Information gathered can be used to a) assess features that are in place, b) determine annual goals, c) evaluate ongoing efforts, d) design and revise procedures and e) compare year-to-year efforts in the area of SWPBS.

 

Attendance Systems and Procedures (ASP)

  • Frequency- Annually- More information coming on a timeline
  • Who: School Social Worker, Administration, Attendance Secretary, Attendance Team

FOI Tool will be rolled out during 2013-2014 school year to be completed to by each school to determine their current fidelity of procedures and systems around Tier 1 Attendance implementation. 

Survey is taken online here.

 

Fidelity of Implementation of Tiers 2 and 3

School-wide Implementation Review (SIR)

The SIR is a self-assessment instrument built around Wisconsin DPI’s vision of RtI. The SIR should be taken annually in second semester by all members of your Building Intervention Team and an administrator.

WI RtI Center SIR FAQ

Printer Friendly SIR

SIR Webinar

Accessing your Results

 

FOI of Interventions

As interventions are approved, fidelity tools will be developed and piloted, and data will be collected on the implementation of the interventions.  FOI data will be reported following each of the data collection windows to ensure that:

  • school staff is clear about the expectations for implementation,
  • school staff is equipped to implement the interventions as designed
  • school leaders and instructional staff are held accountable for implementation.

Based on the data collected, district personnel will develop a plan for professional development to support school staff appropriate implementation of the intervention/s.

Literacy FOI of Progress Monitoring Tool: DIBELS Next

The District has provided training for its literacy leaders both centrally and building based to become DIBELS Next Mentors. Fidelity of implementation will be, in part, ensured though the training process that includes observations of the administration of the indicators and the use of the assessment accuracy checklists that the DIBELS Next training protocols use for administration of the DIBELS Next.

Additional ongoing professional development will be provided as needs are identified.  District-provided professional development opportunities will generally take place in after-school sessions and on some Saturday’s as determined by the district.  Schools can provide their own on-site professional development as it best fits their individual school needs.

 

FOI for PBIS Tier 2/3

 Monitoring Advanced Tiers Tool (MATT)

  • Frequency: Once per year. 
  • Minimal Score Needed: 80
  • Who: The PBIS Team

The MATT results are used by the Tier 2/3 Intervention Team to adapt action plans to PBIS needs by monitoring the implementation and maintenance of PBIS systems at Tier 2/3.  MATT results help determine the most effective allocation of faculty, financial and other school resources.

Benchmarks of Advanced Tiers (BAT)

  • Frequency: Annually (spring)
  • Minimal Score Needed: 70
  • Who: PBIS Teams involved with Tier 2 and Tier 3 supports

The Benchmarks of Advanced Tiers (BAT) allows school teams to assess the implementation status of Tier 2/3 behavior support systems within their school.  The BAT is designed to answer: 1) Are the foundational elements in place for implementing Tier 2 and Tier 3 behavior support practices?  2) Is a Tier 2 support system in place?  3) Is a Tier 3 system in place?

Tier 2 Walkthrough Tool

Tool used by PBIS External Coach to monitor fidelity of Tier 2 Framework. Tool looks at school’s Daily Progress Report (DPR) used, interviews staff members, and pulls up Tier 2 data on Exceed.

CICO and SAIG Fidelity Checklist

CICO and SAIG utilize a checklist to monitor FOI of specific interventions.

Tier 3 Individual Interventions FOI

Wraparound Integrity Tool (WIT)

RENEW Integrity Tool (RIT)