The Division of Program
Monitoring and Interventions (PMI) implements the Data Validation Monitoring
(DVM) System to monitor the accuracy of data submitted by school districts
through the Public Education Information and Management System (PEIMS) and used
in the state's accountability rating and performance-based monitoring (PBM)
systems. The PBM system relies on the
evaluation of student performance and program effectiveness data at the state
level based on established indicators. Data validation responsibilities within
the PMI division include review and follow-up with districts or campuses that
have been identified for potential data inaccuracies, data anomalies, or data
There are key
differences between data validation indicators used as part of the PBM data
validation system and the performance indicators used in the Performance-Based
Monitoring Analysis System (PBMAS). A PBMAS performance indicator yields a definitive result (e.g., 85% of a
district’s graduates completed the Recommended High School Program.). A data
validation indictor typically suggests
an anomaly that may require a local review to determine whether the anomalous
data are accurate.
Results on each data validation indicator, patterns across indicators, longitudinal performance patterns, and existing staging determinations across PBM program areas were examined to determine appropriate levels of required intervention. Indicators that can trigger a review or investigation based on potential data anomalies are listed in the Student Assessment Data Validation Manual.
District Leadership Team
The district leadership team is responsible for conducting intervention activities. Local education agencies (LEAs) identified for DVM-student assessment monitoring and interventions are required to participate in specific activities to collect and analyze data to determine why the LEA triggered an indicator; identify campuses that may have contributed to the LEA’s identification under the indicator; determine the frequency and source of any reporting errors; and evaluate the effectiveness of policies, procedures, and data tracking systems.
Intervention Guidance and Resources are available to assist LEAs in conducting the required activities.
Focused Data Analysis
LEAs staged 1, 2, 3, or
4 are required to conduct a data analysis of certain student assessment data
validation indicators. The purpose of the Focused
Data Analysis (FDA) (as applicable) is to
work with stakeholders to gather, disaggregate, and review data to determine
possible causes for anomalous student assessment data. Additionally, LEAs are
required to complete a student-by-student review as applicable to the
indicator(s) assigned a performance level.
Improvement Plan/Corrective Action Plan for DVM-Student Assessment Records
The LEA must develop and
implement actions to address findings in a timely fashion and may use the
Improvement Plan/Corrective Action Plan (CAP) specifically designed for
DVM-student assessment records to document planned activities.
If noncompliance with
data reporting or documentation requirements is identified, activities to
address those findings must be included in the Improvement Plan/Corrective Action Plan (CAP). If the LEA determines that accurate data
have been submitted and that systems have been implemented in compliance with
state requirements, the LEA is not required to engage in improvement planning
activities or develop an Improvement Plan/CAP.
Additionally, a targeted
on-site review by the TEA may be conducted or other local interventions or
sanctions may be ordered to address data accuracy concerns related to
documented substantial, ongoing, or imminent risks as reflected in LEA data
and/or responses to interventions within the PBM system. The activities in this
level of intervention may or may not be combined with other monitoring
activities. If data reporting concerns
are verified, an LEA will be required to develop an improvement plan/CAP in
response to both the visit and any other required data review activities.