| |
|
|
|
|
|
|
|
Source Justification Data
|
|
|
|
General Information
|
|
Requesting Agency:
|
Department of Education
|
Commodity Specialist Reviewer:
|
Tom Teprovich
|
|
Material or Service:
|
Services: Since 2002, the PVAAS reporting based on the EVAAS® methodology/calculations has been provided to the Commonwealth by SAS, Inc. The EVAAS® team at SAS has provided value-added reporting in a production environment for 20 years using a multivariate, longitudinal, mixed model approach based on the EVAAS® methodology. Although statistically robust, the PVAAS analyses are built upon the simple concept of following each student over time, thus utilizing all available assessment scores for each student to lessen the measurement imprecision of a student’s single score.
PVAAS provides two types of information, value-added data on cohorts of students and student level projection data. Details on this sophisticated modeling approach, and its unique advantages, can be found at the following link: http://www.sas.com/govedu/edu/services/effectiveness.html. A brief summary is provided below.
PVAAS Value-Added Reporting: The value-added reporting based on EVAAS® analyzes available longitudinal data from previous years (looking back) to help schools evaluate how much cohorts of students have gained in a school year by answering questions such as: Did a group or subgroup of students make a year’s worth of growth for a year’s worth of schooling?
The robustness of PVAAS value-added modeling allows the measurement of educational influences to level the playing field for educators, allowing policy makers to set similar progress expectations for students of similar entering achievement. The inherent benefit for students is that it should not matter which school they attend. Students with similar previous achievement should expect to receive comparable opportunities to make academic progress. Thus, the rigor of PVAAS value-added modeling based on EVAAS® protects student opportunity while more fairly assessing the effectiveness of educators.
PVAAS Projection Reporting: The projection data based on the EVAAS® methodology/calculations uses the data already analyzed to help schools project (looking forward) to the future by answering questions such as: What is the percent likelihood of a student being proficient on a future PSSA or other relevant assessment? Projection data can be used for intervention planning and resource reallocation.
The PVAAS projection methodology based on EVAAS® provides educators with estimates of individual students’ likelihood of reaching future academic targets. These targets include next-grade proficiency levels, requirements for high school graduation, and various measures of college readiness.
The PVAAS individual student projections (based on EVAAS® calculations) provided have been approved as growth model augmentation in Pennsylvania. The EVAAS® calculations and methodology was reviewed by the Government Accounting Office (GAO) in 2006 and is referenced in its July report to the House Education Committee, which is available on the official GAO website at: http://frwebgate.access.gpo.gov/cgi-bin/useftp.cgi?IPaddress=162.140.64.21&filename=d06661.pdf&directory=/diskb/wais/data/gao.
PVAAS Services: Once the SAS team receives student achievement data from the Pennsylvania Department of Education, the data are cleaned, merged and analyzed. The reporting is provided to educators in schools and districts in a password-protected website that is fully hosted at SAS, Inc. as an ASP-based solution. The reporting available to educators includes the following:
Secure, Electronic Web-Based Account Management
• 12 levels of security options
• District Administrative Account
• District Wide User Accounts
• Building Administrative Accounts
• Building User Accounts
• Account creation and management done via website by local district
• Unlimited user accounts for school districts
• IU regional accounts with access to all reporting, no student names
• Statewide accounts with access to all reporting, no student names
Content Areas
• All reporting in listed content areas listed as based on EVAAS® calculations /methodology
• Mathematics
• Science
• Reading
• Writing
• Various measures of assessment and college readiness
Custom Reports in PVAAS Web Interface, based on EVAAS® Methodology
• School search for quintiles and cumulative index with Help File
• Student search with Help File
• Custom Student Reports with Help File
• Custom Diagnostic Report with Help File
District Reports in PVAAS Web Interface, based on EVAAS® Methodology
• Value-Added with Help File
• Performance Diagnostic with Help File (whole grade and subgroups)
• Quintile Diagnostic with Help File (whole grade and subgroups)
School Reports in PVAAS Web Interface, based on EVAAS® Methodology
• Value-Added with Help File
• Performance Diagnostic with Help File (whole grade and subgroups)
• Quintile Diagnostic with Help File (whole grade and subgroups)
• Getting Results Data Worksheet
Summary Reports in PVAAS Web Interface, based on EVAAS® Methodology
• Value-Added Summary with Help File
• Performance Diagnostic with Help File (whole grade and subgroups)
• Quintile Diagnostic with Help File (whole grade and subgroups)
• School Performance Diagnostic with Help File
• School Quintile Diagnostic with Help File
Projection Summary Reports in PVAAS Web Interface, based on EVAAS® Methodology
• District (Grade Spans) with Help File (whole grade ad subgroups)
• District (Single Grade) with Help File (whole grade ad subgroups)
• School (Grades Last Tested) with Help File (whole grade ad subgroups)
• School (Single Grade) with Help File (whole grade ad subgroups)
In addition to the web reporting, SAS provides the PVAAS projection reporting (based on EVAAS® methodology/calculations) used in Pennsylvania’s No Child Left Behind Growth Model for AYP Program, which was approved by the U.S. Department of Education in Spring 2008. The projection reporting is used as an augmentation of Adequate Yearly Progress (AYP). Additional details on this proposal and the use of PVAAS projections can be found at the following link: http://www2.ed.gov/admins/lead/account/growthmodel/pa/index.html.
PVAAS reporting also includes summary reports available to administrators, such as scatter plots for all Pennsylvania school districts in four subject areas for grades 4 – 8 and 11. Services also include customized analyses, such as those for the Educational Assistance Program (EAP) and other groups of interest, and longitudinal files for statewide and regional reporting from PVAAS reporting.
|
E-mail:
|
tteprovich@state.pa.us
|
|
Proposed Supplier:
|
SAS Institute, Inc.
|
Request Type(s):
|
Sole Source; Feasibility
|
|
Description:
|
Educational Value-Added Assessment System (EVAAS®) Services and web-based reporting for the Pennsylvania Value-Added Assessment System fully based and developed from the EVAAS® methodology/calculations. The Pennsylvania State Board of Education passed a resolution in 2002 “that the Value Added Assessment system shall be added as a component of the assessment system model” (See Resolution 32 Pa.B. 5151 at http://www.pabulletin.com/secure/data/vol32/32-41/ 1813.html). The selected system must meet this requirement.The Pennsylvania Value-Added Assessment System (PVAAS) is a statistical analysis of state assessment data (such as PA School System of Assessments or PSSA) based on the EVAAS methodology/calculations. PVAAS provides Pennsylvania’s 500 school districts, Career and Technology Centers and Charter Schools with progress data to add to achievement data. Using a multivariate, longitudinal, mixed model approach based on the EVAAS methodology and calculations, PVAAS provides two types of information to educators: value-added data on cohorts of students and student level projection data. Although statistically robust, the PVAAS analyses are built upon the simple concept of following each student over time, thus utilizing all available scores from each student to lessen the measurement imprecision of a student’s single score.
|
|
|
| |
|
Date Submitted:
|
8/24/2010
|
|
Review Information
|
|
ID:
|
7778
|
|
|
|
|
|
Review End Date:
|
09/16/2010
|
|
Approval Status:
CS Approved:09/02/10
Submitted: 8/24/2010
Accepted: 09/02/2010
Approved by Sole Source Coordinator 09/13/2010
Approved by Chief Procurement Officer 09/13/2010
Approved by Deputy Secretary for Procurement 09/13/2010
|
|
|
Approval/Disapproval Date:
|
09/13/2010
|
|
Execution Date:
|
|
|
|
|
|
|
|
|
|
|
|