Dissemination of Application Information
In early October 2006, the State Superintendent of Public Instruction’s program announcement was mailed to county and district superintendents as well as all public middle and high schools. The California School Recognition Program (CSRP) application package, including eligibility criteria and the scoring rubrics, was posted on the program’s Web site in October 2006. All schools that were determined to be eligible based on the eligibility criteria were invited to apply. The State Superintendent’s announcement letter informed schools that applications would be judged based on the qualitative selection criteria reflected in the rubrics.
Qualitative Selection Criteria
School selection is based on the CSRP's scientifically based research and multi-dimensional criteria that address all areas of a school's educational program, its learning environment, and the level of public confidence as demonstrated by family and community participation. The criteria represent a set of quality statements that reflect educational research and best practices, State Board of Education policies, current legislation, and the consensus of the education community regarding the common elements that should be present in exemplary middle and high schools. These elements include:
- High academic expectations for all students based on California’s state-adopted standards and performance levels
- Visionary and collaborative school leadership committed to excellence and high expectations for all students
- Regular and systematic monitoring of student progress by using a variety of assessment techniques
- A strong core curriculum in all required subject areas
- State Board-adopted and standards-aligned textbooks and core curriculum materials provided to all students
- Varied teaching strategies that provide challenging learning experiences for all students
- Strong library media services and appropriate technology that supports learning activities
- Academically competent and caring teachers, and strong professional development that is aligned to standards-based instructional materials and evaluated based upon student progress
- Comprehensive guidance and counseling programs for all students
- Multiple learning support services for students who are learning the English language, who have physical or learning disabilities, and who have not yet reached proficiency
- Support for student learning through family involvement and partnerships with business and community groups
- Safe school culture that supports the inclusion of all students and promotes positive character traits, such as caring, citizenship, fairness, respect, responsibility, and trustworthiness; and proactive policies and programs that prevent bullying
- Programs that foster wellness and healthy behaviors in all students
- Well-maintained learning environment that communicates the importance of education in our society
The criteria used to judge the quality of the 2007 Distinguished Middle and High School Applications are contained in CSRP’s Rubric for Scoring. The research references [http://www.cde.ca.gov/ta/sr/cs/program07.asp] used to develop these criteria along with the criteria themselves are posted on the CSRP Web page.
Application and Rubric Development
The application and rubric were developed by the California Department of Education’s (CDE) Policy and Evaluation Division, Awards Unit, in collaboration with the following program offices to ensure that current best practices and state and national research in their areas of expertise were appropriately reflected in the criteria:
- Curriculum Frameworks and Instructional Resources Division
- Learning Support and Partnerships Division
- Nutrition Services Division
- Professional Development and Curriculum Support Division
- School Improvement Division
- Secondary, Postsecondary and Adult Leadership Division
- Standards and Assessment Division
- Special Education Division
The scoring rubrics were further reviewed and edited by representatives from the following organizations involved with secondary education:
- California County Superintendents Educational Services Association
- County Offices of Education
- Association of California School Administrators
- California Association for Supervision and Curriculum Development
- California League of High Schools
- California League of Middle Schools
- California Middle Grades Partnership Network
- California School Libraries Association
- California Teachers Association
- Middle Grades Alliance
- SELPA Administrators
Optional Special Emphasis Area: Career Technical Education
This year, high schools were invited to apply for special honors in Career Technical Education (CTE) as a special emphasis area. Its inclusion reflects the strong support of the State Superintendent of Public Instruction for preparing all high school students for the workforce as essential and integral to the basic education plan for California public schools. This special emphasis area of the Distinguished School Application was optional and was evaluated separately by a panel of CTE experts.
Eligibility Criteria
In order to be eligible to apply for the 2007 secondary cycle, schools had to meet the following requirements:
Eligible Grade Levels
The CDE has developed standard criteria to define schools as elementary, middle, or high for the Academic Performance Index (API). For the purposes of CSRP, schools are required to use the school type assigned to them by those criteria. A school defined as “middle” or "high" on its API Report has met the grade eligibility requirement for the 2007 cycle. Information regarding school type designations [http://www.cde.ca.gov/ta/ac/ap/index.asp] is available on the API Web page.
Previous Distinguished School Status
2005 Distinguished Middle and High Schools were not eligible to apply this cycle. They may apply for recognition again in the 2009 cycle.
Number of Years in Operation
Schools must have been operating since 2004-05 in order for growth results to be calculated for the API.
Assessment Results
In order to apply for the Distinguished School award, schools must meet the eligibility criteria for Adequate Yearly Progress (AYP) and Academic Performance Index (API).
- No Child Left Behind (NCLB) AYP Eligibility
Schools must make AYP as reported on the 2006 Adequate Yearly Progress Report. More information regarding AYP http://staging.cde.ca.gov/ta/ac/ap/index.asp is available on the AYP Web page.
- API Eligibility
Schools must fall into one of the two following categories as reported on the 2006 Academic Performance Index Growth Report:- Middle schools with a schoolwide API Growth of at least 715 and high schools with a schoolwide API Growth of at least 692 (the midpoint of the statewide distribution respectively) and not greater than 799
- Schoolwide 2006 API Growth must meet or exceed the school's growth target.
- All numerically significant subgroups must make at least 80 percent of the school's growth target unless a subgroup's score was 800 or above. If a subgroup's score was 800 or above, it must remain 800 or above.
-- OR --
- Middle and high schools with a schoolwide API Growth of 800 or above
- Middle and high schools with a schoolwide API Growth API of 800 or above and for whom all numerically significant subgroups have an API Growth of 800 or above have no other additional qualifying conditions.
- Middle and high schools with a schoolwide API Growth 800 or above and for whom any numerically significant subgroups have an API Growth under 800 must have made at least 1 point growth for each subgroup under 800.
- Middle schools with a schoolwide API Growth of at least 715 and high schools with a schoolwide API Growth of at least 692 (the midpoint of the statewide distribution respectively) and not greater than 799
Intervention or Sanction Status
Schools that participate in the state Immediate Intervention Underperforming Schools Program (II/USP) or are subject to the School Assistance and Intervention Team (SAIT) interventions are not eligible to apply for this program. Schools that are subject to federal Program Improvement (PI) sanctions are, likewise, not eligible to apply for this program.
Schools With Testing Irregularities
Schools for which districts have concluded that an adult testing irregularity occurred are ineligible to apply.
Schools in the Process of Correcting Data
Middle and high schools for which districts were making corrections to the Standardized Testing and Reporting (STAR) data could submit a 2007 California Distinguished School Application if their district offices were confident the schools would ultimately meet the eligibility criteria based on the final AYP and API reports released in January 2007. It was the responsibility of these schools to determine if they were willing to submit an application by the December 2006 deadline, knowing that their final eligibility would not be determined until mid-January 2007.
Schools with Outstanding State and Federal Issues of Non-Compliance
While outstanding issues of non-compliance do not affect a school’s eligibility, districts should be aware that any school with an unresolved compliance issue may be prevented from receiving the California Distinguished School designation.
Career Technical Education Awards Eligibility Criteria
High schools were eligible to apply for the 2007 Exemplary Career Technical Education Award if they met the eligibility criteria stated above and either:
- Applied for the 2007 California Distinguished High School Award
-- OR --
- Were selected as a 2005 California Distinguished High School and did not apply for the Exemplary CTE Award in 2005.
Additional Screening
The CDE’s School and District Accountability and Special Education Divisions screen all applicants and their districts for outstanding program complaints and/or unresolved compliance issues. A school would be excluded from nomination only if it was specifically named in such an issue or if the school or district failed to make a good-faith effort to resolve the issue. District superintendents are provided with the opportunity to resolve less serious paperwork-related items as quickly as possible in order for their school’s nomination to go forward.
Evaluation of Applications
Under the direction of staff from the CDE Policy and Evaluation Division and some of the program offices listed earlier, teams of experienced local educators recruited from across the state assisted with the evaluation of applications. Evaluators compared the quality statements in each theme of the rubric to the corresponding theme of the applications and assigned a rubric score that most closely resembled the information in the application. The rubric has four levels (4 signifying the highest quality) that are derived from best educational practices as reflected in current educational research and state policies and programs. The Standards and Assessment theme was weighted double the value of the others. In several themes, level 4 describes an ideal toward which schools are encouraged to strive. The statewide nominees received scores of 3 or 4 on all of the nine rubric themes, except for a score of 6 or 8 on the double weighted theme.
Each application was read and scored independently by at least two evaluators who provided comprehensive written feedback. Expert team leaders subsequently reviewed the scores and comments to ensure inter-rater reliability. In cases of disparity between evaluators' scores or comments, one or more additional expert evaluator(s) also read and scored the application.
Selection of Distinguished School Statewide Nominees
Applications were received from 279 middle and high schools, from among 478 schools deemed eligible. The scores from each evaluator were combined to form a final composite score, and the schools were ranked in numerical order from highest to lowest. The cut scores for statewide nominees and schools receiving honorable mention were determined by technical experts. Applications with the highest scores (7.0 – 8.0) were selected as statewide nominees to receive site visits. They include 76 middle schools and 95 high schools representing 35 counties. Twenty nine middle and high schools whose applications received a score of 6.5 – 6.9 were selected to receive Honorable Mention award certificates.
County superintendents received notification of the results of the Statewide Nominee selection. They notified district superintendents who, in turn, notified the principals of their applicant schools. Principals receive an official notification letter from CDE that includes the evaluator comments. A structured appeals process that provides an opportunity for reevaluation of an application is described in the CDE notification letter.
Selection of Exemplary Career Technical Education Statewide Nominees
A panel of career technical educators evaluated the (CTE) Special Emphasis Area applications. The raw scores of each evaluator were combined to form a composite final score, and the schools were ranked in numerical order from highest to lowest. Applications with the highest final scores (5.0 – 6.0) were selected as statewide nominees to receive site visits. Three high schools were selected as Exemplary Career Technical Education statewide nominees. Teams of career technical educators from CDE and county offices of education visited the CTE statewide nominee schools to validate their applications.
Validation of Applications
Each Statewide Nominee received a site visit to validate the contents of its application. By agreement with the California County Superintendents Educational Services Association, each county office of education organized and scheduled site validation teams comprised of local educators and CDE staff. A nominated school may be eliminated from final recognition if, in the rare circumstance, the team is unable to validate that the information in the application was accurate. There is no requirement that a specific number of schools be approved or eliminated. All schools receive the award if the site visits are successful. County superintendents provide the assurance that the site validation reports are accurate. CDE leadership review the site validation reports and make final recommendations to the State Superintendent.
Announcement to Media and Presentation of Awards
On April 16, 2007, State Superintendent Jack O’Connell announced the 2007 Distinguished Schools and Exemplary Career Technical Education award winners in a statewide news release. Superintendent O’Connell will personally congratulate selected staff from each school at the Distinguished School Awards Ceremony at the Disneyland Hotel on May 18, 2007. Many of California’s most prominent corporations and foundations will sponsor and attend the event.
