This page is the Accessible Alternative Version (AAV) of the API Calculator Training (PPT; Posted 24-Sep-2012) posted at the Academic Performance Index Web page. The PPT version is considered to be the official version of the document.
Slide 1
Training on the Use of the
2011–12 Academic
Performance Index Calculator
Slide 2
Agenda
- Overview of the Academic Performance Index (API) Calculator
- Review of the API Rules
- Practice Questions
- Entering Standardized Testing and Reporting (STAR) Program and California High School Exit Examination (CAHSEE) Assessment Results into the API Calculator
- Resources and Contact Information
Slides 3-7
Overview of the API Calculator
- What is the API Calculator?
- An Excel spreadsheet designed for local educational agencies (LEAs) and schools to input STAR and CAHSEE student results to estimate their API scores.
- An Excel spreadsheet designed for local educational agencies (LEAs) and schools to input STAR and CAHSEE student results to estimate their API scores.
- Where is the API Calculator located?
The calculator is available on the California Department of Education (CDE) API Web page [http://www.cde.ca.gov/ta/ac/ap/] under the bullet "Calculation Spreadsheets Base and Growth." Be sure to select the calculator for the appropriate API cycle (2011 Base and 2012 Growth).
- Save the spreadsheet on your computer before using it.
- The API Calculator has 12 worksheets:
- 1. instructions
- 2. What’s New and FAQs
- 3. Grade
- 4. Grades 3-5 Students with Disabilities (SWD) Only
- 5. Grades 3-5 Non-SWD
- 6. Grade 6 SWD Only
- 7. Grade 6 Non-SWD
- 8. Grades 7-8 SWD Only
- 9. Grades 7-8 Non-SWD
- 10. Grades 9-12 SWD Only
- 11. Grades 9-12 Non-SWD
- 12. Bridge (schools that cross grade/SWD span)
- What data will I need in order to complete the API Calculator?
- 1. STAR and CAHSEE (The results are sent to LEAs by the Educational Testing Service [ETS].
- 2. California Longitudinal Pupil Achievement Data System (CALPADS) data
- 1. STAR and CAHSEE (The results are sent to LEAs by the Educational Testing Service [ETS].
- Why do I need to use STAR/ CAHSEE results from ETS and CALPADS data?
Because inclusion/exclusion and adjustment rules are applied as the first step to calculating an API score, it is important to use the STAR/CAHSEE results received from ETS and the CALPADS data in order to make specific determinations.
(The STAR/CAHSEE results posted on the CDE Web pages do not contain all the necessary information needed to accurately apply the inclusion/exclusion or adjustment rules.)
Slides 8-11
API Rules
- API inclusion/exclusion and adjustment rules must be applied prior to entering STAR/CAHSEE student results into the calculator.
- Full details of the API rules can be found in the 2011–12 API Reports Information Guide posted on the CDE API Web page [http://www.cde.ca.gov/ta/ac/ap/] (see pages 25-39).
- Only test scores that meet the inclusion rules are included in the API; these scores are referred to as valid scores.
- The following inclusion/exclusion and adjustment rules are applied to determine when and how a test score is included in the API:
- Mobility/Continuous Enrollment
- English Learners (ELs)
- Blank Test
- Testing Irregularity
- Accommodations
- Modifications
- Special Conditions
- Adjustments to Performance Levels
- Assignment of 200
- CAHSEE
- Reassignment of Test Scores
- How are the inclusion/exclusion rules applied in determining the number tested and valid scores?
Generally, the process used in applying the inclusion/exclusion rules occurs in the order presented in the prior slide. Some variations may occur for student records where multiple inclusion/exclusion rules apply.
Slide 12
API Rules: Mobility or Continuous Enrollment
- Mobility or continuous enrollment is defined as the student being enrolled at the same school and/or district from Fall Census Day to the first day of STAR/CAHSEE testing without having a gap in enrollment of more than 30 consecutive calendar days. Beginning with the 2011 Base API, continuous enrollment is determined using the CALPADS data. Any student who is not continuously enrolled will not have their test scores included in the API.
Slide 13
API Rules: ELs
- EL students who have been enrolled in a U.S. school for less than one year are not included in the API:
- March 15 is the cut-off date used to determine "less than one year."
- For example, if an EL student enrolled in a U.S. school on March 16, 2011, and took the STAR/CAHSEE in spring 2012, this student’s test scores will not be included in the API.
- March 15 is the cut-off date used to determine "less than one year."
Slides 14-16
API Rules: Blank Test
- If a student record does not have a performance level or shows that no items were attempted on any part of the California Standards Test (CST), California Modified Assessment (CMA), or California Alternate Performance Assessment (CAPA), the entire STAR student record is not included in API.
Exceptions:
- If a student record shows "Tested but Marked No Answers" (STAR Special Condition Code Z) for any content area, the content area is included at the Far Below Basic performance level (200 points in the API calculation).
- If a CAHSEE grade ten student census (February or March) record shows "Blank/Not Attempted" for one or both content areas, this record is included at the Far Below Basic performance level (200 points in the API calculation).
- Blank records for grades eleven and twelve are excluded.
Slide 17
API Rules: Testing Irregularity
- If a content area on a student record reflects a student or adult testing irregularity, the result is included in the Base API but is not included in the Growth API.
- Any adult testing irregularity results in a school not being eligible for any awards program in the current year.
- If the adult testing irregularity affects over five percent of the students, the school’s API is invalidated (i.e., no online report is generated) and the school is ineligible for awards in both the current and future year.
Slide 18
API Rules: Accommodations
- Test administration variations and accommodations do not result in adjustments being made to the student’s test results.
Slide 19
API Rules: Modifications
- Student records indicating that a modification was used are included at the Far Below Basic performance level (200 points in the API calculation).
Slide 20
API Rules: Special Conditions
- The following are the STAR special conditions codes that are considered in API calculations:
- M: Took some tests but moved before remaining tests were administered. (The tests taken are included in the API at the school where the tests were taken.)
- P: Not tested by parent/guardian request. (These tests are not included in the API calculation.)
- M: Took some tests but moved before remaining tests were administered. (The tests taken are included in the API at the school where the tests were taken.)
Slide 21
API Rules: Adjustments to Performance Levels
- Students in Grade Eight Through Eleven Who Take CST General Mathematics:
- Grade Eight Students: Test performance level is dropped by one (e.g., advanced to proficient).
- Grade Nine Students: Test performance level is dropped by two (e.g., proficient to below basic).
- Grades Ten and Eleven Students: Test performance level is dropped to Far Below Basic (200 points in the API calculation).
- Grade Eight Students: Test performance level is dropped by one (e.g., advanced to proficient).
Slides 22-23
API Rules: Assignment of 200
- Grades eight through eleven students who did not take an end-of-course (EOC) CST in mathematics are assigned 200 points (test weight of 0.10 compared to the test weight of 0.20 for students who take a CST in mathematics).
- Grades nine through eleven students who did not take an EOC CST in science are assigned 200 points (test weight of 0.05 compared to the test weight of 0.22 for students who take a CST in science).
- Life Science results are used for grade ten students who take the CST in Life Science but do not take an EOC CST in science (i.e., 200 points will not be assigned).
- Grade ten students who take both an EOC CST in science and the CST in Life Science will have both scores included in the API.
Slides 24-25
API Rules: CAHSEE
- Grade ten students who take the CAHSEE (February or March census) are included in the API:
- 1000 points for a student who passes
- 200 points for a student who does not pass
- Grades eleven and twelve students who take the CAHSEE are included in the API only if they receive a passing score.
- A grade ten make-up record must be matched to a census record using the Statewide Student Identifier (SSID) for the test score to be included in the API.
- "Non-matching" records will not be included in the API.
Slides 26-27
API Rules: Reassignment of Test Scores
- A reassignment of student test scores occur for grades two through twelve when students are referred to an alternative education program (AEP) school.
- An AEP school is defined as:
- County Community School
- Continuation High School
- District Community Day School
- A reassignment occurs if a student:
- Was enrolled at a non-AEP school on Fall Census Day, and
- Was referred to an AEP school using exit reason code T167 within the CALPADS, and
- Took the STAR/CAHSEE at the AEP school.
- Was enrolled at a non-AEP school on Fall Census Day, and
Slides 28-29
Entering Assessment Results into the API Calculator
- After applying the inclusion/exclusion and adjustment rules and determining valid scores, the number of students scoring at each performance level can be entered into the API calculator.
- The API calculator has specific worksheets for "Non-SWD" and "SWD" for all grade spans except grade two.
- Definition of SWD
- Any student record that has a valid Primary Disability code (other than "000" or "999"), or
- Any student who took the CMA or CAPA
- Any student record that has a valid Primary Disability code (other than "000" or "999"), or
- Definition of Non-SWD
- The remaining students who do not meet the above criteria
Slides 30-33
Practice – Grades 2-11
Question 1
- If a grade eight CST student record has a valid Primary Disability Code of "290," where would this student record be entered into the calculator?
- a. The "Grades 7-8 SWD Only" worksheet
- b. The "Grades 7-8 Non-SWD" worksheet
Answer: a
- Any student record with a valid "Primary Disability Code" would be entered into the SWD worksheet, including SWD students who take a CST.
Question 2
- Three students took the Standards-based Tests in Spanish (STS). Under which column should their results be entered into the API calculator?
Answer:
- The STS results are not entered into the API calculator because the STS is not included in the calculation of the API.
- A list of the assessments used in the API can be found on page 5 of the 2011–12 API Reports Information Guide [http://www.cde.ca.gov/ta/ac/ap/documents/infoguide12.pdf].
Slides 34-43
Practice - Elementary
Question 3
- A student at Mountain Elementary School:
- Enrolled on October 20, 2011, and
- Participated in STAR in April 2012
- Would this student’s STAR results be included in the school’s API score?
Answer: No
- Because the student enrolled in the school after Fall Census Day (first Wednesday in October), the student is not considered continuously enrolled and the assessment results will not be included in the school’s API score.
Question 4
- A student at Rocky Elementary School:
- Enrolled on the first day of school in August 2011, and
- Exited via CALPADS for 30 consecutive calendar days in January 2012, and
- Re-enrolled at Rocky Elementary School and participated in the STAR
- Will this student’s STAR results be included in the school’s API score?
Answer: Yes
- The student was enrolled at the school on Fall Census Day and was exited via CALPADS for less than 31 consecutive calendar days. Therefore, this student is considered continuously enrolled and the STAR results will be included in the school’s API score.
Question 5
- An EL student entered into the U.S. and enrolled at River Park Elementary School on March 6, 2011, and participated in STAR in the spring of 2012.
- Would this student’s STAR results be included in the school’s API score?
Answer: Yes
- The "cut off" date is March 15, 2011. Students enrolling in a U.S. school for the first time before March 15, 2011, will be included in the 2012 Growth API.
Question 6
- If a grade eight student scored "Proficient" on the CST General Mathematics, what performance level would be entered into the API calculator?
Answer:
- The performance level would be adjusted from "Proficient" to "Basic" because the performance level of grade eight students who take the CST in General Mathematics is dropped one performance level for the API calculation.
Question 7
- If a grade eight student took the CST in English-language arts (ELA) and scored "Proficient," but did not take an EOC CST in mathematics, what performance levels, if any, would be included in the calculator?
Answer:
- Because this grade eight student did not take an EOC CST in mathematics, a score of Far Below Basic (200 points) will be entered into the API calculator. The CST in ELA "Proficient" score will also be included in the API calculator.
Slides 44-51
Practice - High
Question 8
- If a grade nine student scored "Advanced" on the CST in General Mathematics, what performance level would be entered into the API calculator?
Answer:
- The performance level would be adjusted from "Advanced" to "Basic." Scores for grade nine students who take the CST in General Mathematics are dropped two performance levels for the API calculation.
Question 9
- If a grade eleven student took the CAHSEE and passed the ELA portion, but did not pass the mathematics portion, would both results be included in the school’s API score?
Answer: No
- Only passing grade eleven and twelve CAHSEE results are included in the API. Therefore, the CAHSEE score for the ELA portion would be included but the score for the mathematics portion would not be included.
Question 10
- A grade ten student took the following assessments:
- CST:
- ELA, Life Science, and World History
- CAHSEE:
- ELA
- Mathematics
- CST:
Answer:
- All CST and CAHSEE results would be included in the calculator as is (i.e., there would be no adjustments made to the performance levels).
However, because this student did not take an EOC CST in mathematics, this student would be counted in the "Far Below Basic" cell within the API calculator for mathematics.
Question 11
- A grade nine student took the High School Summative Mathematics Test and scored "Basic." What performance level would be entered into the API calculator?
Answer:
- "Basic." Adjustments are not made to performance levels for the High School Summative Mathematics Test.
Slide 52
Part I of API Calculator
- After the inclusion/exclusion and adjustment rules have been applied, enter the number of students scoring at each performance level into the cells in Part I of each appropriate worksheet.
Calculation Spreadsheet for the 2011 Base API or 2012 Growth API
For Grades 3-5 Students with Disabilities Only
Part I - School Test Data
California Standards Test (CST),
California Modified Assessment (CMA), and
California Alternate Performance Assessment (CAPA)
| Performance Level Weighting Factor (fixed) |
Performance Level |
Number of Valid |
Number of Valid |
Number of Valid Scores: Science (Grade 5 Only) |
|---|---|---|---|---|
| 1000 | 5 : Advanced | 0 | 0 | 0 |
| 875 | 4 : Proficient | 0 | 0 | 0 |
| 700 | 3 : Basic | 0 | 0 | 0 |
| 500 | 2 : Below Basic | 0 | 0 | 0 |
| 200 | 1 : Far Below Basic | 0 | 0 | 0 |
| Total Valid Scores | 0 | 0 | 0 |
Verify that Part I data entry is complete (All cells = 0 or greater).
Slides 53-54
Part I: Grades 9-12 Worksheet, Students and Disabilities
California Standards Test (CST),
California Modified Assessment (CMA), and
California Alternate Performance Assessment (CAPA)
| Performance Level Weighting Factor (fixed) | Performance Level |
Number of Valid Scores: ELA |
Number of Valid Scores: Math |
Number
of Valid Scores: Math 200 Pts.* Assignment |
Number of Valid Scores: Science (End-of-Course Tests) |
Number of Valid Scores: Science 200 Pts.* Assignment (End-of-Course) |
Number of Valid Scores: History-Social Science (Grades 9-11 Only) |
Number of Valid Scores: Life Science (Grade 10 Only) |
|---|---|---|---|---|---|---|---|---|
| 1000 | 5 : Advanced | 0 | 1 | N/A | 0 | N/A | 0 | 0 |
| 875 | 4 : Proficient | 1 | 1 | N/A | 3 | N/A | 4 | 0 |
| 700 | 3 : Basic | 1 | 7 | N/A | 1 | N/A | 8 | 6 |
| 500 | 2 : Below Basic | 3 | 6 | N/A | 10 | N/A | 6 | 0 |
| 200 | 1 : Far Below Basic |
3 | 1 | 4 | 1 | 1 | 3 | 0 |
| Total Valid Scores | 8 | 16 | 4 | 15 |
1 | 21 | 6 |
Verify that Part I data entry is complete (all cells = 0 or greater).
California High School Exit Examination (CAHSEE)
| Performance Level Weighting Factor (fixed) |
Performance Level |
Number of Valid Scores: ELA |
Number of Valid Scores: Mathematics |
|---|---|---|---|
| 1000 | Pass | 2 | 0 |
| blank | blank | N/A | N/A |
| blank | blank | N/A | N/A |
| blank | blank | N/A | N/A |
| 200 | No Pass | 1 | 1 |
| Total Valid Scores | 3 | 1 |
Slides 55-56
Part I: Grades 9-12 Worksheet, Students with Disabilities
California Standards Test (CST)
| Performance Level Weighting Factor (fixed) | Performance Level | Number of Valid Scores: ELA | Number of Valid Scores: Math | Number of Valid Scores: Math 200 Pts.* Assignment | Number of Valid Scores: Science (End-of-Course Tests) | Number of Valid Scores: Science 200 Pts.* Assignment (End-of-Course) | Number of Valid Scores: History-Social Science (Grades 9-11 Only) |
Number of Valid Scores: Life Science (Grade 10 Only) |
|---|---|---|---|---|---|---|---|---|
| 1000 | 5 : Advanced | 246 | 8 | N/A | 94 | N/A | 101 | 59 |
| 875 | 4 : Proficient | 176 | 145 | N/A | 138 | N/A | 136 | 68 |
| 700 | 3 : Basic | 130 | 214 | N/A | 141 | N/A | 76 | 41 |
| 500 | 2 : Below Basic | 22 | 149 | N/A | 33 | N/A | 31 | 6 |
| 200 | 1 : Far Below Basic |
13 | 25 | 7 | 19 | 2 | 27 | 9 |
| Total Valid Scores | 587 | 541 | 7 | 425 | 2 | 371 | 183 |
Verify that Part I data entry is complete (all cells = 0 or greater).
California High School Exit Examination (CAHSEE)
| Performance Level Weighting Factor (fixed) |
Performance Level |
Number of Valid Scores: ELA |
Number of Valid Scores: Math |
|---|---|---|---|
| 1000 | Pass | 201 | 212 |
| blank | blank | N/A | N/A |
| blank | blank | N/A | N/A |
| blank | blank | N/A | N/A |
| 200 | No Pass | 7 | 4 |
| Total Valid Scores | 208 | 216 |
Slide 57
Part II of API Calculator
- Part II of the calculator is automatically updated as Part I is completed.
Slides 58-59
Bridge Worksheet
- The worksheet labeled "Bridge" combines the data from each individual worksheet (e.g., grade 2, grades 3-5, etc.) and automatically calculates the school and LEA API scores.
- Example:
Calculation Spreadsheet for the 2011 Base API or 2012 Growth API
For Bridge Schools that Cross Grade/SWD Spans
API Calculation
| Grade Levels | Total Weights |
API Scores |
|---|---|---|
Grade 2 |
0.00 | 0 |
Grades 3-5 Students with Disabilities Only |
0.00 | 0 |
Grades 3-5 Students with No Disabilities |
0.00 | 0 |
Grade 6 Students with Disabilities Only |
0.00 | 0 |
Grade 6 Students with No Disabilities |
0.00 | 0 |
Grades 7-8 Students with Disabilities Only |
0.00 | 0 |
Grades 7-8 Students with No Disabilities |
0.00 | 0 |
Grades 9-12 Students with Disabilities Only |
15.98 | 558 |
| Grades 9-12 Students with No Disabilities | 609.43 | 846 |
Total Values |
625.41 | 839 |
Slide 60
- "What’s New and FAQs" worksheet in the API calculator
- CDE API Web page [http://www.cde.ca.gov/ta/ac/ap/]
- CDE STAR Web page [http://www.cde.ca.gov/ta/tg/sr/]
- CDE CAHSEE Web page [http://www.cde.ca.gov/ta/tg/hs/]
- ETS STAR Web site [http://www.startest.org/]
- ETS CAHSEE Web site [http://www.ets.org/cahsee/about]
Slide 61
Contact Information
- Betty Miura, Research Analyst
- Jenny Singh, Administrator
Academic Accountability Unit
aau@cde.ca.gov
916-319-0863