Skip to main content
California Department of Education Logo

PSAA Meeting Minutes–April 15, 2014

Minutes of the Advisory Committee for the Public Schools Accountability Act (PSAA) of 1999.
PSAA Advisory Committee Members Present:
  • Co-Chair: Ting Sun, Educational Programs Director, Natomas Charter School
  • Co-Chair: Kenn Young, Superintendent, Riverside County Office of Education

  • Nancy Aaberg, Superintendent, Yuba City Unified School District
  • Constantino Aguilar, Principal, Golden Valley High School
  • Dennis Cima, Senior Vice President, Silicon Valley Leadership Group
  • Edward Haertel, Emeritus Professor, School of Education, Stanford University
  • Mia Keeley, Analyst, Admissions and Records/Early Assessment Program, California Community Colleges Chancellor's Office
  • Clifford Kusaba, Teacher, California Teachers Association
  • Chet Madison, Sr., President, Board of Education, Elk Grove Unified School District
  • Laurie Olsen, Director, The Sobrato Early Academic Language Program
  • Benjamin Scinto, Principal, St. Helena High School
  • Colleen A.R. You, President, California State PTA
PSAA Advisory Committee Members Absent:
  • Wendell Callahan, Director, Assessment, Research, and Pupil Services, San Diego County Office of Education
  • Julianne Hoefer, Director, Assessment and Accountability, Fountain Valley Unified School District
  • Jeff Patterson, English Teacher, SOAR Prep Academy
Principal California Department of Education (CDE) Staff to the Advisory Committee:
  • Keric Ashley, Director, Analysis, Measurement, and Accountability Reporting Division (AMARD)
  • Jenny Singh, Administrator, Academic Accountability Unit
State Board of Education (SBE) and Legislative Representative:
  • SBE Liaisons to the PSAA Advisory Committee: Ilene Straus
  • SBE Staff: Patricia de Cos, Deputy Executive Director

Please note that the complete proceedings of the April 15, 2014, PSAA Advisory Committee meeting, including captioning, are available on the CDE PSAA Meeting Webcast Archive 2014 Web page.

Public Session
April 15, 2014
Ting Sun called the meeting to order at approximately 10:04 a.m.


Item 1

Subject: Welcome and introductions

Constantino Aguilar, Principal, Golden Valley High School, and Benjamin Scinto, Principal, St. Helena High School, were welcomed as new members to the PSAA Advisory Committee to replace members who retired from the Committee in December 2013.

ACTION: No action taken.

Item 2

Subject: CDE Update—Information

Smarter Balanced field testing has begun. The CDE has received feedback from those conducting the field testing. It was reported that as of April 15 over one million students have started testing with no significant technological problems reported to date.


The SBE took action at its March 2014 meeting on the recommendations of the PSAA Advisory Committee by deciding not to calculate an Academic Performance Index (API) for elementary, middle, and high schools for 2014. Assembly Bill (AB) 484 provides the three following alternatives for schools and school districts that do not receive an API to meet legislative requirements or for local use:

  • Use the most recent growth API
  • Use an average of the three most recent growth APIs
  • Use alternative measures that show increases in student achievement schoolwide and for all student groups

For 2014, the CDE will roll over the prior year’s API score, keeping it available for future use. Also, the CDE will provide both weighted and non-weighted three-year averages of the most recent growth APIs to be available in May 2014.

ACTION: No action taken.

Item 3

Subject: Review Decisions Made at the February 20, 2014, PSAA Committee Meeting—Information

CDE staff summarized PSAA Advisory Committee meeting actions from its February 20, 2014 meeting. The Educational Policy Improvement Center (EPIC) is conducting literature reviews on potential multiple measures for the college and career indicator. It was reported that two literatures reviews will be presented today, SAT/ACT and Advanced Placement (AP)/International Baccalaureate (IB). Five of the six topics for the papers have been selected by the Committee. The selection of topic six is an action item on the agenda (see Item 8 below).

ACTION: No action taken.

Item 4

Subject: Presentation: Follow-up to the October Career Readiness Presentation by Carolyn Zachry and Joe Radding, Career and College Transition Division, CDE—Information

Dr. Zachry and Dr. Radding presented responses to questions of the PSAA Advisory Committee from its October 22, 2013 meeting. They provided a chart showing a summary of the National Occupational Competency Testing Institute (NOCTI) 21st Century Skills Workplace Success Assessment elements and how well the elements are aligned with California standards of career ready practice and the Smarter Balanced assessments. They also provided results of a survey sent to other state directors of Career Technical Education (CTE) asking whether career readiness measures are used for all students, whether career readiness measures are used in statewide accountability systems, and what instruments are used for these measures. Lastly, they provided a statement of clarification in the Linked Learning model regarding the extent to which the completer rate would include the academic links to the CTE sequence.


Russell Weikle, Director of the Career and College Transition Division, commented that the California Standards for Career Ready Practice essentially define what is career ready and suggest indicators of readiness. The National Association of State Directors of Career Technical Education Consortium (NASDCTEC) developed standards of career ready practice, and California adapted those standards. California's standards of career ready practice are aligned 100 percent with the NASDCTEC standards. NOCTI developed their assessment of 21st century skills to align with the NASDCTEC standards. Therefore, California’s standards are aligned with the NOCTI measures.

ACTION: No action taken.

Item 5

Subject: Presentation: Success for All: Multiple Measures for College and Career Readiness by Christopher Cabaldon, Linked Learning Alliance—Information

Mr. Cabaldon provided background information about the Linked Learning approach and its focus on both college and career readiness for all students (rather than either college or career readiness). He reported that college readiness measures are currently available and accepted, based on state level data. Some career readiness data is reported to the state (Perkins, California Longitudinal Pupil Achievement Data System [CALPADS]); however, the Committee should consider currently emerging local career readiness measures based on data not necessarily reported to the state, but that meets a specified high standard:

  • AB 790 Linked Learning Pilot Program: Institute for Evidence-Based Change (IEBC)
  • Career Pathways Trust: IEBC and Cal-PASS+
  • CORE/Gardner Center Districts: School Quality Improvement System
  • Local Control and Accountability Plan development: CTE sequences or programs that align with state board-approved CTE standards and frameworks, with exemplars

Mr. Cabaldon described and gave examples of course and program indicators, demonstration indicators, postsecondary experience indicators, and potential voluntary indicators that could be considered for inclusion in the API as measures for college and career readiness. He recommended incorporating explicit incentives into the API for career readiness for all high school students, including college bound students. He commented that the system tends to be driven by how colleges and universities expect course patterns to be structured but that colleges should move beyond the current stepwise progression of courses model to a skills-based approach.

ACTION: No action taken.

Lunch Break

Item 6

Subject: Presentation: Literature Reviews by Dr. David Conley, Dr. Kristine Chadwick, and Paul Beach, EPIC—Information

Dr. Conley provided an overview and described the analytical framework of the API EPIC project, which is to provide a set of six literature review papers regarding possible college and career readiness measures for the API. Each of the measures in the six literature review papers will be developed and evaluated against the ten criteria of an analytical framework. The measures presented at today’s meeting were the SAT/ACT and AP/IB. Dr. Conley provided brief background information for each measure and described each measure in relation to the analytical framework criteria.


Dr. Conley summarized that college readiness tends to be more than English-language arts (ELA) and mathematics academic knowledge. It also involves meta-cognitive learning skills, i.e. "soft skills," that include the ability to set a goal for yourself, have high aspirations, be motivated, manage yourself personally, and persist when you run into challenges. He stated that this constellation of skills dramatically increases the probability that a student will succeed in postsecondary contexts.

ACTION: No action taken.

Item 7

Subject: API College and Career Indicator: Identify Additional Information/Data Needed for the Topics Presented in the First Two Literature Reviews—Information

The Committee identified areas in the first two literature reviews needing additional information, data, or clarification by the EPIC.

ACTION: No action taken.

Item 8

Subject: Select College and Career Measure(s) for the Sixth Literature Review—Action

PSAA Advisory Committee members reviewed the current list of literature reviews to be conducted:

  1. SAT and ACT (college entrance exams)
  2. AP and IB participation and achievemen
  3. Career readiness assessments and CTE certifications/credentials
  4. Innovative measures (e.g., non-cognitive, performance tasks)
  5. Course taking/pathways /a-g requirements (clusters of courses)
  6. To be determined at the April 15, 2014 PSAA Advisory Committee meeting

Dr. Conley and the Committee identified and discussed several topics for the sixth literature review. The Committee concluded that it would be premature to make a decision on the topic for the sixth literature review at this meeting and will consider it as an agenda item for the next PSAA Advisory Committee meeting in June 2014.

ACTION: No action taken.

The meeting was adjourned at approximately 2:59 p.m.

Questions: Academic Accountability Team | | 916-319-0863 
Last Reviewed: Tuesday, January 26, 2016
Recently Posted in Accountability