CAEP Component R5.4|RA.5.4

The Council for Accreditation of Educator Preparation (CAEP) requires the Educator Preparation provider (EPP) to report four accountability measures annually that demonstrate the accountability and performance of the program's initial undergraduate and advanced graduate licensure programs to share with stakeholders and students (both prospective and current).

The four accountability measures are divided into two areas: Impact Measures, which measure data on 1. completer effectiveness and Impact on P-12 learning and development, and 2. satisfaction of employers and stakeholders. Measures two, Outcome Measures, measure data on 3. candidate competency at program completion and 4. the ability of completers to be hired in education positions for which they have prepared (initial and advanced levels).

The following sections contain information and data on accountability measures outlined by CAEP. This information is collected annually via various data sources. Please click on the appropriate section below for more information on each of the College of Education EPP CAEP accountability measures.

CAEP (Council for the Accreditation of Educator Preparation>) has four annual reporting measures that provide information to the public on program impact and program outcome. The CAEP measures with links to supporting evidence for each measure are as follows:

Impact Measures - Initial and Advanced Programs

• Measure 1: Completer Effectiveness and Impact on P-12 Learning and Development -R4.1
  
  • The State of Tennessee and the University of Memphis College of Education Educator Preparation Provider (EPP) track, monitor, and measure the impact of teacher candidates on student learning, growth, and development. The data provided informs college-wide and programmatic improvement within the EPP. Data from TVAAS and Provider impact is retrieved from the TN Report card. The State Report Card data was generated via export of all cohort members recommended for initial TNCompass licensure, provided by the TNCompass vendor RANDA. (2022-2023 EPP TVAAS data published by TVAAS)

    • UM EPP REPORT CARD ( 2023 EPP State Report Card / 2022-2023 Completer Satisfaction Data / TDOE Educator Survey-initial ):

      “Teachers impact every other profession in our state by developing people — equipping students with the critical knowledge, tools, and skills they need to succeed in post-secondary education, careers, and beyond. The knowledge and skills taught in educator preparation programs are vital to ensuring every student in Tennessee has a well-prepared teacher from Day 1 in the classroom. The report card uses multiple metrics to provide information about teacher and leader preparation in the state and spotlight each provider's strengths and areas in which to continue to grow.

      In 2007, the Tennessee General Assembly passed legislation requiring the publication of a report on key metrics of educator preparation providers throughout the state. Several aspects of the report card are required by that legislation, including indicators: placement and retention rates, scores on licensure exams, and teacher effect data based on Tennessee Value-Added Assessment System (TVAAS) scores. The report card also includes other key priority areas for the State Board. This information can help providers make program improvements and inform the public on important aspects of educator preparation in the state.”

• Measure 2: Satisfaction of employers and stakeholder involvement- R4.2, R4.3, R5.3|RA4.1, RA 4.
  
  • The State of Tennessee and the EPP collect data on its completers and employers to analyze the college's impact on preparing candidates to work in P-12 schools. Data from the Tennessee Report card is provided for initial and advanced programs.
    • Satisfaction of Employees ( 2022-2023 Employer Satisfaction/Provider Impact Data, retrieved from TN Report Card )
    • Employment: First-Year Employment, Second-Year Retention, and Third-Year Retention ( 2023 Initial Candidate First-Year through Third-Year Retention / 2023 Employment Outcomes Leaders Preparation Completers-Advanced )

 Outcome Measures - Initial and Advanced Programs

• Measure 3: Candidate Competency at Program Completion- R3.3|RA3.4
  • The Tennessee Educator Preparation Report Card provides a public view of the competencies of College of Education Educator Preparation Provider candidates, as measured by multiple assessments required to obtain a teacher or leader licensure.  Data from national assessments is also provided to reflect the EPP’s candidates' competency at program completion.
    
    • 2022-2023 Praxis/Title II Report - Initial
    • 2022-2023 Praxis/Title II Report - Initial
    • 2022-2023 Candidate Assessment - Initial (UM TN Report Card)

    • Advanced Praxis Leadership Data

  • Candidates in the Master’s ICL 7992 must complete a Master’s project. The course instructor gives candidates directions for developing their project using a four-point rubric with seven items aligned with InTASC Standards: 4q,5g,5n,5r, 10f, and 10s.
    
    • View Fall 2023 Assessment Data

    • Interpretation of the Data: The EPP had ten (10) candidates to complete the ICL 7792 Graduate Composition Project. Of the ten candidates, nine were females, and one was male. One was an African American, four were African American females, and five were white females.

      The point range for the evaluations was 23-28 points for skillful, 17-22 points for adequate, 11-16 points for developing, and 10-0 for unacceptable. 6/10 candidates scored within the skillful range (60%), 3/10 scored adequate (30%), and one candiate1/10 (10%) scored developing on this assessment. However, all candidates passed the project composition evaluation. The EPP has decided to revise the assessment to strengthen the directions, purpose, expectations, and outcomes for this assessment for the Fall 2024 semester. 

• Measure 4:  Ability of completers to be hired in education positions for which they have prepared (initial and advanced levels)
  
  • To address Measure 4, Ability of Completers to be Hired in Education Positions for which They Have Prepared, UTM EPP analyzes data from the Tennessee Department of Education Annual Reports and the University of Memphis EPP Report Card.
    
    • 2022-2023 UM State Report Card

Additional EPP Candidate and Consumer Data

• 2022-2023 Program Enrollment by race-initial and advanced (R3.1|RA3.1)
• 2022-2023 Program Enrollment by gender-initial and advanced (R3.1|RA 3.1)
• 2022-2023 EPP degrees awarded by race- initial and advanced (R3.1| RA3.1)
• 2022-2023 EPP degrees awarded by gender- initial and advanced (R 3.1|RA 3.1)
• 3-year student loan default rates
• 2022-2023 TN Vacancy data

Quality Assurance and Assessment System

The Quality Assurance and Assessment System (QAAS) measures and evaluates candidates’ knowledge, skills, and dispositions and guides continuous improvement in the Educator Preparation Provider (EPP). The College of Education (COE)/Educator Preparation Provider maintains a quality assurance system that consists of valid data from multiple measures and supports continuous improvement. The QAAS consistently and systematically collects and analyzes its data on candidate qualifications, performance, course, and clinical experiences. The EPP maintains this system to evaluate and improve candidate performance and its programs. The EPP Quality Assurance and Assessment System is a cohesive system consisting of:

1) personnel responsible for managing data collection, monitoring, and data use within the quality assurance system.

2) technologies used to manage data collection, storage, analysis, and reporting.

3) monitoring candidate qualifications and performance.

4) assessments of candidate knowledge, skills, and dispositions implemented at specific transition points within a program.

5) evaluations of clinical/field experiences, academic programs, key EPP operational effectiveness, and P12 partnerships.

 6) systematic management and oversight of recruitment and admissions data to attract applicants from diverse populations and to address critical shortage areas.

7) procedures for monitoring completer outcomes.

8) procedures and practices that oversee data collection, analysis, and dissemination and support the use of data in evaluating candidate performance and program components, as well as EPP-wide improvements.

 9) stakeholders who regularly review data and components of the quality assurance system itself as part of the continuous improvement process.

The diagram below describes the process of the Quality Assurance System Assessment Cycle and is based on the foundation that:

The EPP QAS must be:

1. Comprehensive and reflect the Conceptual Framework.
2. systematic with multiple decision points.
3. aligned assessments with applicable knowledge and skill standards.
4. reflect a commitment to fairness, accuracy, consistency, and the avoidance of bias.
5. ensure faculty and stakeholder involvement; and
6. be continuously reviewed and revised.

The Quality Assurance System measures and evaluates candidates’ knowledge, skills, and dispositions and guides Continuous Educator Preparation Provider improvement.

View EPP Quality Assurance and Assessment System Input Model

View Quality Assurance and Assessment System Flow Graphic

Annual Report Cards

• 2020 Annual Report Card
• 2019 Annual Report Card
• 2018 Annual Report Card

Title II Reports

• 2018-2019 Title II Report - Traditional
• 2018-2019 Title II Report - Alternative
• 2017-2018 Title II Report - Traditional
• 2017-2018 Title II Report - Alternative