CAEP Annual Reporting Measures
Annual Reporting Measures
The following reporting measures give a snapshot of Liberty University’s School of Education program impact and its outcomes from the 2020-21 academic year.
Source of measures:
- Recent alumni and employer surveys from graduates in our initial and advanced licensure programs.
- Institutional and national data.
Measure 1 (Initial): Completer effectiveness and Impact on P-12 learning and development (Component R4.1)
Completer Effectiveness (contribute to student learning growth):
This impact study was designed to address CAEP indicators R4.1, which emphasizes the use of multiple state-supported impact measures related to expected levels of student growth (R4.1a) and using validated observation instruments to determine whether program completers effectively apply the professional knowledge, skills, and dispositions that the preparation experiences were designed to achieve (R4.1b).
Completer participants are recruited for the study each year who are actively teaching full time in K-12 schools. For the 2020-2021 academic year, six completers agreed to participate in the Impact Study. The six participants were undergraduate program completers with the following licensure areas: 2 elementary education, 2 special education, and 2 secondary education (biology, math).
The completers are asked to collect an assessment they gave to their K-12 students for analysis and reflection. The completers were interviewed regarding their assessment processes which is then transcribed and coded for themes. The coding revealed the following themes to be highlighted as strong, meaning it resulted in high frequency during the coding process.
- Completers K-12 students demonstrated learning growth as a result of their instruction.
- Completers created or adapted future assignments based on assessment data.
- Completers considered needs of exceptional students on assessments results.
- Completers used assessment data to identify students and deliver remediation.
Completer Effectiveness (apply skills in P-12 classrooms that preparation experiences were designed to achieve):
Impact Study Results: K-12 Student Surveys (N=2 teachers, 22 K-12 students)
- 100% of K-12 students provided the highest rating of strongly agreed that their teacher shows respect to all students.
- 95% of K-12 students provided the highest rating of strongly agreed that their teachers were knowledgeable about his/her subject area.
LU Graduate Impact Study 2021, case study of first year teachers.
Conclusions: LU School of Education (SOE) completers demonstrated proficiency in their ability to effectively plan lessons, deliver instruction, and assess their students to analyze learning growth according to the SOE Impact Study.
Measure 2. (Initial and/or Advanced): Satisfaction of employers and stakeholder involvement (Components R4.2|R5.3 | RA.4.1)
Measure 2: Satisfaction of Employers: (R4.2 & RA.4.1)
R4.2 Employer Survey-SOE Career Fair
RA4.1 Employer Survey-SOE Career Fair
Employer Survey: SOE Career Fair (2021)
The SOE Employer Satisfaction Survey was developed to measure the success of program completers in the field. The SOE Employer Satisfaction Survey assesses program completers’ impact in the classroom (e.g. classroom management, instructional practice, content knowledge, professional responsibility, employment retention, etc.). The survey was developed internally by the School of Education. It has nine questions which use a Likert scale, and one open-ended question. The last of the nine questions is specific to advanced licensure programs, providing data on completers of the admin/supervision, reading specialist, math specialist, and school counseling programs.
A link to the full Career Fair Employers Survey Results can be viewed in the LU Employer Survey-Career Fair Survey Spring 2021.
Stakeholder Involvement: (R5.3)
Partner Satisfaction Survey
The mission of the School of Education’s Partnership Program is to provide a forum for collaboration between the School of Education (SOE) and its education partners to ensure a mutually beneficial relationship for all involved in the Educator Preparation Program (EPP).
SOE Partnership Model
The School of Education maintains a partnership website which can be viewed at: www.liberty.edu/soepartners. The website provides partners with links to events and resources related to their interests.
The School of Education has four advisory councils and two of them relate directly to external partners.
CAC: Community Advisory Council – External
GAC: Global Advisory Council – External
Measure 3 (Initial and/or Advanced): Candidate competency at program completion (Component R3.3 |RA3.4)
The Candidate Preservice Assessment Student Teaching (CPAST) is a proprietary formative and summative assessment implemented during the student teaching practicum (i.e., the culminating field experience of a teacher preparation program). Because the assessment is used as a coaching tool, it is used twice – once midway through the student teaching practicum and once at the end. The data from the CPAST assessment allows for national comparison. The rubric contains levels 0-3.
CPAST Score Results: 2020-21
Fall 2020 Term
- Regarding teaching pedagogy, LU candidates scored a mean of 2.63 compared to the national mean of 2.50 (out of 3.0).
- Regarding candidate dispositions, LU candidates scored a mean of 2.81 compared to the national mean of 2.70 (out of 3.0).
Spring 2021 Term
- Regarding teaching pedagogy, LU candidates scored a mean of 2.65 compared to the national mean of 2.52 (out of 3.0).
- Regarding candidate dispositions, LU candidates scored a mean of 2.76 compared to the national mean of 2.68 (out of 3.0).
The results of the CPAST student teaching assessment above reveal all initial licensure candidates’ final assessment results. In both semesters for the 2020-21 academic terms, Liberty University candidates consistently scored above the national average for this culminating assessment for teaching performance. The detailed report for this assessment can be found in the LU Student Teaching Assessment.
Advanced Programs RA3.4
The EPP has developed an Advanced Internship Assessment (AIA) for each of the four endorsements in the advanced licensure program:
- AIA-AS Administration/Supervision
- AIA-MS Math Specialist
- AIA-RS Reading Specialist
- AIA-SC School Counselor
The Advanced Internship Assessment (AIA) is used during the final internship course for advanced licensure candidates to assess their performance on using the standards of their area of specialization in a school setting. Overall, Liberty University advanced program candidates consistently scored Acceptable (level 2) or at Target (level 3) for each of the CAEP six professional skills assessed within the Internship Assessment. The detailed report for this assessment can be found in the LU Advanced Programs Internship Assessment.
- Percentage of LU candidates in Advanced Programs scoring at or above target for CAEP Professional Skills on Internship Assessment:
- 99% on Application of professional dispositions, laws and policies, codes of ethics and professional standards appropriate to their field of specialization.
- 99% on Applications of data literacy.
Measure 4 (Initial and/or Advanced): Ability of completers to be hired in education positions for which they have prepared.
LU Alumni Survey 2020-21:
The Alumni Survey assesses the achievement and success of recent graduates from Liberty University. Topics on the survey include job placement, job relevance, and overall satisfaction with the program. There are 23 total questions on the survey with 20 questions for all graduates, 3 questions specific to the School of Education, and one question specifically for advanced programs.
The Alumni Survey is completed in the fall semester post-graduation and is used post-graduation in years 1, 5, 10, and 15. The Alumni Office, the Office of Institutional Effectiveness, and the School of Education use this assessment to measure the success and satisfaction of program completers. The detailed report for the alumni survey data can be found in the LU Alumni Survey Gainful employment.