Research and Program Evaluation – CEFS 515

CG • Section 8WK • 11/08/2019 to 04/16/2020 • Modified 02/22/2021

Course Description

Students learn the importance of scientific inquiry in the fields of clinical mental health counseling and marriage and family therapy. Emphasis is on research methods (designs, statistical analysis, needs assessment, and program evaluation) and locating, interpreting, and evaluating research and program evaluation articles that inform evidence-based practice. Ethical and cultural relevance as well as ethically appropriate integration is also addressed. 

For information regarding prerequisites for this course, please refer to the Academic Course Catalog.

Rationale

Empirical methods are increasingly being used to justify or criticize the usage of particular counseling approaches in therapy. Government, private foundations, and corporations are asking for program evaluations to determine the merits of each program’s continued funding. Spiritual interventions are being explored for their utility in therapy. In short, the scientific method, counseling, and Christian intervention strategies are intersecting. Counselors with thorough knowledge of research strategies will shape both what psychotherapy looks like and how effective those interventions are in the counseling setting.

Measurable Learning Outcomes

Upon successful completion of this course, the student will be able to:

  1. Explain the role of scientific research in advancing the counseling profession.
  2. Differentiate various research methods (e.g., descriptive, predictive, and explanatory) and research designs (e.g., experimental, quasi-experimental, single-case designs, action research, and outcome-based research). In addition, he or she will describe each of the research methods and designs.
  3. Apply various statistical principles that are often used in counseling-related research and program evaluations.
  4. Describe various models of program evaluation and action research.
  5. Critique research articles and examine the evidence-based practice.
  6. Articulate ethical and legal principles of clinical research.
  7. Assess the utility and limitations of the scientific method in the study of the Christian integration in counseling.

Common Core Courses Matrix of Student Competencies

F.7  Assessment and Testing


 

Course/Experience – Learning Experiences

F.7.e. use of assessments for diagnostic and intervention planning pruposes

Research Proposal Paper Assignment, Quiz: Research Process and Descriptive Methods, Quiz: Process, Methods, and Inferential Statistics, Quiz: Methods, Program Evaluation, and Designs, & Annotated Bibliography Assignment

 

F.7. f.  basic concepts of standardized and non-standardized testing, norm-referenced and criterion-referenced assessments, and group and individual assessments

Research Proposal Paper Assignment

 

F.7.g. statistical concepts, including scales of measurement, measures of central tendency, indices of variability, shapes and types of distributions, and correlations

Research Proposal Paper Assignment, Quiz: Research Process and Descriptive Methods, Quiz: Process, Methods, and Inferential Statistics

 

F.7.h.  realiability and validity in the use of assessments

Annotated Bibliography Assignment, Research Proposal Paper Assignment, Quiz: Research Process and Descriptive Methods

 

F.7.i. use of assessments relevant to academic/educational, career, personal, and social development

Research Proposal Paper Assignment, Topic Selection: Find a Gap Assignment, Topic Selection: Final Topic Selection Assignment, Video Discussion: Present Your Research

F.8  Research and Program Evaluation

F.8.a. the importance of research in advancing the counseling profession, including how to critique research to inform counseling practice

Research Proposal Paper Assignment, Stimulus Questions: Research Training- Joys and Challenges (Ch. Two) Assignment, Annotated Bibliography Assignment, and Video Discussion: Present Your Research

F.8.b. identification of evidence-based counseling practices

Research Proposal Paper Assignment, Stimulus Questions: Research Training- Joys and Challenges (Ch. Two) Assignment, Annotated Bibliography Assignment, Topic Selection: Find a Gap, Topic Selection: Final Topic Selection, and Video Discussion: Present Your Research

 

F.8.c.  needs assessment

Research Proposal Paper Assignment, Topic Selection: Find a Gap, Topic Selection: Final Topic Selection, Video Discussion: Present Your Research, Stimulus Questions: Research Training- Joys and Challenges (Ch. Two) Assignment, Stimulus Questions: Choosing Research Designs- Balancing Ideals and Realities (Ch. Six) Assignment, Program Evaluation Project Assignment

F.8.d. development of outcome measures for counseling programs

Research Proposal Paper Assignment, Video Discussion: Present Your Research, Program Evaluation Project Assignment, Quiz: Research Process and Descriptive Methods, Quiz: Process, Methods, and Inferential Statistics, Quiz: Methods, Program Evaluation, and Designs

F.8.e. evaluation of counseling interventions and programs

Research Proposal Paper Assignment, Topic Selection: Find a Gap, Topic Selection: Final Topic Selection,Video Discussion: Present Your Research, Annotated Bibliography Assignment, and Program Evaluation Project Assignment

F.8. f.  qualitative, quantitative, and mixed research methods

Research Proposal Paper Assignment, Topic Selection: Find a Gap, Topic Selection: Final Topic Selection, Video Discussion: Present Your Research, Annotated Bibliography Assignment, Quiz: Process, Methods, and Inferential Statistics, Quiz: Methods, Program Evaluation, and Designs

F. 8. g. designs used in research and program evaluation

Research Proposal Paper Assignment, Annotated Bibliography Assignment, Video Discussion: Present Your Research, Stimulus Questions: Choosing Research Designs- Balancing Ideals and Realities (Ch. Six) Assignment

F. 8. h. statistical methods used in conducting research and program evaluation

Research Proposal Paper Assignment, Writing Results and Discussion Assignment, Video Discussion: Present Your Research, Stimulus Questions: Choosing Research Designs- Balancing Ideals and Realities (Ch. Six) Assignment, Quiz: Methods, Program Evaluation, and Designs

F. 8. i. analysis and use of data in counseling

Research Proposal Paper Assignment, Stimulus Questions: Choosing Research Designs- Balancing Ideals and Realities (Ch. Six) Assignment, Quiz: Methods, Program Evaluation, and Designs, Annotated Bibliography Assignment, Topic Selection: Find a Gap, Topic Selection: Final Topic Selection, Video Discussion: Present Your Research

F.8. j. ethical and culturally relevant strategies for conducting, interpreting, and reporting the results of research and/or program evaluation

Research Proposal Paper Assignment, Topic Selection: Find a Gap, Topic Selection: Final Topic Selection, Video Discussion: Present Your Research, Program Evaluation Project Assignment, Writing Results and Discussion Assignment

Course Assignment

Textbook readings and lecture presentations

Course Requirements Checklist

After reading the Course Syllabus and Student Expectations, the student will complete the related checklist found in the Course Overview.

Topic Selection Assignments (2)

Topic Selection: Find a Gap: The student will select 3 topics related to the counseling profession. The topics and summaries of 3 peer-reviewed articles published within the last 5 years (one article per topic) will be submitted to the instructor for approval and feedback. The instructor will give the student feedback on his/her topic selections regarding which may be the most “researchable and ethical topic”, based on assignment requirements, and may recommend the student focus on one for subsequent assignments.  The proposal will not be completed as an experimental study, but rather as a proposal of a study that could be conducted in the future.

Topic Selection: Final Topic Selection: After receiving feedback from the Topic Selection: Find a Gap Assignment, the student will then resubmit the Topic Selection: Final Topic Selection Assignment, choosing one topic selection based upon the professor's feedback, highlighting measurable variables for the Research Proposal Paper Assignment.  

Stimulus Question Assignments (2)

The student will write answers to the stimulus questions for Chapter 2 and Chapter 6 (Stimulus Questions: Research Training-Joys and Challenges (Ch. Two) Assignment and Stimulus Questions: Choosing Research Designs-Balancing Ideals and Realities (Ch. Six) Assignment) located at the end of the chapters in Heppner et al. Answers to the Stimulus Questions will assist the student in the development of the Research Proposal Paper. 

Annotated Bibliography Assignment

The student will use his/her chosen topic to create an Annotated Bibliography Assignment in current APA format that includes at least 5 scholarly sources that support the development of his/her research questions. At least 2 of the sources must have been published within the last 5 years, and all articles must not be older than 10 years. The Annotated Bibliography Assignment will include a critique of the article, a brief description of the source, evaluation of the source, a discussion of the source’s relevance to the research topic, and answers to key questions provided in the instructions document.

Program Evaluation Project Assignment

The student will choose from the provided list of websites for treatment programs related to clinical mental health counseling, addictions counseling, marriage and family therapy, or school counseling. The student will then produce a logic model, state evaluation questions, and develop a basic plan for program evaluation. A template will be provided to aid in the structuring of this assignment.

Research Proposal Paper Assignment

For the Research Proposal Paper Assignment, the student will identify a research topic relevant to counseling and develop a research proposal. The student will conduct a literature review, develop appropriate research hypotheses/questions, develop a methods section to detail population/sampling, instrumentation, procedures, and analysis. Finally, the student will conclude the proposal with the implications that this study could have upon the counseling field and integrate a biblical perspective in light of these implications.

Writing Results and Discussion Assignment

The student will analyze data from a case scenario (not related to his or her proposal) and write up a results and discussion section corresponding to that data set. The student will interpret the study’s design, discuss hypotheses, statistical testing, and implications for the counseling field. The results will be written in no more than 1 page.

Video Discussion: Present Your Research

For the Video Discussion: Present Your Research, the student will create and upload a 3–5 minute video, presenting his/her Research Proposal Paper Assignment. A part of conducting research is to present findings at professional conferences/workshops and the student will practice presenting his/her proposals. Each video must demonstrate course-related knowledge and assertions, and must be supported by at least two outside scholarly sources. The student will reply in a 2–3 minute video to at least 2 of his/her peers discussing the implications to the counseling field and highlighting Christian integration with the topic. Replies must be supported by at least one scholarly source.

Quizzes (3)

The student will complete 3 quizzes:

  • Quiz: Research Process and Descriptive Methods will cover the course material and textbook readings in Modules 1–2.
  • Quiz: Process, Methods, and Inferential Statistics will cover the course material and textbook readings in Modules 1–4.
  • Quiz: Methods, Program Evaluation, and Designs will cover the course material and textbook readings in Modules 1–6.

The first two quizzes will be open-book/open-notes and will contain a combination of 25 multiple-choice or true/false questions. The last quiz will be open-book/open-notes, contain a combination of 22 multiple-choice, true/false, and short-answer questions.  All three quizzes have a time limit of 1 hour and 15 minutes.