AI Summary
[DOCUMENT_TYPE: instructional_content]
**What This Document Is**
These are lecture notes from EVAL 6970: Research on Evaluation, offered at Western Michigan University. The notes center around the critical processes involved in conducting a meta-analysis – a powerful research technique used to synthesize findings from multiple studies. Specifically, the material focuses on the foundational steps of formulating a clear research problem, systematically coding relevant literature, and understanding the various research designs commonly encountered in evaluation studies.
**Why This Document Matters**
Students enrolled in advanced evaluation methodology courses, or those undertaking systematic reviews and meta-analyses, will find these notes particularly valuable. Researchers needing a refresher on the initial stages of meta-analysis, or those preparing to design and implement a meta-analytic study, will also benefit. These notes are most useful when you are beginning the planning phase of your research and need to establish a robust framework for your investigation. They provide a foundational understanding before diving into statistical analysis.
**Common Limitations or Challenges**
This resource focuses on the *preparation* for meta-analysis. It does not delve into the statistical methods used to analyze the data, nor does it provide detailed guidance on writing up the results of a meta-analysis. It also doesn’t offer a comprehensive review of all possible evaluation designs; rather, it focuses on considerations relevant to inclusion in a meta-analytic framework. The notes represent a specific instructor’s approach from a 2011 course and may not reflect the absolute latest advancements in the field.
**What This Document Provides**
* An overview of the importance of a well-defined research problem in meta-analysis.
* Discussion of key considerations when developing study eligibility criteria.
* Insight into the process of creating a coding protocol for extracting relevant information from studies.
* Exploration of the hierarchical nature of data in meta-analysis.
* Guidance on ensuring the reliability of the coding process.
* Examples of screening forms and coding categories.
* Considerations for structuring data for effective analysis.