Systematic Reviews, Step-by-Step: Part 3
So far, we’ve looked at the differences and similarities between Systematic Reviews & Literature Reviews, and we’ve also examined alternatives to systematic reviews, i.e., Rapid, Scoping, & Umbrella Reviews. Now, it’s time to think about the steps involved in a systematic review.
This infographic shows the step-by-step process for conducting systematic reviews in education research. A systematic review is a comprehensive research method that finds and analyzes all high-quality studies on a specific educational question. Unlike regular literature reviews, systematic reviews follow strict protocols to minimize bias and provide the most reliable evidence possible. This approach has become essential in education because it helps researchers and policymakers make decisions based on the strongest available evidence rather than just a few selected studies.
Step 1 & 2 Planning & Searching
The process begins with careful planning where researchers develop a focused research question and create a detailed protocol before starting. The search phase involves systematically searching education databases like ERIC and PsycINFO, as well as checking conference papers, dissertations, and reports that might not be in traditional journals.
Step 3 Screening
Education researchers often need to cast a wide net because relevant studies can be scattered across different fields like psychology, sociology, and subject-specific education journals. The screening phase requires at least two reviewers to independently evaluate each study against predetermined criteria, ensuring that only relevant, high-quality research is included.
Step 4 Data Extraction
The data extraction and analysis phases present unique challenges in education research. Unlike medical studies that often measure similar outcomes, education studies vary widely in their methods, settings, and how they measure success. Researchers must carefully extract not just the results, but also important context like student populations, school settings, and how interventions were implemented.
Step 5 Analysis & Reporting
The final step involves synthesizing findings and writing a comprehensive report following PRISMA guidelines. While some education systematic reviews can combine results statistically, many rely on narrative synthesis to identify patterns and themes across diverse studies, ultimately providing educators and policymakers with clear, evidence-based recommendations.
Generative AI
In addition to exploring systematic reviews, I am also interested in generative AI. I was curious to see what Claude Sonnet 4 Pro Plan would do with the following prompt:
“Create an infographic on how to conduct a systematic review for a small academic research group who have never done one before?”
After studying the chart above, I have many more questions. For example, how long should a systematic review take? And, what exactly is “standardized extraction form”? However, I think I now have a road map of what’s involved. I know that I need a team and to make a plan to document my work so that others can replicate my review. Transparency is key.
Resources
Booth, A., Sutton, A., Clowes, M., & Martyn-St James, M. (2022). Systematic approaches to a successful literature review (3rd ed.). SAGE.
Higgins J., Thomas J., Chandler J., Cumpston M., Li T., Page M., & Welch V. (Eds). (2024, August). Cochrane handbook for systematic reviews of interventions (Version 6.5). https://www.cochrane.org/authors/handbooks-and-manuals/handbook/current
PRISMA. (2020). Welcome to the PRISMA website. https://www.prisma-statement.org/
The Campbell Collaboration. (2021). Campbell collaboration systematic reviews: Policies and guidelines. https://www.campbellcollaboration.org/wp-content/uploads/2024/11/Campbell-Policies-and-Guidelines-_May3-2022.docx.pdf