Workshop #1: Define the Problem and Assemble Evidence

Author

EPA Teaching Team

Welcome to the first workshop of the EPA Policy Analysis course. In this session, we will focus on defining your policy problem within the field of education policy and assembling the necessary evidence to support your analysis.

View all slides in new window Download PDF of all slides

Objectives

  • Conduct a situational analysis in education policy.
  • Frame a clear and concise policy question.
  • Effectively define the problem you aim to address.
  • Begin assembling evidence to support your problem statement.

Situational Analysis

A situational analysis helps you understand the context and environment in which your policy problem exists. In education policy, this involves examining various factors that influence educational outcomes.

Steps for Situational Analysis

  1. Identify the Context

    • Determine the specific area of education you are focusing on (e.g., K-12, higher education, special education).
    • Understand the geographical scope (local, state, national).

  2. Gather Data

    • Collect quantitative data: graduation rates, test scores, funding levels.
    • Collect qualitative data: stakeholder interviews, case studies.

  3. Analyze Policy Environment

    • Review existing policies, regulations, and legislation.
    • Identify recent reforms or initiatives.

  4. Stakeholder Analysis

    • Identify key stakeholders: students, parents, teachers, administrators, policymakers.
    • Understand their interests, influence, and relationships.

  5. Identify Challenges and Opportunities

    • Highlight gaps in policy implementation.
    • Note any emerging trends or issues.

Framing Your Policy Question

A well-framed policy question guides your analysis and sets the direction for your research.

Characteristics of a Good Policy Question

  • Specific: Clearly defines the issue without being too narrow.
  • Researchable: Can be answered through analysis and evidence.
  • Relevant: Addresses a significant problem affecting stakeholders.
  • Neutral: Avoids bias and does not assume a solution.

Example Policy Questions

  • “How can state education agencies improve access to quality STEM education in underfunded schools?”
  • “What policies can reduce the achievement gap between urban and rural students in standardized testing?”
  • “In what ways can teacher retention rates be increased in low-income districts?”

Defining the Problem

Defining the problem is a critical step that sets the foundation for your policy analysis.

Guidelines for Problem Definition

  1. Be Clear and Concise

    • Articulate the problem in a straightforward manner.
    • Keep the statement focused on a single issue.

  2. Use Evidence

    • Support your problem definition with data and research.
    • Cite credible sources to substantiate the problem’s significance.

  3. Focus on the Root Cause

    • Distinguish between symptoms and underlying causes.
    • Aim to address the root of the problem, not just its manifestations.

  4. Consider the Impact

    • Explain who is affected and how.
    • Discuss the short-term and long-term consequences.

Problem Definition Template

  • Problem Statement: [Subject] is experiencing [problem], resulting in [consequences], due to [root cause].

Example Problem Definition

  • “Low-income high school students in urban areas are experiencing high dropout rates, resulting in reduced employment opportunities and perpetuating cycles of poverty, due to insufficient access to supportive educational resources and interventions.”

Assembling Evidence

Collecting robust evidence is essential to support your problem statement and future policy recommendations.

Types of Evidence to Collect

  • Statistical Data

    • Enrollment and dropout rates.
    • Test scores and academic performance metrics.

  • Research Studies

    • Academic articles analyzing similar problems.
    • Meta-analyses and literature reviews.

  • Policy Documents

    • Existing laws, regulations, and policy briefs.
    • Government reports and white papers.

  • Stakeholder Perspectives

    • Interviews or surveys with affected populations.
    • Testimonies from educators and administrators.

Reliable Sources

  • Government Agencies

    • U.S. Department of Education
    • National Center for Education Statistics (NCES)

  • International Organizations

    • Organisation for Economic Co-operation and Development (OECD)
    • United Nations Educational, Scientific and Cultural Organization (UNESCO)

  • Academic Journals

    • Educational Evaluation and Policy Analysis
    • Journal of Education Policy

  • Think Tanks and Research Institutes

    • Brookings Institution
    • RAND Corporation
    • Education Policy Institute

Organizing Your Evidence

  • Create an Evidence Matrix

    • Organize evidence by source, type, and relevance.
    • Note the key findings and how they support your problem statement.

  • Evaluate Source Credibility

    • Assess the reliability and validity of your sources.
    • Prioritize peer-reviewed and official publications.

Action Items

By the end of this workshop, you should:

  • Draft a Clear Problem Statement

    • Use the guidelines provided to write your initial problem statement.

  • Begin Your Situational Analysis

    • Collect preliminary data and identify key stakeholders.

  • Compile Initial Evidence

    • Gather at least 3-5 credible sources that support your problem definition.

Upcoming Deliverable

  • Draft #1 Due on Sept. 18

    • Assignment: Sector Analysis & Problem Definition

    • Requirements:

      • A concise problem statement.
      • A situational analysis summarizing the context.
      • A preliminary list of evidence.

Tips for Success

  • Start Early

    • Give yourself ample time to research and refine your problem statement.

  • Seek Feedback

    • Discuss your ideas with peers or instructors to gain new perspectives.

  • Be Open to Revisions

    • Your problem definition may evolve as you gather more evidence.

  • Maintain Academic Integrity

    • Cite all sources appropriately to avoid plagiarism.

Additional Resources

  • Policy Analysis Guides

    • Bardach, E., & Patashnik, E. M. (2019). A Practical Guide for Policy Analysis: The Eightfold Path to More Effective Problem Solving. CQ Press.

  • Education Policy Organizations