Consultant: Process Tracing and Impact Assessment at International Water Management Institute (IWMI)

Tasks

Engagement with Initiative and WP teams

• Familiarize yourself with the Initiative’s proposal, teams, and countries where the initiative is present
• Engage with country and work package teams to gain an overview of their activities (completed, ongoing, planned), their perspectives, insights, the main stakeholders for each setting, and the domains (e.g., value chains) that the innovation bundles will likely concern.
• Co-facilitate the series of MELIA&SPA workshops on innovation bundle profiling, process tracing, and causal impact assessment
• Co-lead capturing the profile of shortlisted innovation bundles
• Collaborate with the MELIA&SPA team along the implementation of process tracing and impact assessment:
• regularly (bi-monthly) feedback observations to course correct or raise important additional process and causal impact questions to be answered jointly with the work package- and or country teams.

Process tracing assessment

• Planning, co-design and preparing for the process tracing assessment:
• Workplan to carry out the impact assessment process
• Lead the co-design the process tracing assessment with the WP teams and MELIA&SPA team
• Co-develop (with local teams and work package leads) clear counterfactuals to support the process tracing/causal impact assessment

Implementation of the process tracing assessment

• Develop the initial and evolving hypotheses regarding the expected or observed change processes as well as capture and explain the choices made on theory-building concerning intervening events, treating them whether as exogenous, complementary, or endogenous (for WP 1, 2, 3)
• Trace changes over time that influence the demand and support for, the context and efficacy of the bundles towards achieving the set goals (for WP 1, 2, 3)
• Identify uptake and average or potential impact of the piloted innovation bundles. Describe challenges, unexpected or undesirable impacts (for WP 1, 2, 3)
• Track the changes in policies (outcome 4) and policy advice at global level (for Ethiopia, Nigeria, Uganda, Bangladesh, Guatemala, Honduras, and Uzbekistan). Measure impacts on policy making process and on investment decisions by private sector stakeholders (For WP4)

Data collection

• Metadata and data collection tools developed
• Data collected gradually and updated

Impact assessment (WP and initiative)

• Planning and preparing for the impact assessment:
• Workplan to carry out the impact assessment process
• Impact assessment design:
• Identify outcome and impact indicators for the WPs and the Initiative
• Develop impact statements
• Identify the expected or observed change processes
• Data collection tools, filing system
• Carry out the impact assessment process
• Data collection tool and actual data collection
• Trace outputs, outcomes and impacts over time, resulting from the initiative's immediate activities.
• Together with the MELIA/SPA team include the measurement of impacts on women’s economic empowerment, referring to the outputs, outcomes, and impacts in terms of (but not limited to):
• Number of beneficiaries (smallholder farms, agrifood SMEs) – disaggregated by gender
• Number of information products, policy briefs, guidelines, dialogues
• Number of policies and strategies
• Number of research syntheses and guidelines
• Number of innovations
• Data analysis and report writing
• Capture achievements and progress made, but also areas of concern or missed opportunities.
• Capture the maturity of the bundle (environment) to further evolve and exist without the initiative's active engagement. Describe the processes that led to the new current situation: who or what was instrumental to success, who and what was limiting progress, or gave new insights requiring adjustments to the initial bundle and the scaling pathway?
• Capture significant contributions of WPs and initiative to endline report: focus on tracing changes related to the initiative and the bundles.

Key deliverables

• Process tracing assessment designed and carried out for 10 innovation bundles and interventions
• Dataset of process tracing assessment for 10 innovation bundles and interventions
• Semi-annual process tracing assessment reports
• Impact assessment: 1) impact indicator matrix and 2) Impact assessment report for the initiative

Requirements

• An excellent track record of leading impact assessment as well as process tracing roles for international organizations as part of international research or development cooperation.
• A minimum of 7-10 years of experience in participatory and theory-based methods for monitoring, evaluation, and learning including Outcome Mapping, Qualitative Comparative Analysis, Contribution Analysis, Realist Evaluation, Most Significant Change, Process Tracing, and Contribution Tracing.
• Experienced in internal reviews and meta-analyses, external project evaluations, leading multi-stakeholder workshops and field visits as well as in developing, consolidating, communicating, and successfully applying tailored MEAL tools.
• Must have created and implemented systems and processes for knowledge management and learning.
• MEAL experience in at least one of the indicated countries: Bangladesh, Ethiopia, Nigeria, Uganda, Honduras, Guatemala, or Uzbekistan.
• Fluency in English is a must, other languages of the countries indicated are a plus.