PROVISION OF ESSENTIAL BASIC PRIMARY HEALTH CARE TO VULNERABLE CONFLICT-AFFECTED POPULATIONS PROJECT EXTERNAL EVALUATION

Third-Party Monitoring and Evaluation

Project to be assessed

Provision of Essential Basic Primary Health Care to Vulnerable Conflict- Affected Populations

Assessment Type

1. An integrated Third-Party Monitoring and Verification (TPM) Consultancy Services
2. Performance monitoring

Locations/District

Northwest Syria (NWS)

Aleppo Governorate: Afrin district: Afrin city, Jandairis town, and Jalma.

Idlib Governorate: Harim district, Dana sub-district, Sarmada town.

Expected Start Date: July, 2024 (1-3 months for review of SOW)

Purpose: The evaluation’s aim is to determine the extent of success achieved by the intervention funded by BHA in realizing the intended outcomes and objectives set out in the program proposal. Additionally, the evaluation seeks to explore potential future program strategies that could offer lasting support.

More specifically, this final evaluation seeks to:

• Measure the extent to which proposed activities adhered to planned implementation and achieved intended goals, purposes and outcomes.
• Support the organization’s commitment to accountability to donors, government, public, and beneficiaries through assessing good practices, gaps and incorporating learnings into future programs.
• Assessing the accessibility of pharmaceuticals at humanitarian landscape level in the target locations based on inputs from DotW and relevant clusters and/or working groups, humanitarian actors in the area.
• Assess the efficiency, the effectiveness ,relevance and coherence of the project using the OECD/DAC criteria.
• Identify lessons learned and provide practical, innovative, and sustainable program options for further assisting the health system support and increasing the service delivery.
• Examining the project’s integration with non-medical actors, focusing on necessary toolsets, organizational structure, and working relations.

Results of the evaluation will inform changes in DoTW Program strategy 2025-2027 for health sector and will inform adaptation of the program for the upcoming funding cycle.

Evaluation Design and Methodology

This final performance evaluation aims to produce evidence based on both qualitative and quantitative data, with a primary focus on qualitative techniques and the use of quantitative methods as needed. It seeks to engage internal and external stakeholders of Doctors of the World (DoTW) to address key evaluation questions. The evaluation team is requested to propose a methodological approach, however, the evaluation should minimally include desk research, semi-structured interviews, an inception report, a draft and final evaluation report, and a PowerPoint presentation of key findings. While the evaluation team will independently design data collection methods, DoTW will ensure comprehensive data provision. All materials for the desk phase will be provided by the MEAL department.

Mixed-methods performance evaluations will systematically integrate both types of data, including:

• A comparison of baseline and endline quantitative data, that will be provided through the systematic data collected by DoTW as per the MEL plan
• A qualitative study designed to explore issues identified in the quantitative results and address evaluation questions beyond the scope of quantitative methods (e.g., sustainability, management, etc.).

The principles, methods, and design of the evaluation will ensure impartiality, independence, usefulness, and credibility. In line with the assignment’s proposed objectives, timeframe, and intended outcomes, the evaluation will be structured as a Final Performance Evaluation, adhering to BHA Guidelines. Where possible, the evaluation should also incorporate other sources of data, including the activity’s performance monitoring data.

Key aspects include:

• The evaluation will focus on assessing the immediate effects and outcomes of the project towards its end point, providing a timely analysis of its progress.
• It will determine the extent to which the project is on track to achieve its intended results, identifying signs of success and areas needing improvement.
• The evaluation will offer valuable insights for better management of program implementation and its immediate impact on the target population or area, and its relevance to the contextual factors. This final assessment is crucial for making timely adjustments for the upcoming program cycle implementation, its effectiveness and better alignment with the long-term goals.

Additional evaluation criteria will include:

• Validity of the theory of change for the strategy, project, or activity.
• Achievement of the expected results of the strategy, project, or activity.
• Implementation details of the strategy, project, or activity.

The evaluation team, in collaboration with DoTW, will finalize the evaluation methods before fieldwork begins. As a minimum the evaluator/Evaluation Team will have access to the following documentation:

• Project proposal, needs assessment, project documents, logical framework and/or theory of change and relevant monitoring reports (including Indicator Tracking Table and TPMs if relevant, DQA, SITreps).
• Relevant BHA and USAID Guidelines
• DoTW Accountability framework
• DoTW Türkiye Operational Principles
• Key informant list
• Relevant secondary data about NWS and humanitarian needs, situation reports, etc.

All data collected during this evaluation will be stored and managed according to BHA, DoTW, and GDPR guidelines. Interviewee responses will remain anonymous to ensure confidentiality and integrity. The dual data collection approach aims to provide a comprehensive understanding of the program’s impact, highlighting successes and identifying opportunities for improvement to inform program objectives.

Qualitative Methods:

The evaluation is expected to primarily rely on qualitative data collection methods and assignment should aim at minimum to initiate:

Semi-structured and in-depth interviews: These will be conducted with key stakeholders/ key İNFORMANTS, including DoTW staff, beneficiaries, and local partners, to gather detailed insights into the program’s implementation and outcomes.

Focus Group Discussions (FGDs): These will be organized with various groups of beneficiaries to explore their experiences and perspectives on the project. FGDs will help identify common themes and issues that might not surface in individual interviews.

Direct Observations: On-site visits will involve observing program activities and interactions in the field to gain a deeper understanding of the program’s context and effectiveness.
Key Informant List will be provided by MEAL Department in consultation with the Evaluator/ Evaluation Team