CALL FOR EXPRESSION OF INTEREST
ILO/ ROAS is searching for an evaluation consultant to undertake the midterm independent evaluation of the project: Improving living conditions and resilience of refugees displaced by the Syrian crisis and vulnerable hosting communities in Lebanon.
The activities should take approximately 36 working days, with work expected to be undertaken during the period January – April 2025 online (field mission may be foreseen depending on the circumstances in the country). The current call is asking for expressions of interest from interested individual consultants specialized in project evaluations.
Please see Background Information and draft TORs for further information. The draft TOR is still under revision and some changes can be expected before the contractual process.
Duration of the contract: January – April 2025.
Application deadline: December 19, 2024 (11pm Beirut time)
Desired profile of the evaluator:
- Master’s degree in social sciences, economics, development studies, evaluation or related fields.
- A minimum of 7 years’ experience in conducting projects and programme evaluations, with demonstrated experience in development related programmes.
- A minimum of 5 years’ experience in developing theories of change, log frames and M&E systems or an extensive experience conducting evaluability assessments/ reviews.
- Previous experience in evaluations for UN agencies is required.
- Evaluation experience with the ILO and the EU cooperation projects, is a strong asset.
- Relevant regional experience and familiarity with implementation of programmes and projects in the region.
- Experience in Lebanon is an asset.
- Full proficiency in English.
- Knowledge of the ILO and its normative mandate, tripartite structure and technical cooperation activities is a strong asset.
- Excellent communication, interview and report writing skills.
- Demonstrated ability to deliver quality results within strict deadlines.
- Facilitation skills and ability to manage diversity of views in different cultural contexts.
- Must have no previous involvement in the delivery of the project under evaluation.
Proposal submission
Interested candidates intending to submit an expression of interest must supply the following information:
1. A cover letter describing how the skills, qualifications and experience are relevant to the assignment.
2. The CV highlighting previous evaluations that are relevant to the context and subject matter of this assignment. Date of the evaluations and the managing organization should be clearly stated.
3. A financial proposal with daily rate expressed in US dollars.
4. Sample of similar work written by the applicant as the main author.
5. At least two professional references.
Please send your application with relevant attachments to alrifai@ilo.org by the 19th of December 2024 (11:00 PM Beirut time) with the subject heading: “ILO.ENABLE.YOURNAME”.
Project title
Improving living conditions and resilience of refugees displaced by the Syrian crisis and vulnerable hosting communities in Lebanon
DC Symbol LBN/22/01/EUR
Type of Evaluation Independent
Timing of Evaluation Midterm
Countries Lebanon
P&B outcomes:
Outcome 3 – Economic, social and environmental transitions for full, productive and freely chosen employment and decent work for all;
Outcome 4 – Sustainable enterprises as generators of employment and promoters of innovation and decent work;
Outcome 5 – Skills and lifelong learning to facilitate access to and transitions in the labour market;
Outcome 8 – Comprehensive and sustainable social protection for all;
SDG (s) SDG 8. Decent work and economic growth;
Start Date January 2023
End Date December 2025
Administrative unit RO-Arab States/DWT-Beirut
Technical Backstopping Unit DWT Beirut,
Collaborating ILO Units DEVINVEST; SKILLS; SOCPRO;
Donor European Commission, DG for Neighbourhood and Enlargement Negotiations, European Neighbourhood
Evaluation Manager Hiba Al Rifai
Project Budget €10,000,000
Project Background and Objectives
The project “Improving living conditions and resilience for refugees displaced by the Syrian crisis and vulnerable host communities in Lebanon” aims to adapt employment policies to support social protection strategies in order to facilitate integration of vulnerable workers in productive sectors, thus promoting decent employment opportunities in Lebanon. The design of the project is intricately woven into the fabric of Lebanon’s political, economic, and cultural landscape. Lebanon’s governance challenges, compounded by the ongoing Syrian crisis, have created a pressing need for external support to effectively manage the influx of refugees and address the strains on resources and services.
Lebanon faces significant hurdles exacerbated by financial crises and the impacts of the COVID-19 pandemic, leading to heightened vulnerabilities, particularly in terms of high unemployment rates and mismatches between available skills and market demands.
Since September 2024, the situation in Lebanon has escalated into a war with daily Israeli airstrikes and bombings across the country leading to more than 3000 deaths and displacing more than 1.5 million internally. The war has severely impacted civilians, healthcare workers, and aid personnel, disrupting basic services and destroying critical infrastructure. The World Health Organization reported attacks on health facilities and personnel, exacerbating an already dire humanitarian situation.
The ongoing escalation in the country has further exacerbated the economic crisis in Lebanon which in turn has led to high levels of internal displacement, inflation, sharp price increases, job loss and increasing vulnerabilities and protection risks for the most vulnerable sections of the population, in particular for those depending on Social Protection and the uncertainty of accessing essential services like education vocational training and employment/livelihood opportunities.
By navigating complex political, economic, and cultural dynamics, the project aims to enhance the immediate well-being of refugees and host communities as well as foster sustainable solutions and inclusive growth within Lebanon’s challenging environment.
With the financial support of the European Union (EU) and under the auspices of the Ministry of Social Affairs of Lebanon, the International Labour Organisation (ILO) launched the ENABLE project – Empowering Networks and Activation for Building Long-term Employment in January 2023. The project aims to adapt employment policies to support social protection strategies in order to facilitate integration of vulnerable workers in productive sectors, thus promoting decent employment opportunities in Lebanon.
The project, implemented in collaboration with Lebanese ministries, local authorities and the ILO’s Employment Intensive Infrastructure Programme (EIIP), targets vulnerable and unemployed youth, women, and persons with disabilities. By offering alternative employment opportunities, short-term job placements, and market-relevant skills training, ENABLE aims to enhance economic activation and promote economic inclusion in the country.
The project strategy and action plan emphasize decent work and social protection through employment activation, aligning with national documents, the SDGs (1,8,16), and the UNSDCF. This initiative fosters social and economic inclusion by facilitating employment activation and economic integration for Social Protection Beneficiaries. It strengthens the connection between active labour market programs and social protection measures, assisting individuals under social protection to enter or remain in the labour market.
Improving employment activation is crucial for enhancing economic security and resilience. Through integrated employment services and short-term job opportunities, the project aims to reduce reliance on social assistance among the most economically disadvantaged, thereby fostering social cohesion. Program activities are underway in Beirut, Mount Lebanon, North/Akkar, and South/Nabatieh governorates, spanning from January 2023 to December 2025. Due to the recent escalations in the country, the work in some areas has been put on hold.
Evaluation Background
ILO considers evaluation as an integral part of the implementation of development cooperation activities.
Provision is made in the project in accordance with ILO evaluation policy and based on the nature of the project and the specific requirements agreed upon at the time of the project design and during the project as per established procedures. Considering its timeline, its budget and as per the evaluation policy, an independent midterm evaluation is due for the ENABLE project. Furthermore, considering its scope and budget, the ILO evaluation policy mandates the project to undergo an evaluability assessment (EA) to assess its monitoring and evaluation system. Accordingly, this will be an assignment (hereafter referred to as ‘the evaluation’) to conduct an independent midterm evaluation while also assessing the evaluability of the project.
Objectives
The evaluation aims at assessing the overall performance of the project so far while reviewing its evaluability. It serves accountability purposes but also has a very high utility orientation. It will highlight challenges and good practices. The midterm evaluation is expected to formulate lessons learned and practical recommendations to improve the evaluability and the implementation during the remaining period of the project.
This evaluation will provide a comprehensive independent assessment of the project through the six OECD-DAC criteria: Relevance, coherence, effectiveness, efficiency, sustainability, and potential impact of the project.
The evaluation will comply with ILO evaluation policy[1], and the UNEG ethical guidelines[2] will be followed.
Scope of the Evaluation
The evaluation will assess the project’s overall performance in line with its planned outcomes and outputs taking into consideration the context and country situation. It will cover all aspects of the project’s implementation highlighting the main challenges and good practices. The evaluation will assess the existing Theory of Change (TOC) and M&E framework of the project, use the available EVAL tool on evaluability, and provide concrete recommendations for the way forward. The timeframe to be considered will be from January 2023 to November 2024. The geographical coverage will align with that of the project in each of the areas in Lebanon. Considering the current situation in the country, the evaluation will be fully online. The evaluation will integrate ILO’s cross-cutting issues, including norms and social dialogue, gender equality, disability inclusion, and other non-discrimination concerns throughout its methodology and all deliverables.
Clients of the Evaluation
The primary clients of this evaluation are the relevant constituents, the Governments, the Employers and Workers’ Organizations, in Lebanon, the ILO Regional Office for Arab States (ROAS) and the relevant technical units in ILO Headquarters, and the donor, represented by the European Commission in Brussels and its delegations in Lebanon. Secondary users include other project stakeholders and units within the ILO that may indirectly benefit from the knowledge generated by the evaluation. U
A participatory approach involving key stakeholders through online consultations will be ensured to the extent possible.
Evaluation Criteria and Questions
The evaluation utilizes the standard ILO evaluation framework and follows the OECD/DAC evaluation criteria with emphasis on integrating gender. The evaluator is expected to mainstream the analysis of opportunities, gaps, and next steps in addressing all questions.
Relevance:
- To what extent is the project design still relevant to the national priorities, constituents’ needs and the needs of people who are benefiting from the project (Lebanese and Syrian refugees)? Did the design pay special attention to gender considerations?
- How relevant is the project design to the donor’s priorities in the region, the ILO’s P&B (2022-23 and 2024-25), the Lebanon UNSDCF, and the SDGs?
- Using EVAL’s guidance and tool, what is the overall assessment of the project’s TOC and M&E system? Any updates are need considering the current war in the country?
Coherence
- To what extent is the project coherent with other interventions of the ILO and the EU in Lebanon and in the region? To address this question, the evaluator is expected to identify other active similar interventions from desk review and identify synergies and coherence opportunities and gaps.
Effectiveness
- Is the project on track to achieve its stated results across its logical framework? How likely is the project to contribute to the ILO’s Implementation Report on the Programme & Budget (2024-25)?
- What are the major factors influencing the achievement or non-achievement of the results? Are there any identifiable positive or negative unintended results?
- How is the project’s implementation contributing to ILO’s cross-cutting issues: gender equality and disability inclusion, social dialogue, and labour standards?
Efficiency
- Are the available technical and financial resources adequate to fulfil the project plans? Are they allocated strategically to provide the necessary support to achieve the broader project objectives?
- How efficient is the communication among the project team, the regional office and the responsible technical departments at ILO headquarters? How efficient are the coordination efforts and dialogue with main stakeholders?
- How efficiently are resources allocated and utilized in the project to ensure equitable access and benefits for both women and men?
Impact orientation
- Is the project likely to achieve its stated long-term objectives?
- How likely is the project to impact the lives of women and people with disability?
Sustainability
- Does the project have an exit strategy to ensure the sustainability of its efforts? What measures have been considered to ensure that the key components of the project are sustainable beyond the life of the project?
- Has the project considered gender in planning its sustainable measures?
Methodology
The evaluation will be carried out by an external independent Evaluator. The evaluation will follow a mixed methods approach using both available and primary quantitative and qualitative data. Triangulation is expected to ensure the reliability and validity of findings. Gender will be mainstreamed throughout the evaluation process. The evaluator should strive to ensure a balanced number of female and male participants in the evaluation process.
Any changes to the methodology should be discussed with and approved by the Evaluation Manager. The EA part of the assignment should be covered using EVAL’s guidance notes and the specific tools should be duly filled. The evaluator is expected to follow the below approach:
Initial consultations:
The evaluator will have initial consultations with the Evaluation Manager, the relevant ILO staff managing the project, the EU, and some key stakeholders. The objective of the consultations is to reach a common understanding regarding the status of the project, the priority questions, available data sources and data collection instruments and an outline of the final evaluation report.
Document review and analysis
The evaluator is expected to review and analyze the available documents and ask for the necessary one to address the evaluation questions. These include but not limited to project documents or concept notes with logical framework, work plans, progress and technical reports, financial reports, any materials/ studies/ events proceedings prepared or undertaken within the framework of the project. High level strategic documents for the ILO, the EU, and the country.
Individual Interviews
Following the desk review and after the initial consultations as well as the approval of the inception report, the evaluator will hold virtual meetings (if the security situation changes some in-person interviews can be scheduled) with the identified key stakeholders including the ILO staff, the EU, the constituents and other stakeholders. Individual or group interviews will be conducted based on the provided list of stakeholders.
Focus Group Discussions (FGDs) or Surveys
Based on the desk review and the lists of people benefiting from the project, the evaluator is expected to think of creative online ways to consult with the end beneficiaries. This can be by organizing online FGDs or developing surveys that can be done by phone or online with the different groups of people who are benefiting from the project. The FGDs should consider gender, nationality, geographical coverage, disability status, age group, n and the thematic area. The evaluator is expected to lead on all logistics related to the FGDs and/or surveys; the project teams can play a facilitation role (on logistics) only.
Presentation of findings
The evaluator is expected to present the evaluation findings and validate the interpretations. Details on the timing and scope of the presentation will be decided with the EM throughout the process.
Evaluation Timeframe
The evaluation is to commence in January and end in April 2025. The following table describes the tentative number of days:
Tasks/Number of Working days:
Inception phase: inception consultations, desk review, drafting and submitting an inception report
8
Revise and resubmit inception report
2
Data collection
10
Drafting and submission of the evaluation report
10
Revising the draft final report
3
Integration of all comments and finalization of the report
2
Presentation
1
Total 36
Total estimated payable working days: 36 Days
Deliverables
The main outputs of the evaluation consist of the following (all in English):
- Deliverable 1: Inception Report along its comments log
- Deliverable 2: Draft evaluation report (including EA tools)
- Deliverable 3: Draft 2 of the evaluation report along its comments log
- Deliverable 4: PowerPoint Presentation
- Deliverable 5: Final evaluation report with separate template for executive summary and templates for lessons learned and good practices duly filled in (as per ILO’s standard procedure, the report will be considered final after EVAL’s approval)
Payment Terms
- 10 per cent of the total fee against deliverable 1 above approved by the evaluation manager.
- 30 per cent of the total fee against deliverable 2 above.
- 60 per cent of the total fee against deliverables 3, 4 and 5 above, approved by the ILO Regional Evaluation Officer and EVAL.
Management Arrangement
The evaluator will report to the ILO’s evaluation manager and should discuss any technical and methodological matters with her. The project team will provide administrative and logistical support during the data collection. The Evaluation Office will approve and sign off the final evaluation report.
The evaluator is responsible for conducting the evaluation according to the terms of reference (ToR):
- Review the ToR and propose any refinements to evaluation questions and methodology during the inception phase.
- Review project background materials (e.g., project document and progress reports).
- Prepare an inception report.
- Develop and implement the evaluation methodology (i.e., conduct interviews, review documents) to answer the evaluation questions.
- Lead on all logistics and coordination for the data collection
- Conduct preparatory consultations with the evaluation manager prior to the evaluation mission.
- Conduct key informant interviews and collect information.
- Conduct focus group discussions
- Analyse findings from key informant interviews and focus group discussions
- Prepare an initial draft of the evaluation report with input from ILO and external stakeholders.
- Prepare and conduct a presentation on the evaluation findings.
- Prepare the final report based on all feedback received.
- Comply with EVAL’s guidance notes and checklists.
The ILO Evaluation Manager is responsible for:
- Drafting the ToR.
- Finalizing the ToR with input from ILO colleagues and other stakeholders.
- Hiring the evaluator.
- Managing the communication with the evaluator.
- Reviewing the inception report and the initial draft final report, circulating them for comments and providing consolidated feedback to the evaluator on the inception report and the final report.
- Reviewing the final report.
- Coordinating with the Regional Evaluation Officer for the Evaluation Office’s clearance of the final report
- Disseminating the final report to stakeholders
- Coordinating follow-up as necessary.
The ILO Regional Evaluation Officer[1]:
- Provides support to the planning of the evaluation;
- Approves selection of the evaluation consultant and final versions of the TOR;
- Reviews the draft and final evaluation report and submits it to the ILO Evaluation Office;
- Disseminates the report as appropriate.
The Project team is responsible for:
- Reviewing the draft TOR and providing input
- Providing project background materials, including studies, analytical papers, reports, tools, publications produced, and any relevant background notes
- Providing a proposed list of stakeholders
- Participating in the preparatory briefing prior to the assessment missions
- Support in logistical arrangements for the missions
- Reviewing and providing comments on the initial draft report
- Participating in the debriefing on the findings, conclusions, and recommendations
Legal and Ethical Matters
- This evaluation will comply with ILO evaluation guidelines and UN Norms and Standards.
- The ToRs is accompanied by the code of conduct for carrying out the evaluation “Code of conduct for evaluation in the ILO”[2]. The selected consultant will sign the Code of Conduct form along with the contract.
- UNEG ethical guidelines will be followed throughout the evaluation.
- The consultant will not have any links to project management or any other conflict of interest that would interfere with the independence of the evaluation.
How to apply
Proposal submission
Interested candidates intending to submit an expression of interest must supply the following information:
1. A cover letter describing how the skills, qualifications and experience are relevant to the assignment.
2. The CV highlighting previous evaluations that are relevant to the context and subject matter of this assignment. Date of the evaluations and the managing organization should be clearly stated.
3. A financial proposal with daily rate expressed in US dollars.
4. Sample of similar work written by the applicant as the main author.
5. At least two professional references.
Please send your application with relevant attachments to alrifai@ilo.org by the 19th of December 2024 (11:00 PM Beirut time) with the subject heading: “ILO.ENABLE.YOURNAME”.