Final External Evaluation Consultant

TERMS OF REFERENCE

Final External Evaluation of the SUSTOUR Laos Project

March 2024

Plan is seeking a company or consultant(s) to design and implement a final external evaluation (FEE) that will assess the impact and results of the “Promoting Sustainable Tourism by Integrating MSMEs into Sustainable Supply Chains and Raising Consumer Awareness” project (SUSTOUR Laos project). The main purpose of this evaluation is to collect data for the project indicators (see log-frame in Annex 1) to assess the results towards the projects’ objectives and impact on target groups and final beneficiaries.

1.Introduction

Working in over 50 developing countries globally, Plan International strives for a just world that advances children’s rights and equality for girls. Plan International has been working in Laos since 2007, and is delivering programs in 10 provinces in Laos, including Bokeo, Oudomxay, Luang Prabang, Vientiane and Salavan Provinces. We support children and youth to access their rights through our Public Health, Education, Livelihoods, Adolescent and Youth Economic Empowerment programmes. In all contexts, together with partners, we strive for lasting impact in norms, attitudes and behaviors, social and economic safety nets, and policy frameworks. Our work includes community-based action, partner strengthening, and policy advocacy, all focused on gender transformative programming. Visit www.plan-international.org for more information.

In cooperation with project partners, the Ministry of Industry and Commerce (MoIC), the Lao National Chamber of Commerce and Industry (LNCCI) and the European Centre for Ecological and Agricultural Tourism (ECEAT), Plan International Laos is currently implementing the SUSTOUR Laos project (2020-2024), funded by the European Union (EU). The project is co-funded and coordinated by Plan International Germany.

2. Background

The overall objective of the SUSTOUR Laos project is to contribute to the Laos National Green Growth Strategy, 9th Five-Year National Socio-Economic Development Plan, and the National Tourism Strategy as well as SDG goals 8 (decent work) and 12 (sustainable consumption and production (SCP)) by promoting SCP through sustainable supply chain development in the Laos tourism sector.

The SUSTOUR Laos project takes place in Lao PDR and supports, through an integrated business-led approach, micro, small and medium sized enterprises (MSMEs) in Vientiane Capital, Vientiane Province and Luang Prabang Province tourism sectors to adopt and promote SCP practices throughout their supply chains and business processes. This includes using local suppliers, purchasing environmentally friendly products, conserving natural resources, and applying socially responsible ways of interacting with local communities. Adoption of sustainable practices are certified and awarded by the Travelife program which has been developed by ECEAT in partnership with EU travel associations and is recognized internationally as the leading sustainability system in the tourism industry. The project has also developed the “Lasting Laos” supplier sustainability certification programme which is adapted from Travelife for supplier MSMEs in key sectors of the tourism supply chain: transportation; food & beverage; cultural excursions; and handicraft sectors. The project triggers market demand for sustainable tourism by marketing Laos as a “green” destination and raising consumer awareness of sustainable MSMEs among tourists and international travel agents. With LNCCI and MoIC as the local partners, the project promotes an enabling policy environment and dialogue through sustainable local structures supporting SCP practices in the tourism industry. The project began in August 2020 and will be completed in July 2024 with the following expected outcomes:

Outcome 1: The Lao tourism supply chain is more sustainable having adopted and replicated Travelife certified SCP practices among tourism MSMEs by developing greener products for local supplier MSMEs, as well as sustainable settings for host communities.

Outcome 2: The economic and environmental value of sustainable tourism in Laos is promoted and consumer awareness is raised thus creating competitive advantages and incentives for Lao tourism MSMEs applying SCP practices.

Outcome 3: SCP in the tourism sector is advocated by leveraging existing institutions and structures in Laos as well as relevant regional networks and outbound tour operators.

Finally, due to the significant impact that the coronavirus pandemic (COVID-19) had on the tourism industry, this study will also incorporate aspects of a COVID-19 response plan and contract modification which have been developed and implemented over the course of the project. This plan and contract modification comprised a comprehensive response strategy intended to address the impact of COVID-19 on the project and its beneficiaries.

3. Objectives of the Evaluation

The main objective of the FEE is to gain a meaningful understanding of the project results and impact on project beneficiaries, target groups and stakeholders (e.g., government actors, private sector associations, tourism MSMEs, supplier MSMEs and local communities). The company or consultant(s) will analyze and measure the final results of the indicators identified in the project results framework at the overall objective, outcome and output levels. This includes verification of the sampling and data collection methodologies that the project has used throughout its implementation. The company or consultant(s) will be required to conduct all data collection (both qualitative and quantitative). As per the Plan International MERL Policy, and OECD evaluation standards, specific focus areas of the EOPE will include: (1) Relevance; (2) Coherence; (3) Effectiveness; (4) Efficiency; (5) Impact; and (6) Sustainability.

The evaluation will, in addition to collecting data to measure the indicators and evaluation against OECD evaluation standards, should seek to answer the following key research questions:

1. What is the current state of the sustainability of the Lao tourism supply chain, particularly as it relates to SCP?
2. What is the perception, understanding and current practices of key stakeholders and beneficiaries (i.e., tourism MSMEs, supplier MSMEs, local communities, business/tourism associations, government organizations) as related to SCP, sustainable supply chains and sustainable tourism (including the Travelife and Lasting Laos certifications)?
3. What is the perception and level of awareness/interest that consumers (i.e., Free-and-Independent Travelers (FIT), international travel agents) have of tourism MSMEs and their suppliers, as related to SCP and sustainable tourism (including the Travelife and Lasting Laos certifications)?
4. What are the key enabling factors which promote greater sustainability within the Lao tourism supply chain? What are the key disabling factors which hinder it?
5. How are key cross-cutting themes of gender equality and child rights/protection understood and practiced throughout the Lao tourism sector?
6. What has been the impact of the COVID-19 pandemic on the tourism sector and the Lao tourism supply chain and MSMEs in particular? What is the forecast for the full recovery of the sector (to pre-pandemic levels)?

4. Scope of the Evaluation

The FEE will assess the above-mentioned objectives in the 3 target areas and 11 districts: Vientiane Capital (Chanthabury, Sissatanak, Sikhottabong, Hadxaiyfong and Saysettha Districts) Vientiane Province (Vang Vieng, Keo Oudom, and Phonhong Districts) and Luang Prabang Province (Luang Prabang, Chompet and Pak Ou Districts). The FEE will also assess international tourism to Laos, focusing on international travel agents and FITs. The company or consultant(s) will work closely and be in regular communication with Plan Laos, Plan Germany and project partners (LNCCI, ECEAT) throughout the duration of the evaluation. The company or consultant(s) is responsible to oversee data the collection (e.g., surveys, interviews, etc.), including providing enumerator training for local project staff (from Plan Laos) and supervising the data collection process. The project team will provide feedback on the design, data collection tools, analysis and draft reports provided by the consultant.

The key tasks that the company or consultant(s) will be responsible for include:

• Work closely with the project team and partners (Plan Laos, Plan Germany, ECEAT, and LNCCI);
• Literature/document review of relevant project documents (project document, log-frame, M&E framework, baseline study, value chain study, COVID-19 response plan, Results Oriented Monitoring (ROM) review, etc.) and other relevant research/publications;
• Develop and verify the evaluation methodology, including the data collection methods, tools and sampling;
• Test the data collection methods and tools;
• Design interview questionnaires and surveys for key target groups/beneficiaries: (1) Lao tourism businesses (i.e., tourism MSMEs, supplier MSMEs); (2) tourists (international and domestic): (3) international travel agencies; and (4) local communities;
• Outline the FEE design in a succinct inception report, including but not limited to: instructions for data collection, enumerator training, data entry, data cleansing, data processing, data quality assurance and data analysis; Obtain ethical approval for the project surveys with the relevant Lao government department (with the support of project partners);
• Train enumerators (national staff from Plan Laos) on all data collection tools and processes;
• Supervise the data collection, including travel to and within the 3 project target areas;
• Review and analyze data, including statistical analysis of survey results;
• Consolidate, clean and deliver all FEE data in a specific format (e.g. Excel, SPSS);
• Draft the FEE report, including analysis of the project results and impact on beneficiaries, target groups and stakeholders;
• Facilitate workshops to present the data collection methods and the key findings of the FEE to the project team and partners;
• Finalize the FEE report based on feedback from project partners;
• Translate the final report from English to Lao language (the Laos version must also be approved by the project).

5.Methodology

The company or consultant(s) will develop a detailed methodology for data collection, data management and analysis in their proposal. This methodology should be in direct response to the project indicators and research questions. This methodology will be described in greater detail in the inception report which is to be provided by the company or consultant(s) once the FEE is underway. Any method proposed must be in-line with Plan’s MERL Standards, namely that it is ethical and considers the needs and wellbeing of any respondents involved. The methodology proposed by the consultant should build upon the methods summarized below.

Quantitative Methods

Surveys, including (but not limited to):

1. A survey of local communities involved in tourism in two target areas (Luang Prabang and Vientiane Province) which will consist of a sample of 1 district in each Province (2 districts total), 3 villages per district and 20 households per village (120 households in total);
2. A survey of 75 Lao tourism businesses, including tourism MSMEs (e.g., tour operators, travel agents, hotels) supplier MSMEs (e.g., transportation companies, restaurants/cafes, handicraft/souvenir businesses, culture/art/entertainment businesses) in all target areas;
3. A survey of 20 international travel agents which should include a wide sample of key regional, European and international source markets for Laos (e.g. Thailand, Vietnam, South Korea, China, France, Germany, Italy, UK, USA, Australia, etc.);
4. A survey of tourists (i.e., FITs), both domestic and international, consisting of a sample of 1000 domestic tourists (via an online survey) and 200 international tourists (via in-person surveys at tourist hubs such as train stations, airports, etc.).

Desktop Research, including (but not limited to):

1. Relevant government publications (e.g. Statistical Report on Tourism, Destination Management Plans, National Tourism Strategy, 9th Five-Year National Socio-Economic Development Plan, etc.);
2. Other relevant publications/sources (e.g. Lao National Green Growth Strategy, global tourism strategies, publications related to COVID-19, sustainable tourism, etc.);
3. Travelife for Tour Operators, Travelife for Hotels and Lasting Laos websites and databases;
4. Tour catalogues/websites of international travel agents and Lao tourism MSMEs.

Qualitative Methods

Interviews with stakeholders and beneficiaries, including (but not limited to):

1. Relevant Lao government ministries and departments (e.g. Ministry and Departments of Industry and Commerce, Ministry and Departments of Information, Culture and Tourism);
2. Local partners and tourism associations (e.g. LNCCI and its provincial chambers, hotel and restaurant associations, travel agent associations, handicraft associations, etc.);
3. Tourism MSMEs (e.g. hotels, travel agents, tour operators);
4. Supplier MSMEs representing a variety of businesses from key sub-sectors (i.e., handicraft, cultural excursions, food & beverage, transportation);
5. Local community members and representatives.

Desktop Research, using similar sources listed in the quantitative section above but used for qualitative context*.*

6. Ethics and Child Protection

Plan International is committed to ensuring that the rights of those participating in data collection or analysis are respected and protected, in accordance with Framework for Ethical MERL, our Global Policy on Safeguarding Children and Young People and our Global Policy on Preventing Sexual Harassment, Exploitation and Abuse. All applicants should include details in their proposal on how they will ensure ethics and child protection in the data collection process. Specifically, the company or consultant(s) shall explain how appropriate, safe, non-discriminatory participation of all stakeholders will be ensured and how special attention will be paid to the needs of children and other vulnerable groups. They shall also explain how confidentiality and anonymity of participants will be guaranteed.

The data collection process must consider gender and disability inclusion, child protection, safeguarding and ethical standards in their data collection plans. This includes informed consent, length of surveys, questions and survey methods taking a ‘do no harm’ approach, capturing the voices of the most marginalized, not raising expectation during the survey, gender and inclusion considerations for interviewer/interviewee.

7.Deliverables

The key deliverables expected from the company or consultant(s) during the evaluation process are outlined below:

1. An inception report based on literature review, including (but not limited to):
   • The FEE methodology, tools, and data collection plan, including the design of all surveys (business surveys, tourist surveys and community survey) and interview questionnaires*;
   • Basic outline for the enumerator training;
   • Methods for data analysis;
   • Justification of the methods and techniques to be used (including relevant underlying values and assumptions/theories) with a justification of the selections made (e.g. interviewees);
   • Explanation of how gender and disability inclusion, child protection, safeguarding and ethical standards will be followed during the data collection;
   • Stakeholder and beneficiary mapping (input will be provided by the project);
2. Test the data collection tools and make any necessary changes;
3. Facilitate a half-day workshop with Plan, LNCCI and ECEAT to review and discuss the inception report, data collection methods, enumerator training, sampling, etc.;
4. Provide a 1-day training to enumerators on the data collection tools and processes;
5. Supervise enumerators during data collection process, including any surveys, interviews and focus group discussions (including travel to target areas);
6. Draft the FEE report (20 pages maximum) including (but not limited to):
   • Executive summary;
   • Updated results framework with final results of all indicators;
   • Analysis of FEE data, including charts, tables and graphs;
   • Analysis of results against evaluation methodology, including OECD evaluation criteria;
   • Completed consent forms (including for children and their caregivers and adults);
   • Cleaned data (including data files (e.g. Excel, SPSS), transcripts of qualitative data, syntax/ code books etc.);
   • Final sampling methodology (including unit of sampling and sampling frame) and size;
   • Final data collection tools.
7. Develop a brief PowerPoint presentation (approx. 10-15 slides) that summarizes the key findings of the FEE;
8. Present the key findings in a half-day workshop with Plan, ECEAT and LNCCI;
9. Deliver the final report based on feedback from Plan (due within 1 week upon receiving feedback)*.

*The following deliverables must also be submitted in Lao language (all surveys and interview questionnaires as well as the final version of the FEE report).

8.Timeframe

The consultancy shall take place for a period of 25 working days between April 22nd – July 15th, 2024.

• Tasks and Days
  – Review project documents and conduct initial desk research.(1 day)
  – Draft the inception report (incl. development of data collection methodology, analysis plan, tools (surveys, questionnaires, etc.)). Surveys and questionnaires must also be submitted in Lao language.(3 day)
  – Test the data collection tools and make any corrective changes. (1 day)
  – Facilitate the inception report presentation and consultation workshop with Plan, LNCCI and ECEAT (incl. preparation). (1 day)
  – Train enumerators on the data collection tools and processes (incl. preparation).(2 day)
  – Supervise data collection (incl. desktop studies, interviews and surveys) in Vientiane Capital, Vientiane Province and Luang Prabang (incl. travel days). (9 day)
  – Draft the FEE report. (5 day)
  – Facilitate the FEE presentation workshop with Plan, LNCCI and ECEAT (incl. preparation). (1 day)
  – Finalize and translate the report based on feedback from Plan (2 versions submitted in Lao and English language).(2 day)

  Total Number of Estimated Working Days: (25 days)

Note: Additional travel days can be added only if deemed necessary by the project.

9. Qualifications of the Consultant

• At least a Master’s degree in international development, tourism development or related field;
• At least 5 years’ experience in project design, monitoring and evaluation;
• Demonstrated experience in conducting external evaluations of development projects (previous experience in evaluating EU-funded grant projects is an advantage);
• Previous work experience related to tourism development, SCP, private sector development and/or value chains in Laos;
• Knowledge and expertise in participatory, qualitative and quantitative data collection methodology, tools and analysis;
• High level of research and analytical skills;
• Proven experience in implementing and supervising data collection;
• Previous work in experience in Laos is an advantage;
• Excellent spoken and written English, Lao written and spoken language skills are an advantage;
• The company or consultant(s) must be legally permitted to operate in Lao PDR. It is the responsibility of the company and consultant(s) to ensure that any non-Lao personnel have valid working visas and permits.

Child Protection: Plan does not tolerate child abuse. All Plan staff and consultants are selected and employed in line with the conditions of Plan’s Child Protection Policy. These include appropriate reference and background checks.

More details of ToR please click ”SUSTOUR_ToR_Final Evaluation_March 2024_FINAL.pdf”