Independent Evaluation Consultant for the Project “Increasing Effectiveness, Strengthening Enabling Environment for Human Rights Defenders” (SSA)

Background:

ODIHR is the principal institution of the OSCE responsible for the human dimension. ODIHR is active throughout the OSCE area in the fields of election observation, democratic development, human rights, tolerance and non-discrimination, and rule of law. 

Human Rights Defenders (HRDs) in the OSCE region face challenges in conducting their human rights work safely and securely, in effectively advocating for and communicating about human rights and in taking full advantage of new technologies. To address these challenges, ODIHR created the “Increasing effectiveness, strengthening enabling environment for human rights defenders” project (IRMA No. 1300722), which aims to ensure HRDs in the OSCE participating States are more effective in promoting and protecting human rights. Activities promote a safe and enabling environment for HRDs, including National Human Rights Institutions (NHRIs) and journalists, and support them in conducting their work more effectively and securely. This includes assessing the situation of HRDs in participating States; building their capacity to conduct their human rights work safely; and strengthening their ability to communicate their messages with target audiences and conduct advocacy on key human rights concerns, including through the use of technology tools.

The Project was built on ODIHR’s strong track record of providing training for HRDs on human rights monitoring, including on the issue of freedom of peaceful assembly, as well as on safety, security and communication. It increases the capacity of HRDs in utilizing new communication strategies, methods and technologies for monitoring purposes. It makes use of ODIHR’s convening power to bring together HRDs and other stakeholders to address evolving challenges and opportunities such as the role of non-state actors and tech businesses in the situation of HRDs. The project also complements other ODIHR programmes, such as those targeted at making human rights education more accessible through technology, and at strengthening democratic law making by parliaments. The project aims to achieve the following:

• Expected Result I (Human Rights Monitoring): Effective assessments and reports on the situation of HRDs in the OSCE region support the improved implementation of international standards and recommendations concerning HRDs.
• Expected Result 2 (Capacity Building): The capacity of HRDs to protect human rights and influence policies across the OSCE region is improved.
• Expected Result 3 (NHRIs): The independence of NHRIs across the OSCE region and their role in advancing implementation of human dimension commitments is strengthened.
• Expected Result 4 (Dialogue and Joint Action): HRDs, key state and non-state actors increasingly engage in dialogue and joint action, including on the impact of private tech businesses on HRDs and the responsibilities

Under Expected Result 2, ODIHR is in the final stages of the development of the Starlight Stadium game. The game is a capacity building tool designed to teach HRDs about the human rights monitoring methodology. Through undertaking a gamified human rights investigation, players can learn what practically goes into protecting and promoting human rights. Starlight Stadium was developed over a number of years, since 2018, with external contracts and hired technical experts. The development process included extensive consultations with HRDs, technical specialists and other key stakeholders and included a comprehensive testing phase. Starlight Stadium consists of 4 different games (Episodes) which users can play. It will be made available in English, Russian, and Ukrainian on ODIHR’s open-source platform, FreedomLab (https://freedomlab.io/), which serves as a virtual gathering place for HRDs as well as a repository of training materials, tutorials, and digital tools. Starlight Stadium is a key element of support for HRDs that aims to increase their capacity to monitor and report and advocate for the promotion of human rights.

 

Objective and scope of Assignment: 

This evaluation seeks to gather lessons learned on the development processes of Starlight Stadium and to determine if the design is optimally linked to achieving the intended objective, taking into account external factors that contributed or constrained the delivery of the tool. The evaluation will look at the activities and processes in relation to the development of Starlight Stadium undertaken under the project, from January 2021 to October 2024, taking into account related work conducted previously under other ODIHR programmatic initiatives. 

The evaluation will focus on a subset of criteria based on the Development Assistance Criteria (DAC) as laid out in the DAC Principles for evaluation of Development Assistance.  The Evaluation will look specifically at relevance, efficiency, effectiveness, sustainability and added value developing forward-looking recommendations that serve to strengthen ODIHR’s future programmatic activities in the field of capacity building for HRDs. More specifically, the evaluation will:

• assess the efficiency of the development process;
• look at the relevance of the game and the consultative process under which it was developed;
• explore the sustainability of the game in relation to organizational priorities and future plans;
• identify good practices and lessons learnt that can inform the role out of the game, maintenance, next steps as well as similar future programmatic initiatives.

The evaluation will include special consideration of the political objectives of the OSCE, the intergovernmental nature of the Organization and the political and administrative context in which ODIHR operates. It should also include considerations on responsible technology practices to ensure ODIHR is better able to utilize data and digital tools to improve lives, while preventing unintended side-effects and potential pitfalls.

The evaluation will be seen through a human rights and gender lens, taking into account gender considerations were approached and adopted during the development process. It should also provide recommendations, where relevant, on how to further improve gender mainstreaming considerations in the role out of the game.  

A detailed evaluation design will be developed in coordination and under the guidance of ODIHR’s Project Co-ordination Unit (PCU) and should make use of a mix of quantitative and qualitative data collection tools: desk review, surveys, questionnaires and interviews, as well as review of other documentation such as financial information. More specifically this will include:

• Desk review: this will mainly encompass the following type of documents: project documentation including game’s builds, copies of collaborative boards, core team meetings minutes, etc. as well as activity reports, workshop reports, agendas, presentations and training materials, and participant feedback forms.
• Qualitative data will be collected through carrying out semi-structured interviews, focus group discussions, and an open-ended survey.
• Quantitative data will be gathered from existing statistical data and data collated from a closed-ended survey

The evaluation should be carried out within the framework of the do no harm principle and in full consideration of the safety and confidentiality of all persons participating in the project. 

 

Duration of Assignment:

25 working days (July – December 2024)

 

Deliverables:

The evaluator should submit the following deliverables:

Deliverable 1: Detailed evaluation plan

Following the introductory phase, the evaluator will draft the Inception Report through an in-depth desk review of project documentation and other relevant subject matter documents provided by ODIHR, the Inception report should include:

• Outline of methodology and tools including the development of evaluation questions and criteria.
• The plan should also include a proposed timeframe and work plan for the conduct of the evaluation along with an indicative stakeholder list.

The Inception report including evaluation questions, will be agreed with the ODIHR’s Deputy Head of Human Rights Department and Project Co-ordination Unit (PCU). 

Deliverable 2: Data collection and analysis phase

Based on the methodology agreed in the inception report the consultant will implementation the potential survey; and online and in-person interviews (in Warsaw, Poland) with selected key stakeholders including ODIHR’s Starlight Stadium core development team, Advisory working group members, HRDs and ODIHR management;

The in-depth data analysis (project documentation and other relevant subject, quantitative and qualitative data collected; analysing interview responses to the evaluation questions – observations; analysis of lessons learned and good practices, including specific recommendations to ODIHR) will result in an online presentation of emerging findings with PCU, Deputy Head of Human Rights Department and relevant programmatic staff.

Deliverable 3: Report writing phase

Following the presentation further analysis of lessons learned and good practices, including specific recommendations to ODIHR will be presented and submitted in a first draft evaluation report (incl. description of the methodology used, findings, conclusions, recommendations).

Followed by a review by ODIHR – discussion on feedback and agreement of adjustments
a second draft final evaluation report (incl. findings, conclusions, recommendations) will be prepared and submitted.

Deliverable 4: Report presentation and finalization

Followed by a review by ODIHR – discussion on feedback and agreement of adjustments the final evaluation report will be prepared and submitted. The final report must include an executive summary completed that provides a clear, concise presentation of the evaluation’s main conclusions, key recommendations and salient issues identified; All annexes, footnotes, graphs, images and formatting finalized; the report shall contain at least the following annexes:

• List of persons interviewed (with privacy considerations);
• Data collection tools (copies of surveys, questionnaires or other materials used for this purpose);
• A bibliography or list of references;
• The ToR for the evaluation;
• Other project information as need;

The evaluation report will be presented to ODIHR, including relevant project staff.

All deliverables shall be submitted to PCU in accordance with the agreed timeline (timeline is set after the first meeting). The Deputy Head of Human Rights Department and PCU will review the quality of the deliverables submitted and request any improvements necessary to reach the professional standards required.

For more detailed information on the structure and work of the OSCE Office for Democratic Institutions and Human Rights, please see https://www.osce.org/odihr

 

Necessary Qualifications:

• Advanced university degree (Master’s degree or equivalent) in law, political science, international relations, human rights, or other relevant disciplines. A combination of relevant academic qualifications and extensive experience may be accepted in lieu of the advanced university degree.
• Extensive experience (minimum 10 years) of designing and implementing/conducting evaluations of projects implemented at the international level, preferably projects related to human rights and/or responsible technology.
• Knowledge of the work of human rights defenders to promote and protect human rights delivered by international organizations is highly desirable.
• Knowledge of human rights centered design and deployment of new technologies, such as gamification is highly desirable.
• Comprehensive understanding of gender mainstreaming in projects and experience in applying gender mainstreaming in evaluation methodology.
• Professional fluency in written and spoken English; working knowledge of other OSCE languages, especially Russian, is desirable.
• Ability and professional experience of inter-cultural environments and professional conduct with significant political tact, upholding the do no harm approach.
• Experience with the OSCE would be an advantage.
  

Remuneration Package:

Remuneration will be based on the selected consultant’s/expert’s qualifications, experience, the tasks and deliverables for this position and in accordance with the OSCE established rates.

If you wish to apply for this position, please use the OSCE’s online application link found under https://vacancies.osce.org/.

 

The OSCE retains the discretion to re-advertise/re-post the vacancy, to cancel the recruitment or to offer an appointment with a modified job description or for a different duration.

 

Only those candidates who are selected to participate in the subsequent stages of recruitment will be contacted.

 

The OSCE is committed to diversity and inclusion within its workforce, and encourages qualified female and male candidates from all religious, ethnic and social backgrounds to apply to become a part of the Organization. 

 

Candidates should be aware that OSCE officials shall conduct themselves at all times in a manner befitting the status of an international civil servant. This includes avoiding any action which may adversely reflect on the integrity, independence and impartiality of their position and function as officials of the OSCE. The OSCE is committed to applying the highest ethical standards in carrying out its mandate. For more information on the values set out in OSCE Competency Model, please see https://jobs.osce.org/resources/document/our-competency-model.

 

Please be aware that the OSCE does not request payment at any stage of the application and review process.