PEC Consultant for the design of evaluation systems and psychometric behavior analysis at the Operations Learning Program - Tenders Global

PEC Consultant for the design of evaluation systems and psychometric behavior analysis at the Operations Learning Program

United Nations Office of Internal Oversight Services (OIOS)

tendersglobal.net

JOB DESCRIPTION

Post of Duty: Washington D.C – USA.

The IDB Group is a community of diverse, versatile, and passionate people who come together on a journey to improve lives in Latin America and the Caribbean. Our people find purpose and do what they love in an inclusive, collaborative, agile, and rewarding environment.

About this position:

We are looking for a looking for a professional with solid experience in designing evaluation systems and psychometric behavior analysis of virtual learning products to join our team as a PEC Consultant at the Operations Learning Program (OLP).

As a PEC Consultant, you will develop or review evaluation systems and analyze the statistical behavior of the evaluations (objective questionnaires) of virtual, in-person, and hybrid learning products based on the applicants’ responses.

You will work in the Operations Learning Program (OLP), part of the Knowledge and Learning Division (KLD/SDI). This team is responsible for ensuring access to relevant and high-quality knowledge and technical learning to support corporate processes and speed up the preparation and execution of the Bank’s operational program. The Inter-American Institute for Economic and Social Development (INDES) is responsible for the learning area within this division. The INDES seeks to strengthen technical capabilities in the Region to address development challenges successfully.

What you’ll do:

  • Develop evaluation systems for the different virtual, in-person, and hybrid learning products of the Operations Learning Program based on the responses of the applicants. These learning products include MOOCs, private self-training courses, virtual courses with a tutor, operational certifications, and workshops. This includes:

o Prepare or review objective questionnaire questions, considering the following:

  1. Psychometric design criteria to optimize the quality of the questions according to their purpose: formative or summative.
  2. The contents of the course.
  3. Learning objectives.
  4. The guidelines of instructional design.

o Prepare or review evaluation cases or scenarios.

o Prepare or review the table of specifications for each questionnaire, which must represent its structure and demonstrate its content validity.

  • Analyze the statistical behavior of the evaluations (objective questionnaires) of virtual, in-person and hybrid learning products based on the applicants’ responses. This analysis has, among others, the following objectives:
  • Describe the performance observed in the applicants.
  • Describe the psychometric behavior of the evaluation.
  • Identify opportunities for improvement in the questionnaires to optimize the evaluation, depending on their purpose.
  • The consultant must prepare and deliver reports of these results to the Operations Learning Program.
  • Propose solutions to improve the evaluation systems of the learning products offered by the Program.

Deliverables and Payments Timeline:

Deliverables Percentage Estimated deliverable date.
All deliverables are described below, in the “characteristics of deliverables” section. Lump sum, that total doesn’t exceed the maximum amount related to this contract, and according to the products received under the Bank’s satisfaction, following this detail:

4 payments. Each payment represents the 25% of the total amount of the contract.

Dates are flexible, depending on the requirements of each learning product.

Characteristics of deliverables:

  • Prepare or review questionnaire questions. Estimated quantity: 40
  • Prepare or review evaluation cases or scenarios. Estimated quantity: 1
  • Prepare or review the table of specifications for each questionnaire. Estimated quantity: 1
  • Analyze the statistical behavior of the evaluations. Estimated quantity: 1

 

 

What you’ll need:

  • Education: Bachelor’s degree in pedagogy, teaching, instructional design, psychology, or related field. Candidates with master’s degrees in evaluation will be considered positively.
  • Experience: At least two years of experience in classical psychometrics (Classical Test Theory). Experience in remote education aimed at public or private sector officials will be considered positively.
  • Languages: Proficiency in Spanish and English, spoken and written, is required. Additional knowledge of French and Portuguese is preferable.

Key skills:

  • Critical thinking and excellent analytical skills.
  • Ability to create evaluation systems based on the program’s quality guidelines and standards.
  • Ability to propose solutions to improve the evaluations of the learning products under analysis.
  • Rapid response capacity to respond effectively to adjustment requests and recommendations provided by the team to deliver the final version in the shortest time possible.
  • Flexibility to establish delivery dates.

Requirements:

  • Citizenship: You are a citizen of one of our 48-member countries.
  • Consanguinity: You have no family members (up to the fourth degree of consanguinity and second degree of affinity, including spouse) working at the IDB, IDB Invest, or IDB Lab.

Type of contract and duration:

  • Type of contract: Products and External Services Consultant (PEC), Lump sums
  • Length of contract: 3 meses
  • Work Location: Remote

What we offer:

The IDB group provides benefits that respond to the different needs and moments of an employee’s life. These benefits include:

  • A competitive compensation package.
  • A flexible way of working. You will be evaluated by deliverable.

Our culture:

At the IDB Group we work so everyone brings their best and authentic selves to work, willing to try new approaches without fear, and where they are accountable and rewarded for their actions.

Diversity, Equity, Inclusion and Belonging (DEIB) are at the center of our organization. We celebrate all dimensions of diversity and encourage women, LGBTQ+ people, persons with disabilities, Afro-descendants, and Indigenous people to apply.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job interview process. If you are a qualified candidate with a disability, please e-mail us at [email protected] to request reasonable accommodation to complete this application.

Our Human Resources Team reviews carefully every application.

About the IDB Group:

The IDB Group, composed of the Inter-American Development Bank (IDB), IDB Invest, and the IDB Lab offers flexible financing solutions to its member countries to finance economic and social development through lending and grants to public and private entities in Latin America and the Caribbean.

About IDB:

We work to improve lives in Latin America and the Caribbean. Through financial and technical support for countries working to reduce poverty and inequality, we help improve health and education and advance infrastructure. Our aim is to achieve development in a sustainable, climate-friendly way. With a history dating back to 1959, today we are the leading source of development financing for Latin America and the Caribbean. We provide loans, grants, and technical assistance; and we conduct extensive research. We maintain a strong commitment to achieving measurable results and the highest standards of integrity, transparency, and accountability.

Follow us:

https://www.linkedin.com/company/inter-american-development-bank/

https://www.facebook.com/IADB.org

https://twitter.com/the_IDB

 

Additional Information


Apply for job

To help us track our recruitment effort, please indicate in your cover/motivation letter where (tendersglobal.net) you saw this job posting.

Job Location