Data Platforms and DataOps Engineer - Tenders Global

Data Platforms and DataOps Engineer

World Bank Group

tendersglobal.net

<!–

Description

–>

The ITS Enterprise Services department, ITSEN, provides a wide range of technical services, ranging from data centers and system administration, to database, middleware, cloud, and Identity management.  ITSEN consists of two units (ITSIA and ITSSM) which are in Washington, DC; Chennai, India; and in Sofia, Bulgaria.  ITSIA (ITS Identity and Application Service) unit, provides enterprise system integration support, IAM, database and ETL infrastructure support and administration, for both on premise and in cloud (Azure/AWS), for ITS and its clients.

We provide a meaningful, open, and collaborative environment. We have many interesting problems to solve, providing you with an opportunity to develop your skills while contributing to the mission of the bank. We value teamwork, openness, curiosity, and persistence.

The IT officer will oversee and manage ETL environment, including Informatica Power Center (PC), Data Quality (DQ), Informatica Data Management Cloud (IDMC), Master Data Management (MDM), Metadata Manager, Web Services, Proactive Monitoring and Data Privacy Management (DPM). This role involves designing and maintaining ETL processes, ensuring data quality, optimizing system performance, and implementing security measures. The candidate must have a strong technical background and experience with ETL, ELT technologies and services to support business processes data workflow, data privacy management of applications and business units.

Roles and Responsibilities:

  • Lead and provide technical support for the existing ETL infrastructure and ensure it is running at optimal performance.
  • Collaborate with cross-functional teams to understand data integration needs and provide infrastructure solutions.
  • Manage security configurations and protocols to safeguard ETL infrastructure.
  • Work closely with the security team to address any security vulnerabilities, and compliance validation/remediation.
  • Install, configure, upgrade, and apply EBF’s in Informatica Suite – PC, DQ, IDMC,MDM, Metadata Manager, Web Services, Proactive Monitoring, DPM and Power Exchange.
  • Implement, manage, configure, and customize Informatica EDC to ensure organization’s effective data cataloging and data governance requirements.
  • Support application teams and business stakeholders to maintain ELT related data pipelines, data integration workflows using Azure Synapse, Azure Data Factory, Azure Databricks, and other Azure services. Automated deployments of Informatica products using Azure DevOps CICD pipelines.
  • Support application teams with additional data platforms such as Databricks, Data Factory and Microsoft Fabric products using Azure DevOps CICD pipelines.
  • Integrate MDM components such as IDD, ActiveVOS, Elastic Search, ESB, and Active MQ for Business processes.
  • Manage projects and operations using Azure boards and ServiceNow.
  • Lead ETL infrastructure service Business Continuity exercises.
  • Adopt Site Reliability Engineer (SRE) practices into ETL operations.
  • Adopt Azure board to manage projects and to track work programs deliverables.
  • Develop and foster a collaborative working relationship with the Lines of Business Data Integration teams, consultants, and project managers to develop processes, documentation, and solutions related to deployments.
  • Stays abreast with current trends in ETL stack on cloud along with flexibility & adaptability to extend beyond Informatica stack into other data platforms as needed.
  • Analyze current application process and recommend improvements.
  • Maintain Informatica processes running on Linux OnPrem and Cloud Servers, take necessary proactive measures for better ETL infrastructure performance, including server configuration, resources usage optimization and tuning.
  • Provide input on architectural design considering changes in technology within the context of ITS’ current implementation and future roadmap.
  • Advise on new ETL features, Technologies, and components implementation.
  • Stays abreast of new technology trends in project management area, and the broader IT industry.
  • Provide regular status updates to Supervisor and Manger ensuring timely completion of work programs execution and responsibilities.
  • Guide team members and oversee operational tasks.

Selection Criteria

  • Master’s degree with 5 years relevant experience or Bachelor’s degree with at least 7 years’ relevant experience.
  • Experience in the Informatica ETL platforms – PC, MDM, IDQ and IDMC, DPM is a large enterprise is a must.
  • Experience using ADO CICD pipeline and cloud services is a must.
  • Experience using integration platforms with ERP systems and cloud services is a must.
  • Experience with integration of MDM components such as IDD, ActiveVOS, Elastic Search, ESB, and Active MQ, is a must.
  • Familiarity with performance analysis using performance monitoring and tuning tools is a must.
  • Experience in data integration workflows using Azure Synapse, Azure Data Factory, Azure Databricks, and other Azure services, is a plus.
  • Knowledge and/or experience of SAP BODS software is a plus
  • Understanding of cloud native deployment concepts such as DataOps, and cost optimization techniques such as FinOps is a plus
  • ETL code migration, workflow automation using Rundeck, is a plus.
  • Strong development experience with Java, Python, JavaScript.
  • Strong troubleshooting, analytical, and problem-solving skills.
  • Experience in Agile Methodology, Proficient knowledge of current industry practices, standards, and procedures.
  • Excellent problem solving skills including troubleshooting and reviewing deployment pipelines, scripts, configuration etc.
  • Team player who works well with technical and non-technical resources, results-oriented track record and the maturity to escalate issues, as needed.
  • Excellent interpersonal skills, including an ability to work effectively in a team/task force as a participant or team leader.
  • Excellent oral and written communications skills and experience interacting with business, application, and infrastructure teams.

Source: https://worldbankgroup.csod.com/ats/careersite/JobDetails.aspx?id=27815&site=1

<!—

<!–

–>

To help us track our recruitment effort, please specify on the application form/indicate in your cover letter where (tendersglobal.net) you saw this job posting.

Job Location