Job title:
Software Engineer – Cloudera
Company
VE3
Job description
About the Company:We leverage our strong capabilities to build powerful solutions that make a real difference for our clients. We offer a full lifecycle approach to our services, from discovery sessions, design workshops, and business process analysis to deployment, change management, and ongoing support to help clients maximise their investment in the platform.Job Summary:We are seeking a skilled and experienced Software Engineer with expertise in Cloudera. The ideal candidate will have at least four years of experience in systems design, programming/software development, and providing specialist advice within the Cloudera environment. This role will involve working closely with cross-functional teams to design, develop, and optimize robust and scalable big data solutions.Key Responsibilities:1. Specialist Advice
- Provide expert advice on Cloudera and big data technologies to stakeholders and team members.
- Assist in evaluating and recommending new tools and technologies to enhance the big data infrastructure.
- Act as a technical advisor on Cloudera best practices and implementation strategies.
- Support the troubleshooting and resolution of complex technical issues related to Cloudera.
2. Systems Design
- Design and architect big data solutions using Cloudera that are scalable, maintainable, and secure.
- Collaborate with stakeholders to gather and analyze requirements, translating them into technical designs.
- Conduct design reviews and provide feedback to ensure alignment with best practices and project goals.
- Create detailed system documentation, including architecture diagrams, design specifications, and technical manuals.
3. Programming/Software Development
- Develop high-quality big data solutions using Cloudera, adhering to coding standards and best practices.
- Write clean, efficient, and well-documented code for data processing and analytics workflows.
- Perform code reviews and provide constructive feedback to peers.
- Debug and troubleshoot complex issues in a timely manner.
- Collaborate with QA teams to develop and execute unit tests, integration tests, and other automated tests.
4. Data Integration and Management
- Integrate various data sources and applications using Cloudera tools and technologies.
- Develop and maintain ETL processes to ensure seamless data flow and interoperability between systems.
- Optimize data storage, retrieval, and processing for performance and efficiency.
- Ensure data quality and consistency throughout the ETL process.
5. Collaboration and Communication
- Work closely with data analysts, data scientists, and other developers to ensure successful project delivery.
- Participate in Agile/Scrum ceremonies, including sprint planning, daily stand-ups, and retrospectives.
- Communicate effectively with team members and stakeholders to ensure transparency and alignment.
- Mentor junior developers and provide guidance on best practices and technical skills.
RequirementsRequired Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Minimum of 4 years of experience in software development, with a strong focus on Cloudera.
- Proven experience in systems design and architecture.
- Strong understanding of Cloudera ecosystem components such as HDFS, MapReduce, Hive, HBase, Pig, and Spark.
- Proficiency in programming languages such as Java, Scala, or Python.
- Experience with SQL and relational databases.
- Familiarity with version control systems (e.g., Git) and CI/CD pipelines.
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
Preferred Qualifications:
- Experience with cloud platforms (e.g., AWS, Azure) and big data solutions in cloud environments.
- Knowledge of security practices related to big data.
- Certifications in Cloudera or related technologies.
- Experience with Agile/Scrum methodologies.
BenefitsBenefits:
- Competitive salary and performance-based bonuses.
- Comprehensive health, dental, and vision insurance.
- Retirement savings plan with company match.
- Generous paid time off and holidays.
- Professional development opportunities.
- Collaborative and innovative work environment.
Expected salary
Location
London
Job date
Sat, 06 Jul 2024 22:26:20 GMT
To help us track our recruitment effort, please indicate in your email/cover letter where (tendersglobal.net) you saw this job posting.