Internship title: Implement a monitoring system for the Multi-mission Ingestion and File Dissemination System using the ELK stack, i.e. Elasticsearch, Logstash, and Kibana

The internship offers an exciting opportunity to work with the ELK stack (Elasticsearch, Logstash, and Kibana) to build and enhance a monitoring system for a Near Real Time System at EUMETSAT. This system is essential for the operational dissemination of satellite data, providing critical information for weather monitoring, climate studies, and environmental assessments.

Interns will gain hands-on experience in setting up and configuring the ELK stack, including:

• ELK Stack Setup: Installing and configuring Elasticsearch, Logstash, and Kibana to build a monitoring system.
• Log and Metric Integration: Designing and implementing Logstash pipelines for data ingestion and processing.
• Dashboard Development: Creating and customizing Kibana dashboards for visualization and monitoring of system metrics.

The intern will gain the advanced skills in configuring and using the ELK stack, practical experience in monitoring and data visualization, and knowledge of space systems and satellite meteorology.

Duties

The main tasks of the internship would be to:

• Study and understand the ELK stack components and their functions;
• Study and understand the Multi-mission Ingestion and File Dissemination (MFID) System for Near-Real Time meteorological data dissemination;
• Set up and configure Elasticsearch, Logstash, and Kibana for MFID;
• Create Elasticsearch indices for storing and indexing logs;

• Develop visualizations and dashboards in Kibana.
• Test the monitoring system.
• Document the setup and configuration process.
• Present the results.
• In addition, the intern will support relevant day-to-day activities within the team.

Skills and Experience

• Have the ability to work effectively in English;
• Be computer literate;
• Be intrinsically motivated and curious about the internship subject;
• Be able to work independently and collaboratively;
• Have the ability to take the initiative in researching ideas;
• Have the ability to collect, collate, conceptualize and present information clearly.

Additional specific requirements:

• Basic knowledge of Linux and programming.