Data Engineer

Overview

The Data Engineer will support the technical development, integration, and operationalization of a Labour Market Information System by designing, building, and maintaining data pipelines and architectures.

Key Responsibilities

• - Design, build, and maintain ETL/ELT pipelines.
• - Automate data ingestion from various sources.
• - Implement data validation and quality checks.
• - Use platforms like Azure for cloud-based data solutions.
• - Work with Data Scientists and Full stack Web Developers.
• - Create and maintain comprehensive technical documentation.
• - Provide ongoing support for deployed pipelines.
• - Research emerging technologies and industry trends.

Required Experience

A minimum of 5 years of professional experience with Python, SQL, cloud environments container orchestration (Kubernetes), and DevOps automation is required. Knowledge in database design, and development using MS SQL Relational Database is required. Strong familiarity with semantic modeling, knowledge graphs, and AI/ML integration for data systems is desirable.

Qualifications

A minimum high school diploma with a certification or degree in Information Systems, Information Technology, Computer Science, Statistics or related area is required.

Other Details