Overview
The Associate Data Engineer will design and build modern data pipelines and platforms to support critical business decisions. This role operates at the intersection of data engineering, cloud technologies, and advanced analytics to transform raw data into actionable insights.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using modern data processing frameworks.
- Implement ETL/ELT processes for data ingestion, transformation, and integration.
- Build pipelines for unstructured and semi-structured content processing for AI use cases.
- Develop and manage data models for data lakehouse architectures.
- Optimize data processing performance and ensure scalability of data solutions.
- Implement and support data governance, security, and compliance practices.
- Deploy, schedule, and monitor data workflows in production.
- Collaborate with stakeholders to understand data requirements and deliver solutions.
- Provide technical guidance and mentorship to junior team members.
Required Experience
- At least 5 years of relevant experience.
- Demonstrated experience in designing and implementing data engineering solutions in enterprise environments.
- Proven experience with Databricks ecosystem.
- Experience working with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
- Experience with real-time or streaming data processing frameworks.
- Hands-on experience applying AI/GenAI techniques to unstructured data.
- Exposure to machine learning pipelines and MLOps practices.
- Familiarity with data visualization and business intelligence tools.
Qualifications
- Master’s degree in Computer Science, Engineering, Data Science, or a related field.
- Databricks Certified Data Engineer is required.
- Microsoft Certified: Fabric Data Engineer Associate - desirable.
- SAFe Practitioner (SP) - desirable.
