Overview
The Senior Backend & Data Engineer will architect and develop backend systems for digital products, ensuring scalability, security, and performance. The role involves designing, developing, and maintaining backend architecture for Giga's digital tools.
Key Responsibilities
- Design and develop backend systems for Giga's digital tools using Django and Django REST Framework.
- Architect scalable backend solutions, defining system design, data models, API structures, and integration patterns.
- Build and maintain RESTful APIs for communication between frontend applications, mobile apps, and third-party services.
- Design and optimize database schemas using PostgreSQL, ensuring data integrity, performance, and scalability.
- Collaborate with vendors and technology partners to integrate external APIs.
- Translate user stories into technical implementations and deliver features in agile sprints.
- Implement authentication, authorization, and security best practices.
- Define and monitor backend performance metrics.
- Write comprehensive tests and maintain documentation.
- Support CI/CD pipelines and deployment processes.
- Build and maintain data pipelines using Celery and Celery Beat for ETL processes.
- Deploy, configure, and manage Apache Superset as Giga's business intelligence platform.
- Design and implement data transformation workflows for connectivity measurements, school registry data, and geospatial information.
- Extend Celery-based data pipelines for scheduled data refreshes, data quality validation, and integration with external APIs.
- Collaborate with data scientists and analysts to operationalize analytical models and automate reporting workflows.
- Monitor and optimize data pipeline performance.
Required Experience
- Minimum of 5 years of relevant professional experience in backend software development or software engineering.
- Hands-on experience designing and implementing RESTful APIs and microservices architectures.
- Demonstrated experience developing and maintaining production-level systems using Python, including applying sound software architecture principles and working with relational databases (e.g., PostgreSQL/ MySQL) preferably for normalised schema design, query optimization, performance tuning, and database migrations.
- Strong experience in building scalable web applications and backend systems using Django and Python, with expertise in API design (REST/gRPC), framework architecture, and highly reliable automation ecosystems.
- Proven experience in designing reliable, data-driven systems and pipelines for large-scale testing, validation, and release workflows in distributed environments.
- Extensive experience working in Agile/SAFe environments, collaborating with cross-functional teams including product managers, developers, and DevOps engineers to deliver robust and scalable solutions.
Qualifications
An Advanced University Degree (Master's degree or equivalent) in Computer Science, Engineering, Data Analytics or a related field is required. A first University Degree in a relevant field, combined with 2 additional years of professional experience, may be accepted in lieu of an Advanced University Degree.
