Lead Data Engineer
- Extensive experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions
- Strong Data Architecture expertise including different data modelling techniques and design patterns (conceptual, logical, physical, semantic is preferred)
- Strong knowledge of data governance such as data lineage, technical metadata, data quality and reconciliation
- Ability to drive platform efficiency through automation and AI capabilities
- AWS Data Stack: EMR, Glue, Redshift, Athena, S3, Lambda, ECS
- Data Orchestration & Pipelines: Airflow, Dataform
- Data Formats & Modelling: Iceberg, JSON, XML, CSV, Data Modelling Programming & DevOps: Python, SQL, Git, GitHub Actions, Team City, Jenkins, Octopus Unix shell scripting
- ETL & Ingestion: File ingress/egress solutions in AWS
- Security and Observability: DevSecOps, Artifactory, Observability tooling
- Testing & Automation: test automation frameworks, Jupyter Notebooks
- Familiarity with data warehousing and build experience in Teradata, Oracle
- Experience in visualisation tools such as PowerBI, Tableau
- Familiarity and experience with Agile processes
- AWS Data Engineer Associate certification
- Extensive experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions
- Strong Data Architecture expertise including different data modelling techniques and design patterns (conceptual, logical, physical, semantic is preferred)
- Strong knowledge of data governance such as data lineage, technical metadata, data quality and reconciliation
- Ability to drive platform efficiency through automation and AI capabilities
- AWS Data Stack: EMR, Glue, Redshift, Athena, S3, Lambda, ECS
- Data Orchestration & Pipelines: Airflow, Dataform
- Data Formats & Modelling: Iceberg, JSON, XML, CSV, Data Modelling Programming & DevOps: Python, SQL, Git, GitHub Actions, Team City, Jenkins, Octopus Unix shell scripting
- ETL & Ingestion: File ingress/egress solutions in AWS
- Security and Observability: DevSecOps, Artifactory, Observability tooling
- Testing & Automation: test automation frameworks, Jupyter Notebooks
- Familiarity with data warehousing and build experience in Teradata, Oracle
- Experience in visualisation tools such as PowerBI, Tableau
- Familiarity and experience with Agile processes
- AWS Data Engineer Associate certification