Senior Lead Data Engineer

New

Key responsibilities & Accountabilities:

Working with multiple stakeholder communities to understand our data needs and create pipelines to take data between different layers in the platform
Ensuring the technical infrastructure is in place and appropriate to support managing the data platform and associated activities such as pipelines
Creating standards and patterns to ensure that future development adhere to a high-quality fit for purpose framework
Defining features and capabilities to move the dial on data usage within the insurance industry
Providing governance and consultancy to users of the data platform and data related questions

Skills & Ability

Communication – client has a broad range of stakeholders with a commitment to becoming data driven. The successful candidate will need to be able to work with a broad stakeholder group and align between multiple viewpoints
Collaborative – client prides itself on its collaborative culture and data engineers will regularly interact with other technical teams and business users
Willingness to learn – the successful candidate will be expected to propose new approaches and prototype solutions
Influence – A key part of this role will be to influence the strategic usage of data within client at both a technical and cultural level. This role will be a mixture of hands-on development and thought leadership

Knowledge & Experience

3+ years working in a Data Engineering role
Experience designing and using Azure capabilities and especially Analytics tools (incl. Synapse Analytics)
Strong SQL knowledge, ideally with SQL Server and Azure SQL experience
Knowledge of Python and ideally Spark
Experience analyzing, cleaning, migrating and modeling data
Experience working in an Agile environment

Ability to articulate and advocate technology solutions effectively to technical and non-technical stakeholders while applying agile methodologies
Proficiency in data interrogation and presentation of analysis results as part of team outputs
Extensive experience as a senior software developer or engineer with a strong focus on Python development
Strong expertise in SQL databases including PostgreSQL, SQL Server, and Databricks
Comfortable working directly with databases without using Object Relational Mapping tools
Experience working with data at scale and the associated technical challenges
Proficiency with command line tools such as git, bash or zsh, and optionally vim
An undergraduate degree or demonstrable knowledge in Computer Science, Software Engineering, Logic, Applied Statistics, Actuarial Science, Data Science, or related fields is preferred