Lead Data Engineer
Role details
Job location
Tech stack
Job description
I am looking for an experienced Data Engineering Team Lead / Lead Data Engineer who can oversee a small team of experienced Data Engineers, set technical direction and set up new processes in an efficient manner. This is a role where you can really make your mark and impact change very quickly.
Requirements
The Data Engineering Team Lead / Lead Data Engineer will remain hands-on and will ideally have experience with Databricks and Azure however the leadership experience and behaviours are the priority for this role. The Person: The successful candidate must have proven experience operating as a Team Lead / Lead Data Engineer with the ability to design, build, and maintain scalable data pipelines and solutions. You must be able to work closely with the Data Architect to interpret data architecture designs into actionable build plans and lead the development of data processing workflows. From a technical standpoint you will ideally possess / or aspire to learn:
- Knowledge or experience of Databricks including Unity Catolog and Spark SQL.
- Programming skills, preferably in Python and SQL.
- Knowledge and experience in Azure, including working with Azure Data Factory and Azure Storage Accounts.
- Knowledge of previous experience working with Terraform to define, deploy, and manage cloud infrastructure as code in a scalable and repeatable manner, integration and automation of CI/CD data pipelines to support deployment of data services and environments.
Benefits & conditions
Full Time / Permanent £65,000 - £85,000 dependant on experience + car allowance, generous bonus, private medical and other extensive benefits Hybrid - 1 day a week in the Oxfordshire head office required with occasional travel to London