AWS Data Engineer

• Experience of back-end / data engineering across a number of languages (including Python), and commonly used IDE's

• Experience with developing, scheduling, maintaining and resolving issues with batch or micro-batch jobs on AWS ETL or Azure ETL services

• Experience querying data stored on AWS S3 or Azure ADLSv2, or through a Lakehouse capability

• Experience in managing API-level and Database connectivity

• Experience using source control and DevOps tooling such as Gitlab

• Experience in use of terraform (or similar cloud native products) to build new data & analytics platform capabilities

• Experience with developing data features and associated transformation procedures on a modern data platform. Examples include (but not limited to) Azure Fabric, AWS Lakeformation, Databricks or Snowflake.

• Experience automating operations tasks with one or more scripting languages.

Due to the nature of the project and the short turnaround required, the successful candidate must hold valid and live SC Clearance.