Principal Data Engineer
VIQU Ltd
Manchester, United Kingdom
5 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 95KJob location
Manchester, United Kingdom
Tech stack
Airflow
Google BigQuery
Information Engineering
Data Fusion
Python
SQL Databases
Data Streaming
Data Lake
Job description
- Lead the architecture, best practise and engineering strategy of data squads.
- Hands on data engineering work, utilising both python and SQL.
- Mentor and lead teams of engineers, checking and reviewing code, and setting standards.
- Ensure all data platform processes; including ingestion, quality, transformation, security, batch management, monitoring, alerting, and cost control are efficient.
- Design and help build the data platform - ensuring data is processed through semantic layers and can be modelled effectively.
- Suggest improvements for automation and cost savings.
- Lead changes across the organisation, adopting a decentralised design.
Requirements
- Experience as a lead or principal data engineer.
- Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream.
- Deep understanding of Data Mesh/ decentralised design and Data Lake/Warehouse solutions.
- Previously led teams of data engineers.
- Hands on skills across the GCP tech stack, SQL and Python.
- Ability to lead cultural change across organisations, and manage senior stakeholders.
- Ability to work across multiple contexts and teams.
