Enterprise Data Engineer
Talent Smart
Sheffield, United Kingdom
2 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Sheffield, United Kingdom
Tech stack
Azure
Continuous Integration
ETL
Data Systems
Data Warehousing
Raw Data
Reliability Engineering
Data Ingestion
GIT
Data Lake
PySpark
Data Management
Data Pipelines
Databricks
Job description
We're looking for a hands-on Enterprise Data Engineer to build and scale modern data platforms, focusing on robust data pipelines and Back End data plumbing.
You'll work with Databricks and PySpark to ingest, transform, and structure raw data into high-quality Delta tables for enterprise use.
What You'll Do
- Build and maintain PySpark pipelines to ingest raw data into Delta tables
- Design scalable data ingestion and transformation frameworks
- Integrate and standardise complex datasets into analytics-ready formats
- Ensure resilience, reliability, and Real Time monitoring of data pipelines
- Apply strong data modelling and warehousing principles
- Drive engineering best practices (Git, CI/CD, SRE)
Requirements
- Strong experience with Databricks and PySpark
- Solid understanding of data pipelines, ETL/ELT, and Delta Lake
- Experience with data modelling and data warehousing
- Familiarity with Azure DevOps and modern engineering practices
- Focus on building reliable, scalable data systems
