Senior Data Engineer
Randstad UK
Charing Cross, United Kingdom
10 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 85KJob location
Charing Cross, United Kingdom
Tech stack
Artificial Intelligence
Azure
Cloud Computing
Information Engineering
Data Integration
ETL
Data Systems
Python
Machine Learning
Spark
Real Time Data
Databricks
Job description
- Design and implement scalable data integration pipelines using Python and Spark to process large-scale batch data for a diverse global client base.
- Manage project workloads and capacity planning while serving as a technical escalation point to ensure the seamless delivery of high-quality data solutions.
- Partner with internal stakeholders and external clients to gather requirements, provide technical recommendations, and maintain comprehensive documentation for all data workflows.
Requirements
- At least 4 years of professional experience in data engineering or a closely related technical role.
- Proven technical expertise using Python, Spark, and cloud-based platforms, ideally within a Microsoft Azure or Databricks environment.
- Demonstrated experience managing client-facing projects, including handling technical escalations and performing root cause analysis.
- Strong understanding of ETL processes and a track record of delivering complex technical projects within established deadlines.
Good to Have
- Previous experience working with consumer data or collaborating with external data agencies.
- A proactive interest in the application of AI and Machine Learning technologies.
- Experience developing or maintaining real-time data pipelines.
Benefits & conditions
This is an exceptional time to join a collaborative and forward-thinking team where you will have direct exposure to major corporate initiatives and global brands. The role offers a perfect balance of technical challenge and leadership responsibility within a flexible working environment. With a competitive package and a comprehensive onboarding programme in place, now is the ideal moment to accelerate your career in a business that is consistently innovating.