Data Lead
XLVet UK Ltd
North Shields, United Kingdom
19 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
North Shields, United Kingdom
Tech stack
Microsoft Access
Azure
Continuous Integration
ETL
Data Warehousing
Python
Performance Tuning
Power BI
SQL Databases
Data Processing
Data Ingestion
Data Lake
Data Lineage
Data Management
Data Pipelines
Databricks
Job description
XLVets is strengthening its data capabilities to deliver timely, trustworthy insight to our members and internal teams. As a Data Lead, you'll design and operate secure, reliable data pipelines utilising resource within the Azure technology stack enabling analytics, self-service reporting, and data-driven decision-making across a fast-paced, member-focused, and close-knit team., ETL / ELT engineering
- Build and maintain robust and secure ETL/ELT pipelines in Azure Databricks utilising resource such as Azure Storage accounts, Delta Lake, notebooks, jobs, cluster configuration and Unity Catalog.
- Implement monitoring, alerting and CI/CD for data pipelines; continuously improve reliability, performance, and cost efficiency of the solution.
- Demonstrate a clear understanding of data warehousing principles by designing and implementing well-structured dimension and fact tables.
Data modelling and Reporting
- Design pragmatic dimensional models optimised for reporting and analytics using Power BI, with clear lineage and documentation.
- Understand the constraints of Power BI licencing models and alternative report distribution methods for cost efficiency.
- Understands and demonstrates best practice when building reports, writing DAX and data model performance.
Quality, governance & security
- Implement robust data quality controls, comply with established testing protocols, and ensure comprehensive documentation is supplied and maintained, including metadata and data lineage.
- Contribute to standards for data privacy, retention, access, and compliant use of member data.
Requirements
Do you have experience in Unity?, Must have technical experience in:
- Proven Azure experience designing data platforms, data models and understanding how upstream and downstream decisions impact data ingestion, transformation, ETL and data model performance.
- Hands on ETL/ELT with Azure Databricks (Delta Lake, notebook/job orchestration, cluster/performance tuning).
- Strong SQL and Python experience for scalable data processing.
- Power BI experience: dataset modelling and shaping for performance; familiarity with pricing/licensing and its implications for workspace/dataset design.
Must have people skills
- Demonstrates a genuine curiosity and inquisitiveness about our members, their work, and the broader community.
- Capable of clearly communicating complex technical concepts to both technical and non-technical stakeholders, ensuring understanding across diverse audiences.
- Adept at clarifying desired outcomes, presenting well-considered options, effectively managing expectations, and influencing stakeholders with credibility and professionalism.
- Proven ability to resolve complex data challenges, comfortably navigating ambiguity, unusual scenarios, and shifting requirements to deliver effective solutions.