Data Engineer

ETL development and maintenance

• Develop, maintain, and extend our C# ETL application codebase; adding new data flows, optimising existing, and improving reliability
• Work with Azure SQL Managed Instance - authoring and tuning SQL queries and scripts executed by the ETL layer
• Monitor and support Azure Data Factory pipelines, investigating and resolving failures promptly
• Participate in code reviews and contribute to engineering standards across the ETL codebase
• Investigate and resolve data quality issues across the ingestion-to-reporting pipeline

Event-driven ingestion

• Maintain and improve Event Hubs consumers and associated ingestion pipelines
• Ensure event data lands correctly and completely, with appropriate monitoring and alerting
• Semantic layer and reporting
• Make governed changes to Azure Analysis Services tabular models - new measures, hierarchies, and role-based access configurations
• Work with analysts and Power BI report authors to translate reporting requirements into well-modelled data
• Help define and document metric definitions in the semantic layer, reducing ad-hoc engineering requests

Architecture and modernisation

• Contribute to the evaluation and design of future architectures
• Support the gradual improvement of self-serve analytics capability for internal and client-facing consumers

Engineering practice

• Follow and help improve the team's CI/CD and deployment practices via Azure DevOps
• Contribute to documentation of data flows, dependencies, and transformation logic
• Participate in sprint ceremonies as part of a cross-functional scrum team

Do you have experience in SQL?