Senior Data Engineer - Platforms and Tooling

The Home Office works to build a safe, fair and prosperous UK. We achieve this through our work on counter-terrorism, policing, crime, drugs policy, immigration and passports.

The Science, Technology, Research and Analysis (STAR) Group sits at the heart of the Home Office. The group ensures the best evidence and analysis are used to address the strategic issues facing the department. We also provide the science, technology, data, and international insights and collaboration capabilities to drive delivery.

As part of the Home Office Analysis & Insight (HOAI) directorate, the Performance Reporting & Analysis Unit (PRAU) is responsible for delivering comprehensive reporting and performance analysis to support the Migration & Borders Mission and its operational capabilities. The Unit provides management information (MI) to Ministers, the Executive Committee, policy and operational leads, and analytical teams ensuring they have the data required for informed decision-making. Additionally, PRAU produces data for publication and external dissemination. The Unit offers expert advice across the Department on optimising the use of performance information and plays a leading role in the ongoing transformation of MI systems and capabilities.

Within the Migration & Borders Mission and Capabilities, PRAU is spearheading a significant transformation in technology and processes to enhance the delivery of MI services. This initiative focuses on three primary areas for the development of MI services:

• Data Engineering teams responsible for ingesting complex datasets and applying business rules,
• MI teams aligned with the Mission and Capabilities, delivering MI services to those specific domains,
• A central “hub” functioning as a centre of excellence, offering guidance, setting standards, and providing technology and support to both Data Engineering and MI-producing teams.

The new position within this group will supervise data engineering activities necessary for maintaining and advancing the software platforms integral to the MI Service. This includes enabling the integration of new data sources and managing the monitoring of existing data feeds, utilization, and governance., Key responsibilities include day-to-day system monitoring and troubleshooting, system administration, and leadership on engineering projects aimed at improving the functionality of existing tools and systems. As part of a growing team, this role presents an opportunity to influence best practices across the unit and department. Flexibility will be critical to effectively support and advocate for this transformation, alongside fulfilling the specific duties outlined below.

In addition, the department intends to transition from legacy tools to Microsoft Fabric. You will contribute to the design, migration, and ongoing management of a major government platform leveraging this evolving suite of technologies.

As a Senior Data Engineer in the Platforms and Tooling team, you will maintain, manage and upgrade the Vantage MI platform with modern cloud technologies such as Microsoft Azure Synapse, SQL, Power BI and Microsoft Fabric.

You will be a key team member, responsible for supervising:

• Technical Administration.
• Analytics and MI platform upgrades, efficiency and innovation.
• Day-to-day issue management and resolution.
• Help to inform the Tooling and Data Strategies.

You will establish and detail key support processes which enable the Platforms and Tooling team to scale and automate their system maintenance and support activities, improving the service for our end users and developers. The MI Platforms and Tooling team will collaborate closely with colleagues in PRAU and Home Office Digital, and with teams elsewhere in the Department.

Your main day-to-day responsibilities will be:

• Designing, building and maintaining cloud platforms and tools to enable MI teams to work effectively.
• Working with engineering teams to ensure that MI platforms and tooling are integrated with other systems and that they are compliant with security and regulatory standards.
• Work with the 1st and 2nd line support teams to handle incidents that they pass to your team and proactively monitor common issues with a view to resolving the underlying cause.
• Document key platform and tooling configurations and procedures.
• Provide technical support and deliver training to help other engineers deploy high quality MI services.
• Develop monitoring and observability tools to agreed standards for both technical and non-technical stakeholders and consumers.
• Adhere to an ‘accessible by default’ approach in all delivery and documentation activities, working closely with colleagues to implement and enforce accessibility across Power BI reporting and supporting documentation.
• Supporting colleagues with the broader rollout and adoption of MS Power BI across the organisation.
• Work with the wider organisation to enable the ingestion of data into the Vantage platform from various sources, in a secure and cost-effective way.
• Supporting in the successful delivery of completed data loads for customers, Data Engineers and Data Scientists and assisting in the development of new data load programmes.
• Identifying areas for cost savings and/or greater efficiency.

Working Pattern

PRAU is geographically spread across four primary locations (London, Liverpool, and Sheffield and Croydon), with most staff working in line with the Department’s hybrid working arrangements which would see the post holder spend 60% of their week in the office.

This role is available on a full-time basis with the option of compressed hours working. This role is also suitable for part-time working hours, with a minimum requirement to work 4 days /30 hours per week due to business requirements., We'll assess you against these technical skills during the selection process:

• Strategy and Planning Innovation (INOV) – Level 3
• Methods and Tools (METL) – Level 3
• Data Management (DATM) – Level 3
• Data Modelling and Design (DTAN) – Level 3
• Database Design (DBDS) – Level 3
• Data Engineering (DENG) – Level 3

Benefits

In addition to your salary, a career with the Home Office offers a range of benefits, including:

• A Civil Service pension with an employer contribution of 28.97%.
• In-year reward scheme for one-off or sustained exceptional personal or team achievements.
• 25 days annual leave on appointment, rising with service to 30 days.
• Eight days of public holidays, plus one additional privilege day.
• Where business needs allow, some roles may be suitable for a combination of office and home-based working. This is a non-contractual arrangement where all employees will be expected to spend a minimum of 60% of their working time in an office.
• The advertised role is part of the Home Office Government Digital and Data Profession. This role has access to a Digital Capability-Based Allowance. Applicants who are successful at interview will be invited to complete a Capability and Skills Assessment post-interview. Any allowance awarded will be based on the assessment of your capability against the six skills advertised for this role. Please see the Home Office Pay Framework Allowance Careers page for more information.
• The allowance values are set by the Home Office, subject to remaining in a qualifying role, and are non-pensionable. This allowance is non-contractual, subject to an annual review and could be withdrawn at any time.
• For both new entrants and existing civil servants, the total compensation offer is a combination of base salary and, if applicable, a capability-based allowance. New entrants to the Civil Service will start on the pay range minimum. For existing civil servants, our policies on level transfer and promotion will apply.
• See more of our benefits on our careers website.
• Sign-up on our website to receive emails with information about careers at the Home Office., All Civil Servants are expected to comply with the Civil Service Code, and its core values of integrity, honesty, objectivity and impartiality.

Additional Security Checks

As well as successfully obtaining UK Security Vetting clearance, candidates will be subject to a range of additional checks. The range of checks carried out will depend on whether you are a current Home Office employee, existing civil servant or an external new entrant as well as the role requirements. The level of Criminal Record Check required for this role is [Basic] . Further details are included in the Notes to Candidates.

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service on your behalf. However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct.

If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading.

Reasonable Adjustments

If a person with disabilities is at a substantial disadvantage compared to a non-disabled person, we have a duty to make reasonable changes to our processes.

If you need a change to be made so that you can make your application, you should:

• Contact Government Recruitment Service via HOrecruitment.grs@cabinetoffice.gov.uk as soon as possible before the closing date to discuss your needs
• Complete the “Assistance Required” section in the “Additional Requirements” page of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you're deaf, a language service professional

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the ‘Contact point for applicants’ section.

Feedback Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check .

See our vetting charter . People working with government assets must complete baseline personnel security standard (opens in new window) checks., * UK nationals

• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Do you have experience in SQL?, You’ll have a demonstrable passion for Data, with the following skills or some experience in:

• Automating repetitive tasks via programming or low/no-code automation tools.
• Working as part of a team delivering technical products to a varied user base.
• The delivery of projects in data analysis, solution design and end user reporting.
• Automation of tasks or development in Power Bi, Azure Automation, Azure Data Factory, Azure DevOps, or Microsoft Fabric.
• Leveraging modern open-source programming languages, such as Python to develop and deliver high-quality data development and engineering solutions.
• Effectively managing and communicating with non-technical and senior stakeholders about performance and analysis.
• Applying data development / engineering techniques such as continuous improvement/continuous development – both in theory and practice or a strong aptitude to learn.
• Identifying, diagnosing and resolving issues with consideration for their wider impact on other teams and customers.
• Effective line management is required for this role.

Desirable criteria

Ideally, you will also have the following skills or experience in:

• Working with modern tools and data stores such as Microsoft Synapse, Fabric and Data Factory.
• Using modern / open source programming languages and tools – including to deliver data development / engineering products such as Power BI (DAX / query M) & Python/PySpark.
• The skills listed above are reflective of the Home Office Digital Data and Technology (DDaT) Profession Skills and Competency Model (based on the industry standard v8 SFIA framework). The list represents desirable skills that the role will work towards developing, not all skills are expected from the outset., * Changing and Improving
• Communicating and Influencing
• Making Effective Decisions, If you are successful at sift stage, you will be invited to an interview that will be Technical Skills based questions, Behaviours based questions, Strength based questions (no preparation needed).

If you feel that your application has not been treated in accordance with the Civil Service recruitment principles and you wish to make a complaint, then contact the Government Recruitment Service via HOrecruitment.grs@cabinetoffice.gov.uk. If you are not satisfied with the response that you receive, then you can contact the Civil Service Commission.