Senior Data Engineer

Key aspects of the role include:

• Data Pipeline Development: Architect, develop, and optimise data extraction, transformation, and loading (ETL) processes for high-volume healthcare data.
• Integration of NHS Systems Data: Work directly with NHS data sources and ensure seamless integration of systems like UDAL, NCDR, SUS+, HES, and ODS into our analytics platform.
• System Performance: Monitor and enhance the performance of our data systems to ensure reliability and responsiveness.
• Collaboration: Partner with data scientists, analysts, and stakeholders to ensure that data solutions align with business needs and analytic strategies.
• Scalability & Security: Implement and enforce best practices for data security, quality, and scalability across our data infrastructure.

Essential Skills:

• Healthcare Data Expertise: Proven experience in designing and managing data solutions within healthcare environments. Demonstrated ability to work with NHS systems—such as UDAL, NCDR, SUS+, HES, and ODS—and to address the unique challenges these datasets present.
• Data Engineering Proficiency: Advanced proficiency in building and maintaining robust data pipelines using ETL tools and frameworks. Familiarity with data warehousing concepts and experience in developing scalable, high-performance data architectures.
• Technical Expertise: Strong command of SQL and scripting languages, along with experience in programming languages such as Python or Java. Experience with the Microsoft Azure ecosystem is essential, including proficiency with Azure Data Factory and Databricks, as these tools are integral to managing data within the UDAL platform.
• Data Quality and Governance: Experience in implementing data quality controls, data cleansing routines, and establishing governance frameworks to ensure data integrity and compliance with data security standards.
• Collaboration and Communication: Excellent communication skills with the ability to translate complex technical concepts to non-technical stakeholders. Proven experience working in cross-functional teams to deliver data-driven insights that support healthcare decision-making.

Desirable Skills:

• Advanced Analytics Integration: Experience integrating data engineering workflows with analytics platforms, including familiarity with business intelligence tools (e.g., Power BI, Tableau) and predictive analytics.
• Regulatory and Compliance Knowledge: Awareness of industry standards and regulations, particularly those applicable to healthcare data, with an emphasis on data privacy and security (e.g., GDPR, NHS Digital guidelines).
• Educational Background: Degree or equivalent in Computer Science, Data Engineering, or a related technical field; professional qualifications or certifications in data engineering or cloud technologies are a plus.