You will be instrumental in scaling the central data platform of a world class university working within a collaborative and dynamic team composed of Data Engineers and Business Intelligence Analysts. In this role you will craft enterprise-level Data Engineering solutions using Azure data engineering tools. Responsibilities include developing data-pipelines, supporting the Azure data platform and developing Imperial College London's data and analytics capabilities.

You will be hands on working with Azure Data Factory and Databricks to build end-to-end data pipelines, including writing quality code and adhering to guidelines.You will be working closely with other data engineers, product engineers, data analysts and business users.You will be driving best practices, standards, and naming conventions.You will be enhancing and maintaining the data platform.You will be ensuring that data quality, governance and security is in place.

Essentials

Expert skills in Azure Data Factory. Expert skills in utilising Databricks for data transformations. Extensive experience in coding in Python & PySpark programming language. Advanced SQL hands-on skills. Expert skills in building data pipelines. Experience in using RDBMS (SQL Server, . Good understanding of dimensional modelling (Star Schema). Experience working with DevOps solutions. Experience with Agile delivery methods. Willingness to continually learn and improve, including prototyping and testing new technologies and ways of working. Problem solver – seeking to find the right solution to deliver value. Clear communicator – both written and verbal.

Desirable

Experience in Lakehouse Architecture. Experience in Data Domain Architecture (or Data Mesh). Experience working with APIs. NoSQL database knowledge.

As a Senior Data Engineer there is the potential to be part of the delivery of an industry changing modern data platform The opportunity to continue your career at a world-leading institution and be part of our mission to continue science for humanity Benefit from sector-leading salary and remuneration package (including 39 days off a year and generous pension schemes) Get access to a range of workplace benefits including a flexible working policy from day 1, generous family leave packages, on-site leisure facilities and a cycle-to-work schemeInterest-free season ticket loan schemes for travel Be part of a diverse, inclusive, and collaborative work culture with various and resources designed to support your personal and professional .