You will be instrumental in scaling the central data platform of a world class university working within a collaborative and dynamic team composed of Data Engineers and Business Intelligence Analysts. In this role you will craft enterprise-level Data Engineering solutions using Azure data engineering tools. Responsibilities include developing data-pipelines, supporting the Azure data platform and developing Imperial College London's data and analytics capabilities.
You will be hands on working with Azure Data Factory and Databricks to build end-to-end data pipelines, including writing quality code and adhering to guidelines.You will be working closely with other data engineers, product engineers, data analysts and business users.You will be driving best practices, standards, and naming conventions.You will be enhancing and maintaining the data platform.You will be ensuring that data quality, governance and security is in place.
Essentials
Expert skills in Azure Data Factory. Expert skills in utilising Databricks for data transformations. Extensive experience in coding in Python & PySpark programming language. Advanced SQL hands-on skills. Expert skills in building data pipelines. Experience in using RDBMS (SQL Server, . Good understanding of dimensional modelling (Star Schema). Experience working with DevOps solutions. Experience with Agile delivery methods. Willingness to continually learn and improve, including prototyping and testing new technologies and ways of working. Problem solver – seeking to find the right solution to deliver value. Clear communicator – both written and verbal.Desirable
Experience in Lakehouse Architecture. Experience in Data Domain Architecture (or Data Mesh). Experience working with APIs. NoSQL database knowledge.
As a Senior Data Engineer there is the potential to be part of the delivery of an industry changing modern data platform The opportunity to continue your career at a world-leading institution and be part of our mission to continue science for humanity Benefit from sector-leading salary and remuneration package (including 39 days off a year and generous pension schemes) Get access to a range of workplace benefits including a flexible working policy from day 1, generous family leave packages, on-site leisure facilities and a cycle-to-work schemeInterest-free season ticket loan schemes for travel Be part of a diverse, inclusive, and collaborative work culture with various and resources designed to support your personal and professional .
The latest news, articles, and resources, sent to your inbox weekly.
Data Engineer4 Month ContractLocation: Home / Corsham (2 days a week)Rate: £550 - £600 per day (Inside IR35)Skills: Postgres SQL, SQL Stored Procedures, Power BI, SSIS, SC ClearanceWe are looking to recruit an SC Cleared Data Engineer for a global software and solutions organisation. This is an initial 4 month...
Corsham
Data Engineer - London - AWS - Up to 70,000 + BenefitsExciting opportunity to work with a forward thinking company who offer their employers the chance to work with cutting edge tech, grow their skills with fully-costed training programs, maintain a healthy work-life balance with modern working arrangements - up...
City of London
Job Title: Data EngineerLocation: LimerickSalary: €(phone number removed) (DOE)HybridReperio have partnered with a small, but high-performing MedTech company who are on the lookout for Data Engineers to join their growing Data department. As a Data Engineer, you will play a crucial role in designing, building, and maintaining scalable data pipelines...
Limerick
This is a fantastic opportunity to work as a Data Engineer, on a long term contract, inside IR35, requiring 2 days per month in Swansea.It's important to note that this Data Engineer role will require 2 days per month on site in Swansea.The key skills required for this Data Engineer...
Mynyddbach Community
Contract Data Engineer (6 Months) - Azure Azure, Azure Functions, ADF, Azure databricks, PowerBi We are seeking an experienced Data Engineer for a 6-month contract to design, develop, and deploy scalable, secure Azure solutions. This role offers the opportunity to work on cutting-edge cloud technologies and contribute to key business...
Northampton
Data EngineerPermanentLocation: Home / Brighton (on site 6 days a month)Salary: £50,000 - £60,000 (+ excellent benefits including 28% employer pension contributions, + bonus)Skills: Cloud Data Platforms (Azure preferred), SQL, Azure Data Factory, AgileWe are looking to recruit a Data Engineer for a technology driven public sector organisation based in...
Brighton
