Description
Senior Azure Data Engineer (Azure Synapse) - London
Salary Negotiable to £70,000 DoE
Hybrid working with 2 days in London, the rest from home.
Job Reference: J12860
Working for an award-winning independent protection adviser, the role will focus on developing the organisation's data engineering capabilities. Data is a key enabler for the business and developing enterprise grade data engineering services is a central pillar in the digital transformation program. The data pipelines and models that you will develop will underpin all Business Intelligence, Machine Learning and CRM capabilities.
The role holder must ensure that the data is well-managed and ready for consumption by the business, which will require the integration of multiple data sources (both cloud and on-prem) and developing data transformations pipelines in an Azure Synapse environment. The role will be aligned to a specific area of the business, such as the digital teams or central data services and projects will be varied, for example building a new reporting data warehouse, creating a single view of the customer, measuring, improving data quality, and developing machine learning pipelines.
Key Accountabilities
·Shape the development and data engineering capabilities, with the ability to influence the direction of team, including ways of working, engineering principles, data governance and best practice.
·Become an SME on the design, development, and deployment of data ETL pipelines (using Azure Data Factory, Azure Synapse, Apache Spark and other technologies) to access, combine and transform data from on-prem and cloud-based sources.
·Ensure that all data pipelines are developing to a high standard, where possible adopting best practice engineering principals such as domain driven design, test driven development and clear separation of concerns.
·Maintain an effective backlog to ensure that engineering services are iteratively and incrementally developing in line with business needs and priorities.
·Help to shape the overall strategic data and analytical capabilities, as a senior member of data team you will need to help us adopt best practices and continuously improve data engineering standards across the team
·Help to manage key internal and external relationships, including Business end users, IT, Risk & Compliance, and data services providers. To achieve this the role holder will need to demonstrate proven stakeholder management experience.
·Develop complex data products and solutions, managing long running projects, multiple priorities, and balance the need for delivery over scalability
Experience & Skills Required
·Proven track record of developing data pipelines and products using Azure, Azure Synapse, Apache Spark, DevOps, Snowflake, Databricks and Fabric.
·High level of coding proficiency in SQL and Python.
·A good level of experience of Data Modelling and BI solutions is also required.
·Experience of Machine Learning Engineering and CRM are also highly desirable.
·Excellent communication and influencing skills
·Ability to think strategically and help develop the data strategy, whilst at the same time being hands on'.
Additional Requirements:
Candidates must have unrestricted, existing and future right to live and work in the UK.
