Senior Azure Data Engineer

Senior Azure Data Engineer
Hybrid - Work From Home and West London
Circ £70,000 - £80,000 + Range of benefits
A well-known and prestigious business is looking to add a Senior Azure Data Engineer to their data team. This is an exciting opportunity for a Data Engineer that's not just technical, but also enjoys directly engaging and collaborating with stakeholders from across business functions such as finance, operations, planning, manufacturing, retail, e-commerce etc. Having nearly completed the process of migrating data from their existing on-prem databases to an Azure Cloud based platform, the Senior Data Engineer will play a key role in helping make best use of the data by gathering and agreeing requirements with the business to build data solutions that align accordingly. Working with diverse data sets from multiple systems and overseeing their integration and optimisation will require raw development, management and optimisation of data pipelines using tools in the Azure Cloud. Our client has expanded rapidly and been transformed in recent years, they're an iconic business with a special work environment that's manifested a strong and positive culture amongst the whole workforce. This is a hybrid role where the postholder can work from home 2 or 3 days per week, the other days will be based onsite in West London just a few minutes walk from a Central Line tube station.
The key responsibilities for the post include;

• Develop, construct, test and maintain data architectures within large scale data processing systems.
  
• Develop and manage data pipelines using Azure Data Factory, Delta Lake and Spark.
  
• Utilise Azure Cloud architecture knowledge to design and implement scalable data solutions.
  
• Utilise Spark, SQL, Python, R, and other data frameworks to manipulate data and gain a thorough understanding of the dataset's characteristics.
  
• Interact with API systems to query and retrieve data for analysis.
  
• Collaborate with business users / stakeholders to gather and agree requirements.
  To be considered for the post you'll need at least 5 years experience ideally with 1 or 2 years at a senior / lead level. You'll need to be goal driven and able to take ownership of work tasks without the need for constant supervision. You'll be engaging with multiple business areas so the ability to communicate effectively to understand requirements and build trusted relationships is a must. It's likely you'll have most, if not all the following:
  
• Experience as a Senior Data Engineer or similar
  
• Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD.
  
• Experience with PySpark, Python, SQL and other data engineering development tools.
  
• Experience with metadata driven pipelines and SQL serverless data warehouses.
  
• Knowledge of querying API systems.
  
• Experience building and optimising ETL pipelines using Databricks.
  
• Strong problem-solving skills and attention to detail.
  
• Understanding of data governance and data quality principles.
  
• A degree in computer science, engineering, or equivalent experience.
  Salary will be dependent on experience and likely to be in the region of £70,000 - £80,000 although client may consider higher for outstanding candidate. Our client can also provide a vibrant, rewarding, and diverse work environment that supports career development.
  Candidates must be authorised to work in the UK and not require sponsoring either now or in the future. For further information, please send your CV to Wayne Young at Young's Employment Services Ltd. Young's Employment Services acts in the capacity of both an Employment Agent and Employment Business