Azure Data Engineer

Reading
3 weeks ago
Applications closed

Related Jobs

View all jobs

Azure Data Engineer

Azure Data Engineer - ADF, Snowflake - £425pd inside IR35

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer, Manchester

Azure Data Engineer

Azure Data Engineer

Reading – 1 day a week

£(Apply online only) per day inside IR35

About the Role:
We are seeking a highly skilled Data Engineer with strong expertise in Microsoft Azure, Databricks and SQL to join our data engineering team. This role requires someone who is proactive, solution-oriented, and able to work autonomously within a busy team environment. You will play a crucial role in structuring and integrating core data systems, ensuring high-quality data flows into and out of our Master Data Management (MDM) platform.

This is a fantastic opportunity to join a business that has just secured £50 million in investment and are working on a huge utilities project of national importance. This consultancy is building an elite team of data professionals, already outpacing competitors in the data consultancy space.

📌 Contract or Permanent – Your Choice

  • Initial 6-month inside IR35 contract, but huge opportunity to stay for longer as this is a multi-year project with huge growth potential

  • Option to go perm if you want long-term stability

    Key Responsibilities:

  • Azure Data Engineering: Utilize Azure services to manage data pipelines, storage, and processing. Work with Azure Data Lake, Synapse Analytics, and other relevant Azure tools.

  • MDM Integration: Ensure data is structured and processed correctly within the MDM platform to produce a golden set of data assets, which serve as an enhanced and high-quality version of source data.

  • Data Quality & Analytics: Implement data quality measurement processes, generating analytics to feed into dashboarding and reporting solutions.

  • Multi-Source Data Processing: Handle data from four primary sources, managing its ingestion through the data lake, transforming it in Prophecy, applying data quality rules, and enriching it with additional insights.

  • Data Pipeline Development: Build and maintain scalable ETL/ELT pipelines to facilitate efficient data flow across the platform.

  • Exception Reporting: Develop and maintain exception reporting to monitor inbound data quality and identify discrepancies.

  • Collaboration & Autonomy: Work efficiently within a busy team where full support may not always be available, requiring a proactive and forward-thinking approach to problem-solving.

    Required Skills & Experience:

  • Proven experience as a Data Engineer, with a strong focus on MS Azure, Databricks and SQL.

  • Expertise in Azure Data Factory, Synapse, Data Lake, and Prophecy (or similar tools).

  • Experience working with Master Data Management (MDM) systems and structuring data for optimal integration.

  • Strong knowledge of ETL/ELT pipeline development and data transformation best practices.

  • Proficiency in data quality assurance, analytics, and exception handling.

  • Ability to work independently, problem-solve proactively, and drive improvements in data processes.

  • Understanding of property data assets and their integration from multiple sources is a plus.

    Preferred Qualifications:

  • Certifications in Microsoft Azure (e.g., Azure Data Engineer Associate)

  • Experience with big data technologies and cloud-based data warehousing solutions.

  • Familiarity with Power BI or other visualization tools for data analytics.

    Data Engineer / Senior Data Engineer / Principal Data Engineer / Data Architect

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Leadership for Managers: Strategies to Motivate, Mentor, and Set Realistic Goals in Data-Driven Teams

Machine learning (ML) has become an indispensable force in the modern business world, influencing everything from targeted marketing campaigns to advanced medical diagnostics. As industries integrate predictive algorithms and data-driven decision-making into their core operations, the need for effective leadership in machine learning environments has never been greater. Whether you’re overseeing a small team of data scientists or spearheading an enterprise-scale ML project, your leadership style must accommodate rapid innovation, complex problem-solving, and diverse stakeholder expectations. This guide provides actionable insights into how you can motivate, mentor, and establish achievable goals for your machine learning teams—ensuring they thrive in data-driven environments.

Top 10 Books to Advance Your Machine Learning Career in the UK

Machine learning (ML) remains one of the fastest-growing fields within technology, reshaping industries across the UK from finance and healthcare to e-commerce, telecommunications, and beyond. With increasing demand for ML specialists, job seekers who continually update their knowledge and skills hold a significant advantage. In this article, we've curated ten essential books every machine learning professional or aspiring ML engineer in the UK should read. Covering foundational theory, practical implementations, advanced techniques, and industry trends, these resources will equip you to excel in your machine learning career.

Navigating Machine Learning Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Machine learning (ML) has swiftly become one of the most in-demand skill areas across industries, with companies leveraging predictive models and data-driven insights to solve challenges in healthcare, finance, retail, manufacturing, and beyond. Whether you’re an early-career data scientist aiming to break into ML, a seasoned engineer branching into deep learning, or a product manager exploring AI-driven solutions, machine learning career fairs offer a powerful route to connect with prospective employers face-to-face. Attending these events can help you: Network with hiring managers and technical leads who make direct recruitment decisions. Gain insider insights on the latest ML trends and tools. Learn about emerging job roles and new industry verticals adopting machine learning. Showcase your interpersonal and communication skills, both of which are increasingly important in collaborative AI/ML environments. However, with many applicants vying for attention in a bustling hall, standing out isn’t always easy. In this detailed guide, we’ll walk you through how to prepare meticulously, pitch yourself confidently, ask relevant questions, and follow up effectively to land the machine learning opportunity that aligns with your ambitions.