Data Engineer Expert/Manager

Dufrain
Manchester
1 week ago
Applications closed

Related Jobs

View all jobs

Data Engineer

High Salary: Senior Data Engineer, Consultant...

Senior Data Engineer (Kafka Expert)

Lead Data Engineer

Data Engineer

Senior Data Engineer

Dufrain_LinkedIn_Banners_AW_5.jpg

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and enhancing real-time reporting.

Our Microsoft Data Engineering Practice delivers end-to-end data platforms and engineering pipelines across Microsoft Fabric, Azure Synapse Analytics and Azure Data Bricks, alongside strategic guidance and governance support across a wide range of industries.

As an expert Data Engineer Consultant, you’ll play a pivotal role in shaping Data Engineering strategy, mentor and manage delivery teams, driving platform adoption, and ensuring high-quality outcomes for our clients. This is an exciting opportunity for an experienced consultant who thrives on variety and strategic work but is still happy to get hands-on with all aspects of Data Engineering from Data Modelling and design through to developing in Spark and SQL.

Role Responsibilities 

  • Lead end-to-end Data Engineering solution delivery on complex engagements, ensuring technical excellence and business value.
  • Mentor and guide Data Engineering teams, fostering a culture of knowledge sharing, continuous improvement, and high-quality delivery.
  • Own and drive pre-sales engagements, collaborating with sales teams to develop compelling proposals and solutions.
  • Ensure best practices in data engineering, governance, security, and compliance.
  • Collaborate closely with clients to understand their business needs and translate them into robust technical solutions.
  • Act as a subject matter expert in Microsoft Fabric, advising both internal teams and clients on best practices and strategic implementations.
  • Conduct technical presentations, demonstrations, and workshops to showcase solutions to potential clients.
  • Foster a culture of innovation, collaboration, and continuous improvement within the team.
  • Facilitate requirements workshops and design sessions, engaging both technical and non-technical stakeholders to co-create solutions.
  • Support revenue generation and brand building activity, including presenting demos to external stakeholders and scoping client needs to support the commercial process.
  • Own and drive delivery plans, structuring high-quality work, managing risks and dependencies, and communicating effectively with senior stakeholders to ensure alignment with strategic goals.

Skills and experience required 

  • Proven experience in Data Engineering, with hands-on expertise with Spark (hands on experience of Microsoft Fabric is beneficial), some of which should be in a consulting professional services capacity.
  • Strong leadership skills, with experience managing teams in a consulting or enterprise environment.
  • Ability to drive and lead pre-sales discussions, including solution design, estimation, and proposal writing.
  • Extensive experience in designing and implementing data pipelines, data lakes, and data warehouses.
  • Strong knowledge of ETL processes, data modelling, and cloud-based solutions.
  • Excellent stakeholder management and communication skills.
  • Experience working with Azure Data Services, SQL, Python, and/or other relevant technologies.
  • Ability to thrive in a fast-paced environment and manage multiple projects simultaneously.

Desirable Qualifications:

  • Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
  • Microsoft Certified: Fabric Data Engineer Associate (DP-700)
  • Databricks Data Engineer Associate
  • Databricks Data Engineer Professional

What to do next

If you’re passionate about data, and you’re looking to join a leading data and analytics company based in the UK, you could find your dream role at Dufrain.

Please submit your CV highlighting your relevant experience and certifications. Applicants must have the right to work in the UK and not require sponsorship now or in the future.Visa sponsorship is not available.

We are an equal opportunity employer and value diversity at our company.. We do not discriminate on the basis of race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other status protected by law. All qualified applicants will receive consideration for employment without regard to these factors. We encourage applications from individuals of all backgrounds and experiences.


Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Quantum-Enhanced Machine Learning—Propelling AI into the Next Frontier

Machine learning (ML) has revolutionised how we interpret data, build predictive models, and create intelligent applications. From recommendation engines and self-driving cars to advanced genomics and natural language processing, ML solutions are integral to nearly every corner of modern life. However, as data complexity and model size continue to skyrocket, the computational demands placed on ML systems grow in tandem—often pushing even high-performance classical computers to their limits. In recent years, quantum computing has emerged as a tantalising solution to these challenges. Unlike traditional digital systems, quantum computers exploit quantum mechanics—superposition and entanglement—to process information in ways that defy conventional logic. As these machines mature, they promise exponential speed-ups for certain tasks, potentially reshaping how we approach AI and data-intensive challenges. What does this mean for machine learning? Enter quantum-enhanced ML, a new frontier where quantum processors and classical ML frameworks unite to accelerate model training, tackle high-dimensional data, and solve complex optimisation tasks more efficiently. In this article, we will: Unpack the current state of machine learning, highlighting key bottlenecks. Provide a concise overview of quantum computing—why it’s radical and how it differs from classical technology. Examine potential breakthroughs in quantum-enhanced ML, including real-world use cases and technical approaches. Explore the roles and skill sets that will define this quantum-AI era, with guidance on how to prepare. Discuss the roadblocks (like hardware maturity and ethical concerns) and how they might be addressed in the years to come. If you’re a machine learning engineer, data scientist, or simply an AI enthusiast fascinated by the next wave of computational innovation, read on—quantum computing could become an integral part of your future toolkit, opening up job opportunities and reimagining what ML can achieve.

Machine Learning Jobs at Newly Funded UK Start-ups: Q3 2025 Investment Tracker

Machine learning (ML) has become the beating heart of modern tech innovation, powering breakthroughs in healthcare, finance, cybersecurity, robotics, and more. Across the United Kingdom, this surge in ML-driven solutions is fueling the success of countless start-ups—and spurring demand for talented machine learning engineers, data scientists, and related professionals. If you’re eager to join a high-growth ML company or simply want to keep tabs on the latest trends, this Q3 2025 Investment Tracker will guide you through the newly funded UK start-ups pushing the boundaries of ML. In this article, we’ll highlight key developments from Q3 2025, delve into the most promising newly funded ventures, and shed light on the machine learning roles they’re urgently seeking to fill. Plus, we’ll show you how to connect with these employers via MachineLearningJobs.co.uk, a dedicated platform for ML job seekers. Let’s dive in!

Portfolio Projects That Get You Hired for Machine Learning Jobs (With Real GitHub Examples)

In today’s data-driven landscape, the field of machine learning (ML) is one of the most sought-after career paths. From startups to multinational enterprises, organisations are on the lookout for professionals who can develop and deploy ML models that drive impactful decisions. Whether you’re an aspiring data scientist, a seasoned researcher, or a machine learning engineer, one element can truly make your CV shine: a compelling portfolio. While your CV and cover letter detail your educational background and professional experiences, a portfolio reveals your practical know-how. The code you share, the projects you build, and your problem-solving process all help prospective employers ascertain if you’re the right fit for their team. But what kinds of portfolio projects stand out, and how can you showcase them effectively? This article provides the answers. We’ll look at: Why a machine learning portfolio is critical for impressing recruiters. How to select appropriate ML projects for your target roles. Inspirational GitHub examples that exemplify strong project structure and presentation. Tangible project ideas you can start immediately, from predictive modelling to computer vision. Best practices for showcasing your work on GitHub, personal websites, and beyond. Finally, we’ll share how you can leverage these projects to unlock opportunities—plus a handy link to upload your CV on Machine Learning Jobs when you’re ready to apply. Get ready to build a portfolio that underscores your skill set and positions you for the ML role you’ve been dreaming of!