National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Data Engineer Expert/Manager

Dufrain
Edinburgh
1 month ago
Create job alert

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and enhancing real-time reporting.

Our Microsoft Data Engineering Practice delivers end-to-end data platforms and engineering pipelines across Microsoft Fabric, Azure Synapse Analytics and Azure Data Bricks, alongside strategic guidance and governance support across a wide range of industries.

As an expert Data Engineer Consultant, you’ll play a pivotal role in shaping Data Engineering strategy, mentor and manage delivery teams, driving platform adoption, and ensuring high-quality outcomes for our clients. This is an exciting opportunity for an experienced consultant who thrives on variety and strategic work but is still happy to get hands-on with all aspects of Data Engineering from Data Modelling and design through to developing in Spark and SQL.

Role Responsibilities 




  • Lead end-to-end Data Engineering solution delivery on complex engagements, ensuring technical excellence and business value.
  • Mentor and guide Data Engineering teams, fostering a culture of knowledge sharing, continuous improvement, and high-quality delivery.
  • Own and drive pre-sales engagements, collaborating with sales teams to develop compelling proposals and solutions.
  • Ensure best practices in data engineering, governance, security, and compliance.
  • Collaborate closely with clients to understand their business needs and translate them into robust technical solutions.
  • Act as a subject matter expert in Microsoft Fabric, advising both internal teams and clients on best practices and strategic implementations.
  • Conduct technical presentations, demonstrations, and workshops to showcase solutions to potential clients.
  • Foster a culture of innovation, collaboration, and continuous improvement within the team.
  • Facilitate requirements workshops and design sessions, engaging both technical and non-technical stakeholders to co-create solutions.
  • Support revenue generation and brand building activity, including presenting demos to external stakeholders and scoping client needs to support the commercial process.
  • Own and drive delivery plans, structuring high-quality work, managing risks and dependencies, and communicating effectively with senior stakeholders to ensure alignment with strategic goals.

Skills and experience required 


  • Proven experience in Data Engineering, with hands-on expertise with Spark (hands on experience of Microsoft Fabric is beneficial), some of which should be in a consulting professional services capacity.
  • Strong leadership skills, with experience managing teams in a consulting or enterprise environment.
  • Ability to drive and lead pre-sales discussions, including solution design, estimation, and proposal writing.
  • Extensive experience in designing and implementing data pipelines, data lakes, and data warehouses.
  • Strong knowledge of ETL processes, data modelling, and cloud-based solutions.
  • Excellent stakeholder management and communication skills.
  • Experience working with Azure Data Services, SQL, Python, and/or other relevant technologies.
  • Ability to thrive in a fast-paced environment and manage multiple projects simultaneously.

Desirable Qualifications:


  • Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
  • Microsoft Certified: Fabric Data Engineer Associate (DP-700)
  • Databricks Data Engineer Associate
  • Databricks Data Engineer Professional

What to do next

If you’re passionate about data, and you’re looking to join a leading data and analytics company based in the UK, you could find your dream role at Dufrain.

Please submit your CV highlighting your relevant experience and certifications. Applicants must have the right to work in the UK and not require sponsorship now or in the future.Visa sponsorship is not available.

We are an equal opportunity employer and value diversity at our company.. We do not discriminate on the basis of race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other status protected by law. All qualified applicants will receive consideration for employment without regard to these factors. We encourage applications from individuals of all backgrounds and experiences.


Related Jobs

View all jobs

Data Engineer

Principal Data Engineer

(Senior) Lead Data Engineer

GCP Data Engineer

Data Engineer

Data Engineer

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Return-to-Work Pathways: Relaunch Your Machine Learning Career with Returnships, Flexible & Hybrid Roles

Returning to work after an extended break can feel like starting from scratch—especially in a specialist field like machine learning. Whether you paused your career for parenting, caring responsibilities or another life chapter, the UK’s machine learning sector now offers a variety of return-to-work pathways. From structured returnships to flexible and hybrid roles, these programmes recognise the transferable skills and resilience you’ve developed, pairing you with mentorship, upskilling and supportive networks to ease your transition back. In this guide, you’ll discover how to: Understand the current demand for machine learning talent in the UK Leverage your organisational, communication and analytical skills in ML contexts Overcome common re-entry challenges with practical solutions Refresh your technical knowledge through targeted learning Access returnship and re-entry programmes tailored to machine learning Find roles that fit around family commitments—whether flexible, hybrid or full-time Balance your career relaunch with caring responsibilities Master applications, interviews and networking specific to ML Learn from inspiring returner success stories Get answers to common questions in our FAQ section Whether you aim to return as an ML engineer, research scientist, MLOps specialist or data scientist with an ML focus, this article will map out the steps and resources you need to reignite your machine learning career.

LinkedIn Profile Checklist for Machine Learning Jobs: 10 Tweaks to Drive Recruiter Interest

The machine learning landscape is rapidly evolving, with demand soaring for experts in modelling, algorithm tuning and data-driven insights. Recruiters hunt for candidates proficient in Python, TensorFlow, PyTorch and MLOps processes. A generic profile simply won’t cut it. Our step-by-step LinkedIn for machine learning jobs checklist covers 10 targeted tweaks to ensure your profile ranks in searches and communicates your technical impact. Whether launching your ML career or seeking leadership roles, these optimisations will sharpen your professional narrative and boost recruiter engagement.

Part-Time Study Routes That Lead to Machine Learning Jobs: Evening Courses, Bootcamps & Online Masters

Machine learning—a subset of artificial intelligence—enables computers to learn from data and improve over time without explicit programming. From predictive maintenance in manufacturing to recommendation engines in e-commerce and diagnostic tools in healthcare, machine learning (ML) underpins many of today’s most innovative applications. In the UK, demand for ML professionals—engineers, data scientists, research scientists and ML operations specialists—is growing rapidly, with roles projected to increase by over 50% in the next five years. However, many aspiring ML practitioners cannot step away from work or personal commitments for full-time study. Thankfully, a rich ecosystem of part-time learning pathways—Evening Courses, Intensive Bootcamps and Flexible Online Master’s Programmes—empowers you to learn machine learning while working. This comprehensive guide examines each route: foundational CPD units, immersive bootcamps, accredited online MSc programmes, funding options, planning strategies and a real-world case study. Whether you’re a software developer branching into ML, a statistician aiming to upskill, or a professional exploring AI-driven innovation, you’ll discover how to build in-demand ML expertise on your own schedule.