Data Engineer - Databricks

Dufrain
London, England
11 months ago
Applications closed

Related Jobs

View all jobs
Spotlight

Machine Learning Engineer - National Security (Gloucestershire)

Mind Foundry Gloucester, Gloucestershire, United Kingdom
On-site Clearance Required
Spotlight

Senior ML Compiler Engineer

Fractile Bristol, United Kingdom

Data Engineer

Relation Therapeutics London, United Kingdom
Permanent

Data Engineer, Strategic Account Services

Amazon London, United Kingdom
Permanent

Senior Data Engineer

Synthesia London, United Kingdom
Hybrid

Senior Research Engineer - Data

Synthesia London, United Kingdom
Remote

Senior Simulation Data Engineer

PhysicsX London, United Kingdom

ML Engineer

Data Idols Farringdon, Greater London, London, EC1M 4BJ, United Kingdom
£60,000 – £65,000 pa Hybrid
Posted
2 Jul 2025 (11 months ago)

AtDufrain, we don't just build data solutions-we shape the future of data-driven decision-making. Do you thrive on solving complex challenges and turning data into powerful insights that drive transformation?

We're looking forData Engineerswho havea broad range of data engineering skills, with a focus onMicrosoft Databricks.Experience withMicrosoft FabricorSnowflakeis also highly desirable.

ABOUT THE ROLE

As a Data Engineer, you will play a key role in delivering high-quality data solutions for our clients. This role offers the opportunity to work across a variety of technologies and contribute to the growth of our Consulting practice.

ROLE RESPONSIBILITIES

  • Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues.
  • Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment.
  • Delivering high-quality pieces of work, proven ability to escalate problems to client / senior team members where necessary and propose possible solutions.
  • Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge-sharing activities, and data services.

ESSENTIAL TECHNICAL SKILLS REQUIRED

We are looking for a technically skilled data professional with a strong foundation in modern data platforms and engineering practices. Key technical competencies include:

  • Databricks Platform Expertise: Proven experience designing and delivering data solutions using Databricks on Azure or AWS.
  • Databricks Components: Proficient in Delta Lake, Unity Catalog, MLflow, and other core Databricks tools.
  • Programming & Query Languages: Strong skills in SQL and Apache Spark (Scala or Python).
  • Relational Databases: Experience with on-premises and cloud-based SQL databases.
  • Data Engineering Techniques: Skilled in Data Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data Management, and Business Intelligence.
  • Engineering Delivery Practices: Solid understanding of Agile, DevOps, Git, APIs, Containers, Microservices, and Data Pipelines.
  • Modern Data Tools: Experience with Kafka, Snowflake, Azure Data Factory, Azure Synapse, or Microsoft Fabric (highly desirable).
  • Data Architecture Frameworks: Knowledge of Inmon, Kimball, and Data Vault methodologies.

Nice to have certifications

  • Databricks Certified Data Engineer Associate
  • Databricks Certified Data Engineer Professional

ABOUT YOU

You're not just a data expert-you're a problem solver, a collaborator, and a forward-thinker. You will be someone who:

  • Brings energy, focus, and a drive to meet ambitious deadlines.
  • Delivers insightful, practical solutions that go beyond the obvious.
  • Communicates confidently with senior stakeholders and contributes meaningfully to strategic conversations.
  • Thrives in a team environment, sharing knowledge and supporting others.
  • Works independently with initiative and resilience under pressure.
  • Takes ownership of deliverables and consistently produces high-quality output.
  • Adapts easily to working solo or as part of a dynamic, integrated team.
  • Stays ahead of industry trends, standards, and regulatory developments.

If you're passionate about data, and you're looking to join a leading data and analytics company based in the UK, you could find your dream role at Dufrain.

Please submit your CV highlighting your relevant experience and certifications. Applicants must have the right to work in the UK and not require sponsorship now or in the future.Visa sponsorship is not available.

We are an equal opportunity employer and value diversity at our company.. We do not discriminate on the basis of race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other status protected by law. All qualified applicants will receive consideration for employment without regard to these factors. We encourage applications from individuals of all backgrounds and experiences.

Department Consulting Locations London, Edinburgh, Manchester Remote status Hybrid
#J-18808-Ljbffr

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Where to Advertise Machine Learning Jobs in the UK (2026 Guide)

Advertising machine learning jobs in the UK requires a different approach to most technical hiring. The candidate pool is small, highly specialised and in demand across AI labs, financial services, healthcare, autonomous systems and consumer technology simultaneously. Machine learning engineers and researchers move between roles through professional networks, conference communities and specialist platforms — not general job boards where ML roles compete with unrelated software engineering positions for the same audience. This guide, published by MachineLearningJobs.co.uk, covers where to advertise machine learning roles in the UK in 2026, how the main platforms compare, what employers should expect to pay, and what the data says about hiring across different role types.

Machine Learning Jobs UK 2026: What to Expect Over the Next 3 Years

Machine learning has undergone a transformation that few technology disciplines can match. In the space of three years it has moved from a specialism sitting at the edges of most organisations' technology strategies to a capability that sits at the centre of them. The tools have changed, the expectations have shifted, and the range of industries treating machine learning as a core business function — rather than an experimental one — has expanded dramatically. For job seekers, this creates both opportunity and complexity in roughly equal measure. The machine learning jobs market of 2026 is significantly larger than it was three years ago, but it is also significantly more demanding. Employers have developed more sophisticated expectations, the technical bar for specialist roles has risen, and the landscape of tools, frameworks, and architectural patterns that practitioners are expected to know has broadened considerably. The candidates who will thrive over the next three years are those who understand where the discipline is heading — which specialisms are attracting the most investment, which technologies are reshaping what machine learning engineers and researchers are expected to build, and how the definition of a machine learning career is evolving beyond the model-building core toward a much wider range of roles across the full ML lifecycle. This article breaks down what the UK machine learning jobs market is likely to look like through to 2028 — covering the titles emerging right now, the technologies driving employer demand, the skills that will matter most, and how to position your career ahead of the curve.

New Machine Learning Employers to Watch in 2026: UK and Global Companies Driving ML Innovation

Machine learning (ML) has transitioned from a specialised field into a core business capability. In 2026, organisations across healthcare, finance, robotics, autonomous systems, natural language processing, and analytics are expanding their machine learning teams to build scalable intelligent products and services. For professionals exploring opportunities on www.MachineLearningJobs.co.uk , understanding the companies that are scaling, winning investment, or securing high‑impact contracts is crucial. This article highlights the new and high‑growth machine learning employers to watch in 2026, focusing on UK innovators, international firms with significant UK presence, and global platforms investing in machine learning talent locally.