Senior Data Engineer - Databricks

London
9 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer (AWS, Airflow, Python)

Senior Data Engineer (Microsoft Fabric)

Senior Data Engineer - (Python & SQL)

Senior Data Engineer / Consultant (Databricks)

Fully remote - UK

£70,(Apply online only),000 (DOE) + Excellent benefits

Data ignites passion, community fuels collaboration, and growth knows no bounds. Recognized for innovation and rapid growth, this esteemed Consultancy have been named Databricks EMEA Emerging Business Partner of the Year and achieved a second consecutive appearance on the Financial Times FT1000 list.

Looking for Senior Data Engineers to join remotely in the UK. Be the first to have an influential impact on the UK hub.

"As a Data Engineer, you will have the unique opportunity to push the boundaries of technology and lead the way in how data transforms the world. We work with customers who want to innovate and change their industries. So it never gets boring! Sorting out a complex technical puzzle, setting up a new data architecture from scratch, or guiding our customers through adopting the latest technologies is our routine here. Hence, we'd expect you to be more than just a (data) engineer. We'd expect you to breathe and live data, to thrive for knowledge and excellence, and to be keen to build something enduring and impactful for our customers."

Technical Expertise

  • You will have 5+ years of experience in Data Engineering, with a focus on cloud platforms ( ANY of the following: Azure, AWS, GCP)

  • You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog);

  • You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.);

  • You’re proficient in SQL and Python, using them to transform and optimize data like a pro;

  • You know your way around CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep);

  • You’ve hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker).

    Consulting & Client-Facing Skills

  • Proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders. I

  • You’ve successfully delivered projects like Data Lakehouse buildouts and cloud data migrations;

  • You excel in explaining technical concepts to non-technical audiences and drive decision-making.

    What they offer?

    You'll have the rare opportunity to join at a time when you can still meaningfully impact our growth trajectory and organizational success.

  • The chance to work remotely (European Travel to head office is there for the taking and a chance to spend time with others!)

  • World-class educational benefits - there’s no shortage of learning opportunities, meaning that you'll get access to Databricks' public and internal courses to learn all the tricks of Distributed Data Processing, MLOps, Apache Spark, Databricks, and Cloud Migration from the best. Additionally, we'll pay for various data & cloud certifications, you'll get dedicated time for learning during work hours, and access to our internal library;

  • Flexible Annual leave days - we’re flexible with how many days you take off if that does not conflict with customer success and the work getting done

  • 4 weeks of paternity leave - because we think it’s important for both parents to be there when it matters the most;

  • Employee Assistance Program (EAP) - life always happens! And we'd like to be there for you when it counts the most. Through EAP, we offer our employees access to psychology, financial, and legal consulting services via phone or in person;

  • Pension scheme enrollment and a comprehensive private health insurance plan

  • Top-notch working equipment - working comfortably means working well. You will get a MacBook Pro, a phone, and a sign-up bonus of 1000 GBP gross (to be paid with your first payroll) to set up your home office or whatever else is needed to give your best;

  • The chance to make an impact in a high-transparency culture - open feedback and no politics are things we value a lot. Additionally, you'll get the chance to work in the field of data & AI and shape the future of a rapidly growing tech company.

    Click 'Apply now' and share your CV.

    Interviews taking place from next week

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.