Databricks Data Engineer

EXL
Manchester
2 months ago
Applications closed

Related Jobs

View all jobs

Databricks SME and AWS Data Engineer

Data Engineering Product Owner, Technology, Data Bricks, Microsoft

Data Engineering Product Owner, Technology, Data Bricks, Microsoft

Lead Data Engineer - Databricks

Data Engineer

Lead Data Engineer

Join to apply for the Databricks Data Engineer role at EXL

EXL (NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes, and unlock growth with speed. Bridging domain expertise with robust data, powerful analytics, cloud and AI, EXL creates agile, scalable solutions for the world’s leading corporations.

Founded on a core of innovation, collaboration, excellence, integrity and respect, EXL delivers value from data to faster decision‑making and business transformation across industries such as insurance, healthcare, banking and financial services, media, and retail.

BU/Segment: Analytics / Data Management / Insurance Domain | Location: Manchester, United Kingdom

Job Summary

We’re looking for a highly skilled Azure Databricks Data Engineer to design, develop and deliver cloud‑based data integration and analytics solutions within our Insurance portfolio. As part of this role you will build scalable pipelines, optimise performance, and maintain best practices in data quality and governance, with a strong emphasis on Azure and Databricks, and insurance domain knowledge.

Responsibilities
  • Design, build and deploy scalable data pipelines using Azure Databricks, Azure Data Factory and Azure SQL Database.
  • Optimize Databricks environments for performance, cost and security.
  • Develop and maintain data integration, ETL/ELT processes and data‑quality frameworks.
  • Translate business requirements into data models, ensuring consistency and accuracy across data layers.
  • Collaborate with stakeholders to deliver effective data solutions and analytics.
  • Produce technical documentation including data‑flow diagrams, architecture designs and test plans.
  • Stay current with emerging data‑engineering and Azure ecosystem technologies to drive continuous improvement.
Required Qualifications and Experience
  • Insurance industry experience is essential, with a strong understanding of policy, claims and regulatory data.
  • Minimum of 5 years’ management experience; leading technical delivery or overseeing project teams within data engineering or integration environments.
  • 8–10 years’ experience in data engineering and integration, ideally in enterprise‑scale environments.
  • Hands‑on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data‑pipeline orchestration.
  • Strong data‑modelling skills (Dimensional, ODS, Data Vault) and experience with data‑warehousing concepts.
  • Experience working with large, complex datasets and distributed computing environments.
  • Proficiency in SQL, version control (e.g. Git) and CI/CD pipelines.
  • Familiarity with Agile delivery and DevOps practices (Azure DevOps, JIRA, etc.).
Preferred Skills & Experience
  • Knowledge of Enterprise Data Management practices, data governance, metadata management and lineage tools.
  • Exposure to multi‑cloud environments (AWS or GCP).
  • Understanding of modern data‑architecture philosophies and real‑time cloud data capabilities.
Benefits
  • A competitive salary with a generous bonus.
  • Private healthcare, critical‑illness life assurance at 4 × annual salary and income protection insurance.
  • Rewarding pension scheme and employee stock purchase plan (ESPP).
  • Financial well‑being solutions such as cashback cards and a cycle scheme.
  • Extensive professional and personal development opportunities, including online courses, seminars and workshops.
  • Flexible hybrid working model to support a balanced, healthy lifestyle.
  • Commitment to equal opportunity; EXL is an equal‑opportunity employer that does not discriminate on race, religion, colour, national origin, sex, sexual orientation, age or disability status.
Eligibility

To be considered for this role you must already be eligible to work in the United Kingdom.

Seniority Level: Associate

Employment Type: Full‑time

Job Function: Engineering, Consulting, and Information Technology

Industries: Business Consulting and Services; Insurance; Technology, Information and Media


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

Jobs

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

Careers Jobs

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.