Data Engineer (Fabric-Platforms)

Methods
Bristol
3 weeks ago
Create job alert
Base pay range

£50k – £65k


What You’ll Be Doing as a Data Engineer

  • Work closely with cross‑functional teams, translating complex technical concepts into clear, accessible language for non‑technical audiences and aligning data solutions with business needs.
  • Collaborate with a dynamic delivery team on innovative projects, transforming raw data into powerful insights that shape strategic decisions and drive business transformation.
  • Utilise platforms and tools such as Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks and Power BI to build robust, scalable and future‑proof end‑to‑end data solutions.
  • Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data.
  • Develop and maintain sophisticated data models, employing dimensional modelling techniques to support comprehensive data analysis and reporting.
  • Implement and uphold best practices in data governance, security and compliance, using tools like Azure Purview, Unity Catalog and Apache Atlas to maintain data integrity and trust.
  • Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data queries for performance and cost‑efficiency.
  • Develop intuitive and visually compelling Power BI dashboards that provide actionable insights to stakeholders across the organisation.
  • Monitor and tune solution performance, identifying opportunities for optimisation to enhance the reliability, speed and functionality of data systems.
  • Stay ahead of industry trends and advancements, continuously enhancing your skills and incorporating the latest data‑engineering tools, languages and methodologies into your work.

Your Impact

  • Enable business leaders to make informed decisions with confidence by providing them with timely, accurate and actionable data insights.
  • Be at the forefront of data innovation, driving the adoption and understanding of modern tooling, architectures and platforms.
  • Deliver seamless and intuitive data solutions that enhance the user experience, from real‑time streaming data services to interactive dashboards.
  • Play a key role in cultivating a data‑driven culture within the organisation, mentoring team members and contributing to the continuous improvement of the Engineering Practice.

Requirements

  • Proficiency in SQL and Python – highly proficient, enabling you to handle complex data problems with ease.
  • Understanding of Data Lakehouse Architecture – strong grasp of the principles and implementation of Data Lakehouse architecture.
  • Hands‑On Experience with Spark‑Based Solutions – experience with Spark‑based platforms like Azure Synapse, Databricks, Microsoft Fabric or on‑premise Spark clusters, using PySpark or Spark SQL to manage and process large datasets.
  • Expertise in Building ETL and ELT Pipelines – skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark‑based solutions to ensure efficient data flow and transformation.
  • Efficiency in Query Writing – can craft and optimise queries to be cost‑effective and high‑performing, ensuring fast and reliable data retrieval.
  • Experience in Power BI Dashboard Development – experience in creating insightful and interactive Power BI dashboards that drive business decisions.
  • Proficiency in Dimensional Modelling – adept at applying dimensional modelling techniques, creating efficient and effective data models tailored to business needs.
  • CI/CD Mindset – naturally work within Continuous Integration and Continuous Deployment (CI/CD) environments, ensuring automated builds, deployments and unit testing are integral parts of your development workflow.
  • Business Requirements Translation – knack for understanding business requirements and translating them into precise technical specifications that guide data solutions.
  • Strong Communication Skills – ability to effectively translate complex technical topics into clear, accessible language for non‑technical audiences.
  • Continuous Learning and Development – commitment to continuous learning and professional development, staying up to date with the latest industry trends, tools and technologies.

Desirable Skills

  • Exposure to Microsoft Fabric – familiarity with Microsoft Fabric and its capabilities would be a significant advantage.
  • Experience with High‑Performance Data Systems – handling large‑scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte‑sized databases.
  • Knowledge of Delta Tables or Apache Iceberg – understanding and experience with Delta Tables or Apache Iceberg for managing large‑scale data lakes efficiently.
  • Knowledge of Data Governance Tools – experience with data governance tools like Azure Purview, Unity Catalog or Apache Atlas to ensure data integrity and compliance.
  • Exposure to Streaming/Event‑Based Technologies – experience with technologies such as Kafka, Azure Event Hub and Spark Streaming for real‑time data processing and event‑driven architectures.
  • Understanding of SOLID Principles – familiarity with the SOLID principles of object‑oriented programming.
  • Understanding of Agile Development Methodologies – familiarity with iterative and agile development methodologies such as SCRUM, contributing to a flexible and responsive development environment.
  • Familiarity with Recent Innovations – knowledge of recent innovations such as GenAI, RAG and Microsoft Copilot, as well as certifications with leading cloud providers and in areas of data science, AI and ML.
  • Experience with Data for Data Science/AI/ML – experience working with data tailored for data science, AI and ML applications.
  • Experience with Public Sector Clients – experience working with public sector clients and understanding their specific needs and requirements.

Security Clearance

Security clearance is required – as part of the onboarding process candidates will be asked to complete a Baseline Personnel Security Standard. Details of the evidence required to apply may be found on the government website Gov.UK. If you are unable to meet this and any associated criteria then your employment may be delayed or rejected. Details of this will be discussed with you at interview.


Benefits

Methods Analytics (MA) exists to improve society by helping people make better decisions with data. Combining passionate people, sector‑specific insight and technical excellence to provide our customers an end‑to‑end data service.

We use a collaborative, creative and user‑centric approach to data to do good and solve difficult problems. Ensuring that our outputs are transparent, robust and transformative. We value discussion and debate.

We are passionate about our people; we want our colleagues to develop the things they are good at and enjoy.


By joining us you can expect:



  • Autonomy to develop and grow your skills and experience.
  • Be part of exciting project work that is making a difference in society.
  • Strong, inspiring and thought‑provoking leadership.
  • A supportive and collaborative environment.

Additional Benefits

  • Develop access to LinkedIn Learning, a management development programme and training.
  • Wellness 24/7 confidential employee assistance programme.
  • Social – office parties, pizza Friday and commitment to charitable causes.
  • Time off – 25 days of annual leave a year, plus bank holidays, with the option to buy 5 extra days each year.
  • Volunteering – 2 paid days per year to volunteer in our local communities or within a charity organisation.
  • Pension – salary exchange scheme with 4% employer contribution and 5% employee contribution.
  • Life assurance – 4 times base salary.
  • Private medical insurance – non‑contributory (spouse and dependants included).
  • Worldwide travel insurance – non‑contributory (spouse and dependants included).

Seniority level

Mid‑Senior level


Employment type

Full‑time


Job function

IT Services and IT Consulting


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.