Data Engineer - Microsoft Fabric

Data Engineer - Microsoft Fabric role at Simpson Associates. Join our UK consulting team as an experienced Data Engineer specialising in Spark based data platforms such as Microsoft Fabric or Databricks.

This remote role offers the opportunity to design and deliver integrated analytics solutions using Microsoft Fabric’s cutting-edge Spark ecosystems, including Lakehouse, Data Pipelines, and Power BI. You’ll collaborate closely with our agile delivery team, contributing to technical backlogs, participating in daily stand-ups, and engaging directly with clients to deliver scalable, high-quality data solutions.

• Build and maintain data pipelines, lakes, and warehouses using Fabric and/or Databricks components.
• Implement ETL/ELT processes, data modelling, and analytics workflows to support BI and AI initiatives.
• Serve as a technical expert in the field of data engineering, recognised by both internal teams and customers.
• Provide advanced support across the business through deep expertise in data engineering practices.
• Act as a go-to resource for complex and modern architectural and implementation challenges.
• Deliver high-quality solutions aligned with the latest data engineering methodologies and technologies.
• Contribute to the design and execution of key data functions that drive business and customer success.
• Collaborate with cross-functional teams to prioritise and execute technical backlog items.
• Participate in agile ceremonies including stand-ups, sprint reviews, and customer demos.
• Troubleshoot data issues, optimise performance, and ensure data accuracy and reliability.
• Document architectures, pipelines, and operational procedures for team knowledge sharing.

• Expertise in Microsoft Fabric specific features: OneLake, Dataflows, Pipelines, and Power BI integration (inc. DirectLake).
• Strong programming skills in PySpark, Python, and SQL.
• Familiarity with Azure cloud services and DevOps tools (Git, CI/CD pipelines).
• Proven experience in agile methodologies and backlog management tools (Jira, Azure DevOps Boards).
• Advanced SQL / SparkSQL skills for querying, modelling, and integration.

• 3+ years in Data Engineering, with at least 12 months of hands-on experience in Microsoft Fabric or Databricks.

• Microsoft certifications such as Fabric Analytics Engineer Associate or Azure Data Engineer Associate (preferred).
• Databricks Certifications
• Reasonable proficiency in English for effective technical and client communication.

• Strong problem-solving and attention to detail.
• Excellent collaboration and communication abilities.
• Adaptability to fast-paced, agile team environments.
• Proactive mindset with a focus on continuous improvement and value delivery.

The successful candidate will be required to obtain Security Clearance and NPPV Level 3.

• Seniority level: Associate
• Employment type: Full-time

• Information Technology and Consulting

• Data Infrastructure and Analytics
• Software Development
• IT Services and IT Consulting