Principal Data Engineer

Description

Key Responsibilities

• 
  
• Help define and take the lead on the deployment of modern data engineering solutions across the Microsoft Azure ecosystem
  
• Build, automate, and manage scalable ETL/ELT data pipelines using Microsoft Fabric and Azure Synapse
  
• Lead the adoption and implementation of Microsoft Fabric as the core of our unified data platform
  
• Integrate diverse data sources across on-premise systems, cloud platforms, and third-party applications using Azure Integration Services (Logic Apps, API Management, Event Grid)
  
• Drive best practices in data ingestion, transformation, governance, and lineage
  
• Support AI Engineers in building Retrieval-Augmented Generation (RAG) pipelines, including embedding generation, document chunking, and vector database integration
  
• Optimize data pipelines that feed LLM-based agents, ensuring high-performance retrieval and timely access to knowledge
  
• Collaborate with colleagues in Data & Analytics Team to ensure reliable, timely access to trusted data
  
• Mentor junior engineers and support continuous improvement across the team
  
• Ensure solutions meet security, compliance, and performance standards
  
• Lead performance tuning, troubleshooting, and root cause analysis of critical data processes
  
• Contribute to the overall data strategy, architecture roadmap, and technology stack decisions
  

Skills, Knowledge & Expertise

• 
  
• Experience of designing and implementation of an Azure analytical platform including Azure Integration Services, Azure Synapse Analytics, Microsoft Fabric, Azure Databricks and Logic Apps
  
• Experience of working with senior stakeholders to articulate the strategy, objectives and benefits of a central enterprise cloud data platform
  
• Experience of DevOps to manage workload
  
• Experience of coaching and mentoring data engineers to achieve successful outcomes
  
• Understanding of data sciences tools and techniques combined with an understanding of a range of data sources
  
• Familiarity with AI-focused data engineering, including RAG systems, vector databases, embedding pipelines, and semantic indexing
  
• A proven record of collaboration with colleagues and stakeholders
  
• Process mapping and supporting documentation production
  
• Test plan formulation and managing through to resolution
  

• 
  
• Ability to communicate and collaboration with multiple stakeholders across the business and within Breedon Technology Services
  
• High level of technical proficiency in designing, implementing and maintaining a quality service
  
• Research and evaluation of technological developments
  
• Ability to analyse and troubleshoot potential issues within the platform
  
• Ability to identify creative solutions to overcome problems
  
• Ability to impart knowledge and support the development of team members 
  
• Ability to support AI workflows by designing high-performance retrieval pipelines and working with AI engineering teams
  

Job Benefits

• 
  
• Company Pension
  
• Discount Scheme
  
• Enhanced Maternity, Paternity & Adoptions Scheme
  
• Free on-site Parking
  
• Health & Wellbeing Initiatives
  
• Life Assurance
  
• Share Save Scheme
  
• Volunteering Policy
  
• Holiday Buy Scheme