Lead Data Engineer Location:Belfast, United Kingdom Salary: Up to £110,000, depending on experience Job Description: Our client is seeking an experienced Lead Data Engineer to join their growing team in Belfast. This role will involve working on innovative data solutions that help improve processes within the food supply chain industry. You will be responsible for designing, implementing, and managing large-scale data pipelines and cloud-based solutions, with a focus on Azure. The ideal candidate will have a solid background in ETL architecture, data warehousing, and cloud technologies, and will thrive in a fast-paced, client-focused environment. Key Responsibilities: Design and manage data pipelines: Ingest and integrate data from multiple sources including databases, APIs, and files, ensuring smooth data flow for key stakeholders. ETL development: Lead the design and development of ETL pipelines using tools such as Azure Data Factory, Ab Initio, and Python to transform and prepare data for reporting and analytics. Cloud-based data storage: Manage and optimise data storage on Azure SQL, Azure Data Lake, Blob Storage, and Snowflake for structured and unstructured data. Data governance and security: Implement robust governance policies, ensuring data quality, security, and compliance across projects. Client collaboration: Serve as a primary technical point of contact for clients, guiding them through complex data projects and managing expectations. Continuous integration and deployment: Collaborate with DevOps teams to automate pipelines and deploy solutions using Azure DevOps for scalable, high-quality outcomes. Data visualisation and reporting: Leverage tools like Power BI to transform raw data into actionable business insights, aiding decision-making processes. Essential Skills: 10+ years of experience in data engineering with a focus on ETL processes. Advanced knowledge of Azure Cloud services, particularly Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Azure DevOps. Proficiency in Python, Ab Initio, Unix Shell scripting, and Oracle SQL. Strong understanding of data warehouse design, data architecture, and experience with Star/Snowflake schemas. Expertise in data governance, security protocols, and implementing data retention strategies. Ability to manage multiple projects, working directly with clients and technical teams to deliver top-tier solutions. Desired Experience: Experience working on data migration projects, particularly within the Azure ecosystem. Strong business intelligence skills, specifically with tools like Power BI for data visualisation. Knowledge of the food supply chain industry or similar sectors would be advantageous. Benefits: Competitive salary up to £110,000. Hybrid working model, with flexibility for remote work. Opportunity to work on cutting-edge data solutions and cloud technologies. Personal and professional development in a rapidly growing sector. For more information contact Aaron Somers via email or LinkedIn if you would like to have a confidential chat. Skills: Data Analysis data engineering