As an IT Data Engineer, you will play a crucial role in designing, building, and maintaining our data movement pipelines using Microsoft tools and platforms. Working within an agile environment, you will be responsible for project based and IT day-to-day data development and reporting tasks.
This company is one of the UK's leading full-service law firms, with offices in London, Wales, Thames Valley, and the South Coast region. They provide our clients with practical and straightforward legal advice whatever their regional, national, and international requirements. Our clients are commercial business, not-for-profit organisations, government agencies and private individuals.
We operate hybrid working practices, with a typical week split between time in the office and home working.
Responsibilities
Work with Microsoft Azure services (e.g., Data Factory, Data Lake Storage, Databricks, Synapse Analytics) to orchestrate data loading and workflows and manage data pipelines.
Collaborate with analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
Develop and implement data validation and reconciliation processes to ensure data accuracy and consistency across all data sets.
Implement data quality checks and validation rules to ensure data accuracy and consistency.
Troubleshoot and resolve issues related to data transformation, data loading, and data quality, while proactively identifying opportunities for process optimisation and performance tuning.
Create and maintain data models using and Microsoft SQL Server and Azure SQL Database.
Optimize and enhance existing SSIS packages for performance, scalability, and reliability.
Stay informed of the latest Microsoft data and reporting technologies to continuously improve data movement capabilities and data modelling techniques.
Skills / Experience Required
Strong experience with Azure services such as Azure Data Factory (and Synapse Analytics Pipelines), Azure Databricks, and Azure SQL Database.
Proven experience as a Data Engineer and understanding of BI and data warehousing concepts using modern Microsoft technologies.
Experience with Azure solution deployment automation and testing through ARM templates, etc.
Strong proficiency in Microsoft SQL Server, SSIS, and T-SQL.
Knowledge of data modelling and schema design using Microsoft tools.
Knowledge of delivering DevOps capabilities for data projects and agile methodologies
Experience with Power BI for data construction, visualization and business insights is desirable.
Excellent critical thinking skills and attention to detail.
Effective communication and collaboration abilities and the ability to understand and articulate requirements to technical and non-technical audiences.
Bachelor's degree in computer science, Information Systems, or related field.
Azure certifications related to data engineering or analytics
The latest news, articles, and resources, sent to your inbox weekly.
We are excited to offer an excellent opportunity for an experienced Data Engineer to join an innovative and forward-thinking financial services company. You will be part of a dynamic team driving the transition from traditional data systems to a cloud-based environment, with a focus on Microsoft Azure. This role is...
Blackpool
Data EngineerInitial 6 month FTCHybrid (Once a month onsite every couple of months)Your Role as a Data Engineer, your responsibilities will include:Working on the mainstay programme (moving from Dynamics AX to D365)Implementing and managing a new Data Lakehouse using the latest technologies on a daily basisUtilising technologies such as Data...
Poole
Data Engineer (Azure Stack)Location: GalwaySalary: €(phone number removed) (DOE)HybridReperio have partnered with a well-known pharmaceutical company in the Irish market who are seeking a Data Engineer with experience in Microsoft Azure services to join their expanding data team. This company are a majorly sought-after employer, boasting an impressive reputation n...
Galway
Contract type: PermanentHours: Full Time, 37.5 hours per weekSalary: circa £60,000 depending on experienceLocation: Canary WharfWFH policy: Employees are required to attend the office 2 days/weekFlexible working: Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight.Reports to: Lead Data EngineerDeadline Note: We reserve the right...
Canary Wharf
Data EngineerSuffolk£50,000 - £60,000Fixed term contract (contact for details)On behalf of our client, we are seeking an experience Data Engineer to work within a newly created team to embed data foundations, data engineering processes and best practices, where there is currently none. At this stage, the programme is focusing on...
Stowmarket
Working for one of the biggest NHS providers in Norfolk, you will be repsonsible for;Develop, test & implement solutions built in the Azure Data Environmentand BI reporting software ensuring that it meet the requirements of the endusers and the Data Engineering teams development standards. Supporting with the development of technical...
Lakenham