As an IT Data Engineer, you will play a crucial role in designing, building, and maintaining our data movement pipelines using Microsoft tools and platforms. Working within an agile environment, you will be responsible for project based and IT day-to-day data development and reporting tasks.
This company is one of the UK's leading full-service law firms, with offices in London, Wales, Thames Valley, and the South Coast region. They provide our clients with practical and straightforward legal advice whatever their regional, national, and international requirements. Our clients are commercial business, not-for-profit organisations, government agencies and private individuals.
We operate hybrid working practices, with a typical week split between time in the office and home working.
Responsibilities
Work with Microsoft Azure services (e.g., Data Factory, Data Lake Storage, Databricks, Synapse Analytics) to orchestrate data loading and workflows and manage data pipelines.
Collaborate with analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
Develop and implement data validation and reconciliation processes to ensure data accuracy and consistency across all data sets.
Implement data quality checks and validation rules to ensure data accuracy and consistency.
Troubleshoot and resolve issues related to data transformation, data loading, and data quality, while proactively identifying opportunities for process optimisation and performance tuning.
Create and maintain data models using and Microsoft SQL Server and Azure SQL Database.
Optimize and enhance existing SSIS packages for performance, scalability, and reliability.
Stay informed of the latest Microsoft data and reporting technologies to continuously improve data movement capabilities and data modelling techniques.
Skills / Experience Required
Strong experience with Azure services such as Azure Data Factory (and Synapse Analytics Pipelines), Azure Databricks, and Azure SQL Database.
Proven experience as a Data Engineer and understanding of BI and data warehousing concepts using modern Microsoft technologies.
Experience with Azure solution deployment automation and testing through ARM templates, etc.
Strong proficiency in Microsoft SQL Server, SSIS, and T-SQL.
Knowledge of data modelling and schema design using Microsoft tools.
Knowledge of delivering DevOps capabilities for data projects and agile methodologies
Experience with Power BI for data construction, visualization and business insights is desirable.
Excellent critical thinking skills and attention to detail.
Effective communication and collaboration abilities and the ability to understand and articulate requirements to technical and non-technical audiences.
Bachelor's degree in computer science, Information Systems, or related field.
Azure certifications related to data engineering or analytics
