Your Role

and What You'll Be Doing

The Senior Data Engineer is responsible for the design, development, and maintenance of data engineering solutions for Irwin Mitchell. They understand requirements, create technical designs, configure applications, write code, and conduct testing. They collaborate with various teams, participate in meetings, and provide technical advice to address concerns. They troubleshoot and resolve technical issues, debug code, investigate failures, support end-users and the maintenance of the solutions. They document the data engineering development process, including technical specifications. Collaboration with other engineers, testers, and project managers is crucial for successful delivery. They ensure quality and reliability by conducting thorough testing, performing code reviews, and implementing best practices in data engineering development.

The Senior Data Engineer role is a key part in accelerating data value creation at IM and unlocking data’s potential, enabling improved data driven decisions and advanced analytics.

This role will shape IM transition to the cloud, both through the creation of a modern cloud data platform and as a wider organisation. It will ensure IM’s data is optimised to support the needs of colleagues and Clients.

This role will drive the creation of an aspirational data culture, with responsible data team autonomy, unified data platform with discoverable governed data, using industry best practices and modern technologies.

What You'll Be Doing

Mentoring and providing technical guidance to junior data engineers, ensuring adherence to best practices and driving continuous improvement. Collaborating closely with data scientists and analysts to understand their requirements and providing data engineering support for their advanced analytics and machine learning projects. Monitoring and troubleshooting data pipelines, ensuring data integrity, availability, and security. Proactively ensure well architected solutions are achieved. Great communication: Regularly achieve consensus amongst teams Perform technical interviews Staying up-to-date with the latest advancements in data engineering and Azure technologies, evaluating and recommending new tools, frameworks, and architectures to enhance our data capabilities. Provide guidance, mentorship, and support to junior engineers, helping them develop technical skills, problem-solving abilities, and professional growth. Conduct regular one-on-one sessions with mentees, offering constructive feedback, advice, and career guidance. Share knowledge and best practices with the engineering team, fostering a culture of continuous learning and improvement. Create and facilitate technical training programs or workshops to enhance the skills and capabilities of the engineering team. Encourage and support mentees in setting and achieving their career goals, providing guidance on career paths, and identifying growth opportunities. Offer support during challenging projects or assignments, providing guidance on problem-solving, decision-making, and handling technical complexities. Celebrate and recognise the achievements and successes of mentees, boosting their confidence and motivation.

About You

Essential

Expertise in Python programming for data engineering tasks, including data extraction, transformation, and loading. Extensive hands-on experience with Azure data services, such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Functions, and Azure Synapse Analytics. Experience develop Databricks Lakehouse using Delta lake and Unity Catalog. In-depth understanding of data modelling, ETL development, and data integration techniques. Strong knowledge of cloud-based data architectures, distributed computing concepts, and big data technologies (e.g., PySpark, Spark). Experience with Terraform/Bicep for deploying infrastructure as code and application code via Azure DevOps. Communication: Strong communication skills are essential for effectively conveying complex technical concepts to both technical and non-technical stakeholders. This includes being able to listen actively, ask clarifying questions, and articulate ideas clearly and concisely.

Desirable

Experience with cloud platform engineering Experience of working within a Professional services firm

Our Benefits - What We Can Offer You 25 days holidays as standard plus bank holidays - You can ‘buy’ up to 35hrs of extra holiday too. Generous and flexible pension schemes. Volunteering days – Two days of volunteering every year for a cause of your choice (fully paid) Westfield Health membership, offering refunds on medical services alongside our Aviva Digital GP services.

We also offer a wide range of well-being initiatives to encourage positive mental health both in and out of the workplace and to make sure you’re fully supported. This includes our Flexible by Choice programme which gives our colleagues more choice over a hybrid way of working subject to role, team and client requirements.

We have been ranked in the Best Workplaces for Wellbeing for Large Organisations for 2024!

Our responsible business programmes are fundamental to who we are and our purpose. We’re committed to being a diverse and inclusive workplace where our colleagues can flourish, and we have established a number of inclusion network groups across our business to support this aim. 

Our commitment to Social Responsibility, community investment activity and tackling climate change is a fundamental part of who we are. It’s made up of four strands: Our People, Our Community, Our Environment and Our Pro Bono.