Senior Data Engineer

Increase your chances of reaching the interview stage by reading the complete job description and applying promptly.

Head Resourcing is pleased to be working with a progressive thinking organisation specialising in marine insurance and underwriting, who are looking for an experienced Senior Data Engineer to join their team in London. With a clear vision to become a fully data-driven company. By embracing innovation and advanced technology, we aim to revolutionise our operations, enhancing decision-making, customer satisfaction, and scalability.

Their goal is to integrate robust data capabilities with our strong broker and client relationships, ensuring we remain leaders in the market. Joining our team means contributing to a collaborative and dynamic environment where your expertise will directly influence our data strategy. We value innovation, teamwork, and a commitment to excellence, and we’re dedicated to fostering your professional growth.

Key Responsibilities:

• Take ownership of the organisation’s solution architecture, ensuring it aligns with business objectives.
• Oversee the design, development, and maintenance of data pipelines and infrastructure to process structured and unstructured data from multiple sources for analytics and reporting.
• Lead the delivery of the data and technology strategy, ensuring it supports the overall business roadmap.
• Collaborate with stakeholders to identify data requirements and transform them into scalable, effective data models.
• Build and manage a cost-effective, cloud-based data warehouse from the ground up, designed for current needs and future growth.
• Ensure compliance with industry regulations and maintain the security and integrity of all data systems.
• Continuously monitor and optimise data systems to improve performance, scalability, and reliability.
• Mentor team members, providing guidance on best practices and fostering professional development.
• Partner with BI teams to deliver optimised data models and support new data requirements.

Skills and Experience:

• Demonstrated expertise in end-to-end data gathering, warehousing, and product development.
• Strong technical project management skills, with a proven ability to deliver projects on time and within scope.
• Analytical problem-solving abilities with a keen attention to detail.
• Extensive experience designing and implementing cost-efficient data and technology solutions independently.
• Proficiency in building and optimising scalable data pipelines and warehouses, with hands-on experience in SQL, Python, Spark, Java, or Scala.
• Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and their data services.
• Hands-on experience with data warehouse platforms such as Snowflake, BigQuery, AWS Glue, Azure Data Factory, and Databricks.
• Skilled in CI/CD processes and data orchestration tools like Airflow or Luigi.
• Strong communication and collaboration skills to engage effectively with both technical and non-technical stakeholders.
• Experience with containerisation (Docker) and orchestration tools (Kubernetes, Terraform).
• Proven leadership experience in data engineering, ideally within a product-driven or financial services company.
• Familiarity with Agile development methodologies.
• Knowledge of integrating solutions via bulk exports, APIs, or IPaaS platforms.

Desirable Skills:

• Background in financial services, particularly in the insurance domain, including knowledge of underwriting, claims, and financial metrics like loss ratios or Gross Written Premium.
• Experience in building data infrastructure for analytics and reporting in financial services.
• Familiarity with BI tools such as Looker, Power BI, or Tableau.

If this sounds like you we would like to hear from you.