Job Title: Principal Data Engineer

Duration = 6 Months with likelihood of extending to 12

Location = UK (Remote)

Principal Data Engineer

Who you'll work with

You’ll be a member of a global team working on GenAI initiative. Client’s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a cloud-first approach to transform our data platforms and analytical applications across the firm.

We are seeking an experienced data engineer to shape and accelerate the delivery of target state data platform enabling GenAI use-cases. We want a passionate specialist who loves to build data solutions as part of multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers and others.

Your impact within our firm.

We are looking to staff a rockstar Principal Data Engineer to join Lilli team in enabling GenAI application with data. You’ll learn what it’s like to build and work on a GenAI product that has Firm-wide impact.

As part of the team, you sit at the technical side and work closely with product professional to deliver data processing capabilities enabling top use cases to transform how we work using GenAI. You collaborate with cross-functional teams, including product managers, data scientists, engineers, data engineers, designers, and Firm stakeholders, to define product requirements, prioritize features, and drive a successful delivery.

You will be leading multiple workstreams that include work related to data infrastructure, data engineering framework & adoption, developer productivity, data processing capabilities, GenAI-agents data enablement and more.

What you'll do

As a Principal Data Engineer, you will be responsible for making critical technical design decisions that shape our data infrastructure. You will mentor and apprentice data engineers, fostering their growth and ensuring they adhere to best practices. Your role includes influencing the data engineering team structure to optimize delivery and maximize impact. You will also be accountable for the quality of deliverables, ensuring that all code meets high standards of reliability, scalability, and performance. Your leadership and expertise will drive the team to achieve excellence in all aspects of data engineering.

Skills

• 8+ years of professional experience as a data engineer, with a strong focus on cloud- based data engineering using AWS services
• Experience leading teams of engineering professionals
• Creation of enterprise-grade data solutions at large scale
• Expertise with Python development
• Fluency with data architecture & data engineering patterns and ability to apply them appropriately
• Experience with relational databases and vector stores
• Strong experience with containerization technologies and AWS ECS
• Practicing high coding standards with clean code, modularity, error handling, testing automation and more
• Very driven, superstrong on execution and output orientation, likes to get job done attitude and ability to figure things out independently. Able to work in complex and very fast paced environment
• Interest in Generative AI and other ML topics
• Kedro framework experience as a plus
• Holds their ground, opinionated, not afraid to speak up at any level
• Familiarity with agile principles and product development
• Excellent problem-solving skills and the ability to analyze and resolve complex data engineering challenges
• Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment

Data Engineer

Duties

Who you'll work with

You’ll be a member of a global team working on GenAI initiative. Client’s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a cloud-first approach to transform our data platforms and analytical applications across the firm.

We are seeking an experienced data engineer to shape and accelerate the delivery of target state data platform enabling GenAI use-cases. We want a passionate specialist who loves to build data solutions as part of multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers and others.

Your impact within our firm

We are looking for a Data Engineer with expertise in Python development, who is passionate about cloud- based dataengineering using AWS services and loves to build data solutions as part of multi-disciplinary team.

You would be working closely with digital product professionals, data scientists, cloud engineers and others.

You’ll be a member of a global team working on GenAI initiative, based in one of our European offices. Our Client’s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use.

You will work in a team of data engineers to develop data ingestion pipelines, create and mature data processing capabilities that ingest data into a data system used by GenAI applications.

Your work would include but won't be limited to creation of the python code, tests, creation and modification of GitHub Action CICD pipelines, working with AWS-based infrastructure and docker containers.

What you'll do

You will work in a team of data engineers to develop data ingestion pipelines, create and mature data processing capabilities that ingest data into a data system used by GenAI applications. Work includes but not limited to creation of the python code, tests, creation and modification of GitHub Action CICD pipelines, working with AWS-based infrastructure and docker containers

Skills

• 3+ years of professional experience as a data engineer, with a strong focus on cloud- based data engineering using AWS services
• Expertise with Python development
• Practicing high coding standards with clean code, modularity, error handling, testing automation and more
• Strong experience with relational databases
• Very driven, superstrong on execution and output orientation, likes to get job done attitude and ability to figure things out independently. Able to work in complex and very fast paced environment
• Hands-on experience with Docker
• Solid and demonstrable background in data pipeline performance and diagnostics
• Interest in Generative AI and other ML topics
• Kedro framework experience as a plus
• Holds their ground, opinionated, not afraid to speak up at any level
• Familiarity with agile principles and product development
• Excellent problem-solving skills and the ability to analyze and resolve complex data engineering challenges
• Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment