Jobs

Lead Data Engineer


Job details
  • Blend360
  • Edinburgh
  • 6 days ago

Job Description

Life as a Lead Data Engineer at Blend

We are looking for someone who is excited by the idea leading a data engineering squad to develop best in class analytical infrastructures and pipelines.

However, they also need to be aware of the practicalities of making a difference in the real world – whilst we love innovative advanced solutions, we also believe that sometimes a simple solution can have the most impact.

Our Lead Data Engineer is someone who feels most comfortable around solving problems, answering questions and proposing solutions. We place a high value on the ability to communicate and translate complex analytical thinking into non-technical and commercially oriented concepts, and experience working on difficult projects and/or with demanding stakeholders is always appreciated.

Reporting to the Director of Data Engineering the role will work closely with the other Data Engineering Leads and other capabilities in the organisation such as the Data Science, Data Strategy and Business Development teams.

This role will be responsible for driving high delivery standards and innovation within the data engineering team and the wider company. This involves delivering data solutions to support the provision of actionable insights for stakeholders.

Our Data Engineering Leads remain hands-on and work with the Data Engineers within their squad.

What can you expect from the role?

  • Lead project delivery, covers overseeing the end-to-end delivery of projects and ensure robust project governance from a Data Engineering perspective.
  • Squad management, responsible for managing a team of Data Engineers, from Junior to Senior levels, covering resource utilization, training, mentoring, and recruitment.
  • Stakeholder engagement by preparing and present data-driven solutions to stakeholders, translating complex technical concepts into actionable insights.
  • Data pipeline ownership by designing, develop, deploy, and maintain scalable, reliable, and efficient data pipelines.
  • Domain expertise by keeping up to date on emerging trends and advancements within data ecosystems, ensuring the team remains at the forefront of innovation.
  • Business development support by providing expert input into proposal submissions and business development initiatives from a Data Engineering perspective.
  • Champion engineering excellence by promoting best practices for high-quality engineering standards that reduce future technical debt.
  • Evolve best practices by continuously refining the Data Engineering team's ways of working, driving alignment across the squad and wider teams.
  • Strategic contributions by collaborating with the Data Engineering Director on strategic workstreams, contributing to the Data Engineering strategy and Go-to-Market (GTM) initiatives.


Qualifications

What you need to have?

Experience:

  • Proven experience in leading technical teams and building applications using microservice architecture.
  • Extensive experience with Python and FastAPI.
  • Strong understanding of microservices principles and components such as logging, monitoring, health checks, scalability, resilience, service discovery, API gateways, and error handling.

Technical Skills:

  • Proficiency with Pydantic and data validation in FastAPI.
  • Experience with containerization technologies (e.g., Docker, Kubernetes).
  • Familiarity with CI/CD pipelines and tools.
  • Knowledge of API design and implementation.
  • Experience with monitoring and logging tools (e.g., Prometheus, Grafana, other).
  • Knowledge of security best practices in microservices architecture.
  • Familiarity with version control systems (e.g., Git) and collaborative development workflows.

Nice to Have:

  • Experience working with Retriever models, including implementation of chunking strategies.
  • Knowledge and use of vector databases.
  • Understanding of optimal approaches in querying LLM models via API.
  • Prompt engineering knowledge, with familiarity in different strategies.
  • Exposure to various prompt engineering techniques in different scenarios.

 

 

 



Additional Information

All your information will be kept confidential according to EEO guidelines.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Lead Data Engineer

We're seeking a Lead Data Engineer to join our team and bring data to the heart of N Brown. You'll be part of Group Data, focusing on exploring solutions to maintain, improve, and scale our use of data. Key Responsibilities As Lead Data Engineer:Lead a team of engineers in creating,...

Manchester

Lead Data Engineer

Lead Data EngineerRetelligence is partnering with a high-growth, forward-thinking organization specializing in digital innovation and marketing across international markets. This company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions.This is a fantastic opportunity to join a dynamic team within a business...

Bishopsgate

Lead Data Engineer

Reporting to the Principal Solutions Architect, the Lead Data Engineer is a senior role in our analytics department. the Purpose of the role is to build modern, cloud based data pipelines which enable the delivery of data used by internal & external stakeholders, and to play a leading role in...

Stockport

Lead Data Engineer

Lead Data Engineer - Up to £100k - HealthTechFantastic new opportunity for an experienced Data Engineer to join a venture backed HealthTech startup.What You'll Be Doing:Architecting robust, secure data infrastructure from the ground upDesigning scalable data pipelines that can handle sensitive, complex informationCollaborating with multidisciplinary teams including scientists, ML researchers,...

Understanding Recruitment London

Lead Data Engineer

Job DescriptionLife as a Lead Data Engineer at BlendWe are looking for someone who is excited by the idea leading a data engineering squad to develop best in class analytical infrastructures and pipelines.However, they also need to be aware of the practicalities of making a difference in the real world...

Blend360 Edinburgh

Lead Data Engineer

Lead Data Engineer - Up to £75,000 + Competitive benefits package - North West Office location - Flexible hybrid workingiO Associates is recruiting an experienced Lead Data Engineer on behalf of an exciting business in the eCommerce industry. This is a great time to join a growing Data team in...

iO Associates