Jobs

Lead Data Engineer


Job details
  • BrightBox Group Ltd
  • London
  • 1 week ago

Lead Data Engineer, SC Clearance required, outside IR35, travel once/ twice a month to Newcastle.


Role Overview:

We are seeking a Lead Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and frameworks that support data-driven decision-making. You will work collaboratively with cross-functional teams to ensure data integrity and accessibility while providing technical leadership to junior engineers. This position is outside IR35.


Responsibilities:

- Design and develop robust data pipelines using Quantexa and Databricks.

- Collaborate with data scientists and analysts to understand data requirements and provide solutions.

- Ensure the reliability, scalability, and performance of data systems.

- Lead and mentor a team of data engineers, fostering a culture of continuous improvement.

- Manage data integration processes and maintain data quality standards.

- Implement best practises for data governance and security.

- Participate in code reviews and contribute to architectural discussions.

- Maintain up-to-date documentation for data systems and processes.


Qualifications:

- Proven experience as a Data Engineer, with a strong background in data pipeline development.

- Expertise in Quantexa and Databricks.

- Experience in leading technical teams and projects.

- Strong understanding of data modelling and ETL processes.

- SC clearance is required for this role.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

- A degree in Computer Science, Engineering, or a related field is preferred.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Lead Data Engineer

Lead Data Engineer - onsite once a month - LancashireWe are looking for a Data Engineer to be a key player in designing, developing, and maintaining our data infrastructure to enhance our Business Intelligence and Analytics capabilities. In this role, you will collaborate with stakeholders to ensure that our data...

Harnham Newcastle upon Tyne

Lead Data Engineer

SR2 is partnered with aUK-based consultancymaking an impact acrossFinance, Retail & Government, who are urgently looking to hire severalLead Data Engineers.We are looking for Data Engineers to onboard across Q1 next year - 7 in January, 16 in February & 15 in March.Location:All roles are London-based and have a hybrid...

SR2 | Socially Responsible Recruitment | Certified B Corporation London

Lead Data Engineer

Lead Data Engineer, SC Clearance required, outside IR35, travel once/ twice a month to Newcastle.Role Overview:We are seeking a Lead Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and frameworks that support data-driven decision-making. You will work collaboratively...

BrightBox Group Ltd London

Lead Data Engineer in London - PA Consulting

This is a job posted by our partner JoobleSkills and ExperienceDesigning and deploying production-grade data pipelines (batch and streaming) within a big data architecture using tools like Python,Scala,Spark, and SQL.Expertise in either AWS or Azure cloud platforms, with hands-on experience in key services such as:Location108 E 16th Street, New York,...

WorksHub London

Lead Data Engineer

Job Title: Lead Data EngineerRole Type: PermanentLocation: Birmingham (Hybrid)Our client is seeking an experienced Lead Data Engineer or a Data Engineer aspiring to step into a lead position.Role OverviewAs the Data Engineer, you will be responsible for a team of data engineers, analysts and leveraging your expertise in Microsoft BI...

Jumar Solutions

Lead Data Engineer

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in...

Pontoon Warwickshire