Jobs

Lead Data Engineer


Job details
  • BrightBox Group Ltd
  • London
  • 3 weeks ago

Lead Data Engineer, SC Clearance required, outside IR35, travel once/ twice a month to Newcastle.


Role Overview:

We are seeking a Lead Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and frameworks that support data-driven decision-making. You will work collaboratively with cross-functional teams to ensure data integrity and accessibility while providing technical leadership to junior engineers. This position is outside IR35.


Responsibilities:

- Design and develop robust data pipelines using Quantexa and Databricks.

- Collaborate with data scientists and analysts to understand data requirements and provide solutions.

- Ensure the reliability, scalability, and performance of data systems.

- Lead and mentor a team of data engineers, fostering a culture of continuous improvement.

- Manage data integration processes and maintain data quality standards.

- Implement best practises for data governance and security.

- Participate in code reviews and contribute to architectural discussions.

- Maintain up-to-date documentation for data systems and processes.


Qualifications:

- Proven experience as a Data Engineer, with a strong background in data pipeline development.

- Expertise in Quantexa and Databricks.

- Experience in leading technical teams and projects.

- Strong understanding of data modelling and ETL processes.

- SC clearance is required for this role.

- Excellent problem-solving skills and attention to detail.

- Strong communication and collaboration skills.

- A degree in Computer Science, Engineering, or a related field is preferred.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Lead Data Engineer

Join a leading independent company renowned for exceptional service and customer care. As the Lead Data Engineer, you will spearhead our efforts to transform into a data-driven organisation, utilising state-of-the-art technologies like Azure and Databricks.Lead Data EngineerLocation: Sunderland, UK (Hybrid - up to 3 days work from home)Job Type: Full-time,...

Sunderland

Lead Data Engineer - Contract

Lead Data Engineer (GCP) - 3 Month Contract - Inside IR35Hybrid (1 day p/w in London)Spinks have partnered with a leading UK Consultancy who are seeking an experienced Lead Data Engineer to support their client on an exciting project.As a Lead Data Engineer, you will have proven experience leading small...

London

Lead Data Engineer - Hybrid/London - £100,000 +Bonus

My client is based in the London area are currently looking to recruit for an experienced Lead Data Engineer to join their team. They are one of the leaders within the Insurance Industry, and are currently going through a period of growth and are looking for an experienced Data Engineer...

City of London

Lead Data Engineer

Lead Data EngineerSalary/Rate: £100,000 - £110,000 per annum + BonusLocation: North LondonCompany: RetelligenceAbout RetelligenceRetelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions....

Highbury

Lead Data Engineer

Lead Data Engineer - AWS, Python, SQL, Kafka - Fully RemoteWe are looking for aLead Data Engineerwith expertise inAWS, Python, SQL, andKafkafor acloud-based data, software development company based in London. Their products allow data transformation into ultra-secure cloud based environments mainly used by large enterprises and government sectors.Please note: A...

Movement8 Leeds

Lead Data Engineer

Lead Data Engineer - AWS, Python, SQL, Kafka - Fully RemoteWe are looking for aLead Data Engineerwith expertise inAWS, Python, SQL, andKafkafor acloud-based data, software development company based in London. Their products allow data transformation into ultra-secure cloud based environments mainly used by large enterprises and government sectors.Please note: A...

Movement8 Bristol