Senior Lead Data Engineer (Big Data)

iO Associates
London
1 week ago
Create job alert

Title: Senior Lead Data Engineer

Salary: Up to £80,000 D.O.E

Location: Remote (Occasional Travel)

Are you a seasoned data engineering professional with big data experience? Does leading a team while working on innovative solutions that impact real lives excite you?

If so, our client is looking for an experiencedSenior Lead Data Engineerto join their forward-thinking, 100% data-driven organisation. This is a hands-on leadership role where you will guide a talented team of engineers, drive technical excellence, and shape the future of data solutions.

As a key member of the Data Engineering team, you will collaborate with cross-functional teams to design, develop, and optimise scalable data architectures and pipelines. If you're passionate about leading cutting-edge projects, mentoring engineers, and working with advanced cloud and big data technologies, we'd love to hear from you!

Your Responsibilities:

  • Technical Leadership:Design, develop, and optimise data software, infrastructure, and pipelines. Provide hands-on leadership to the team.
  • Team Mentorship:Lead, guide, and mentor a team of data engineers, fostering a collaborative and innovative culture.
  • Strategic Roadmap:Define and execute the technical roadmap to align with business objectives and future-proof solutions.
  • Data Excellence:Champion best practices in coding, architecture, and data performance, setting high standards for the team.
  • Cloud & Big Data Solutions:Build and optimise data solutions using tools like Hadoop, Spark, Kafka, AWS, Azure, and Databricks.
  • Collaboration:Partner with cross-functional stakeholders to deliver high-impact data solutions that meet complex business requirements.
  • Monitoring & Quality:Ensure data quality, integrity, and availability through monitoring systems and effective troubleshooting.

What We're Looking For:

  • Hands-on Leadership:Proven experience leading and mentoring technical teams, with a hands-on approach to problem-solving.
  • Technical Expertise:Deep knowledge of data engineering, cloud solutions (AWS/Azure), and big data technologies (Hadoop, Spark, Kafka).
  • Programming Proficiency:Strong coding skills in two or more languages, such as Python, Java, Scala, or PySpark.
  • Cloud and On-Prem Experience:Expertise in ETL tools, data lakes, and data transformation tools like Databricks or Azure Data Fabric.
  • Analytical Excellence:Strong problem-solving skills, with a track record of delivering scalable and cost-efficient data solutions.
  • Certifications:AWS, Azure, or Cloudera certifications are highly valued.
  • Nice-to-Have Skills:Geospatial data experience, advanced SQL/database expertise, and knowledge of data warehousing patterns.

Key Benefits:

  • Salary up to £80,000
  • Fully Remote
  • Private Medical Cover
  • 25 days holiday, plus bank holidays
  • And more!

Our client has a 2-stage interview process, and for the right candidate, they will interview early next week!

If you're interested, or know someone who would be, then please apply to .

#J-18808-Ljbffr

Related Jobs

View all jobs

Oracle Data Engineer

Assistant Data Engineer (Structured Cabling)

Technical Lead

Technical Lead

Technical Lead

Technical Lead

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Leadership for Managers: Strategies to Motivate, Mentor, and Set Realistic Goals in Data-Driven Teams

Machine learning (ML) has become an indispensable force in the modern business world, influencing everything from targeted marketing campaigns to advanced medical diagnostics. As industries integrate predictive algorithms and data-driven decision-making into their core operations, the need for effective leadership in machine learning environments has never been greater. Whether you’re overseeing a small team of data scientists or spearheading an enterprise-scale ML project, your leadership style must accommodate rapid innovation, complex problem-solving, and diverse stakeholder expectations. This guide provides actionable insights into how you can motivate, mentor, and establish achievable goals for your machine learning teams—ensuring they thrive in data-driven environments.

Top 10 Books to Advance Your Machine Learning Career in the UK

Machine learning (ML) remains one of the fastest-growing fields within technology, reshaping industries across the UK from finance and healthcare to e-commerce, telecommunications, and beyond. With increasing demand for ML specialists, job seekers who continually update their knowledge and skills hold a significant advantage. In this article, we've curated ten essential books every machine learning professional or aspiring ML engineer in the UK should read. Covering foundational theory, practical implementations, advanced techniques, and industry trends, these resources will equip you to excel in your machine learning career.

Navigating Machine Learning Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Machine learning (ML) has swiftly become one of the most in-demand skill areas across industries, with companies leveraging predictive models and data-driven insights to solve challenges in healthcare, finance, retail, manufacturing, and beyond. Whether you’re an early-career data scientist aiming to break into ML, a seasoned engineer branching into deep learning, or a product manager exploring AI-driven solutions, machine learning career fairs offer a powerful route to connect with prospective employers face-to-face. Attending these events can help you: Network with hiring managers and technical leads who make direct recruitment decisions. Gain insider insights on the latest ML trends and tools. Learn about emerging job roles and new industry verticals adopting machine learning. Showcase your interpersonal and communication skills, both of which are increasingly important in collaborative AI/ML environments. However, with many applicants vying for attention in a bustling hall, standing out isn’t always easy. In this detailed guide, we’ll walk you through how to prepare meticulously, pitch yourself confidently, ask relevant questions, and follow up effectively to land the machine learning opportunity that aligns with your ambitions.