Lead Data Engineer
Remote/Reading/Exeter
The Opportunity
Are you ready to make a significant impact on the future of data and engineering? We have an exciting Lead position in our Data Engineering team, perfect for experienced, hands-on professionals in leading and innovating. As a 100% data-driven company, we pride ourselves on employing the best engineering practices across our products and solutions.
As direct report to the Head of Data Engineering, you will play a crucial role in driving the team’s vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions.
This is an exciting opportunity for highly skilled and motivated Senior Lead Data Engineers with strong expertise in data architecture, ETL pipelines, cloud technologies and big data solutions who are looking to keep crafting their technical leadership responsibilities and shape the future of data engineering within our organisation.
In this role, you will:
Technical Leadership: Assist the Head of Data Engineering in overseeing the design, development, and optimisation of data software, data infrastructure and pipelines.
Team Technical Leadership: Guide a team of talented data engineers to deliver cutting-edge solutions, mentor and coach them, ensuring that best practices in data engineering and software development are followed. Lead by example. Be hands-on.
Lead by Example: We value leaders with exceptional technical expertise and hands-on coding skills. As a Senior Lead, you’ll set the standard by being directly involved and actively contributing to technical challenges. Be ready to roll up your sleeves when necessary and engage in real, impactful work alongside the team.
Data Strategy & Solutions: Own the technical roadmap, aligning engineering efforts with broader business goals and ensuring timely delivery, quality control, and that architectural decisions are forward-thinking and scalable. Inspire the team by providing a clear vision for technical excellence and innovation in the data engineering strategy.
Cloud: Optimise cloud-based data solutions, storage and processing systems, with hands-on experience in Azure.
Technical Excellence: Lead the pursuit of technical excellence by championing best practices in coding, architecture, and performance. Foster a team culture focused on continuous improvement, where learning is encouraged.
Leverage Big Data Technologies: Utilise tools such as Hadoop, Spark, and Kafka to design and manage large-scale on-prem data processing systems.
Collaboration: Collaborate with cross-functional teams and stakeholders to deliver high-impact solutions that align with business objectives.
Assemble Large, Complex Data Sets: Craft and manage data sets that meet both functional and non-functional business requirements.
Monitoring & Troubleshooting: Ensure data quality, integrity, and availability by developing systems and solutions to monitor performance, quality and troubleshoot issues as they arise.
Build Advanced Data Solutions: Develop the software and infrastructure for optimal data extraction, transformation, and loading using leading cloud technologies like Azure or Big Data ones.
Ensure Cost Efficiency: Keep the Data Lakes and Data solutions within agreed cost models and budgets.
Data Engineering Empowerment: Empower a high-performing engineering team to deliver innovative software while fostering a collaborative environment where ideas are valued. Act as a mentor, helping team members overcome technical challenges and grow in their roles.
About You
The Lead Data Engineer will be a passionate leader with hands-on seniority in engineer with the ability to inspire, mentor, and bring a team along on the journey. The ideal candidate will possess:
Depth of Expertise: seasoned hands-on experience in data engineering, with extensive experience in a leadership or mentoring role. Demonstrated track record of leading complex data engineering initiatives at scale. Extensive experience in designing, implementing, and optimizing data solutions, supported by a history of successfully managing technical teams and projects.
Exceptional coding skills.
Degree in Computer Science, Software Engineering, or similar (applied to Data. Data Specialisation).
Extensive experience in data engineering, in both Cloud & On-prem Big Data and Data Lake environments
Expert knowledge in data technologies, data transformation tools, data governance techniques.
Strong analytical and problem-solving abilities.
Good understanding of Quality and Information Security principles.
Effective communication, ability to explain technical concepts to a range of audiences
Able to provide coaching and training to less experienced members of the team
Essential skills: Programming Languages such as Spark, Java, Python, PySpark, Scala, etc (minimum 2)
Extensive Big Data on-prem experience (coding/configuration/automation/monitoring/security/etc) is a MUST On-premises HDFS, Hadoop, Sedona, Cloudera, etc
Significant Azure hands-on experience (coding/configuration/automation/monitoring/security)
ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones
Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse
Certifications Azure, or Cloudera certifications are a plus. Nice to have skills: Geospatial data experience, FME, Sedona, GIS< QGIS, PostGIS etc
Advanced Database and SQL skills
SQL or Data warehousing design patterns and implementation
Join us and lead the charge in transforming the data landscape at Landmark, while advancing your career in a dynamic and forward-thinking environment.
What it's like to work at Landmark:
At Landmark, you'll find a friendly, dynamic, and supportive team that values bold ideas, big dreams, and active curiosity. We foster a culture of innovation, encouraging everyone to contribute to the development and direction of our products and services, while continuously seeking new and efficient ways to work.
Collaboration and sociability are at the heart of what we do, and we take pride in coming together to achieve great things.
We offer a range of benefits to support your well-being and career growth, including:
Competitive Salary
Generous Holiday Allowance: 25 days' holiday plus bank holidays, with the option of adding up to 5 additional unpaid leave days per year
Annual Lifestyle Allowance: £300 to spend on an activity of your choice
Pension Scheme: Matched up to 6% for the first 3 years, and up to 10% thereafter
Private Health Insurance: Provided by Vitality
Group Income Protection Scheme
Charitable Fundraising: Matched funding for your efforts
Cycle to Work and Gym Flex Schemes
Internal Coaching and Mentoring: Available throughout your time with us
Training and Career Progression: A strong focus on your development
Family-Friendly Policies
Free Parking
Join us at Landmark and be part of a team that supports your ambitions and growth, both personally and professionally.
