Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Mid/Senior Data Engineer

Methods Business and Digital Technology
Sheffield
2 days ago
Create job alert

Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanent basis.

This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.

What You'll Be Doing as a Data Engineer:
  • Lead technical aspects of data engineering projects, providing direction and mentorship to junior and mid-level engineers
  • Design and architect modern data solutions that align with business objectives and technical requirements
  • Design and implement advanced ETL/ELT pipelines
  • Build highly scalable and performant data solutions leveraging cloud platforms and open-source software
  • Develop data models to handle enterprise-level analytical needs
  • Make critical technical decisions on tools, frameworks, and approaches for complex data challenges
  • Optimise large-scale data processing systems for performance and cost-efficiency
  • Implement robust data quality frameworks and monitoring solutions
  • Evaluate new technologies to enhance our data engineering capabilities
  • Collaborate with stakeholders to translate business requirements into technical specifications
  • Present technical solutions to leadership and non-technical stakeholders
  • Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice
Your Impact:
  • Enable business leaders to make informed decisions with confidence through timely, accurate data insights
  • Drive adoption of modern data architectures and platforms
  • Deliver seamless data solutions that enhance user experience
  • Elevate the technical capabilities of the entire data engineering team
  • Help cultivate a data-driven culture within the organisation
  • Establish technical standards and patterns that ensure quality and maintainability
Requirements

You Will Demonstrate:

  • Proven experience leading technical aspects of data projects
  • Strong data architecture and modelling skills with the ability to design scalable data solutions
  • Experience mentoring junior engineers and providing technical guidance
  • Deep understanding of data warehouse design principles and methodologies
  • Advanced knowledge of optimisation techniques for large-scale data processing
  • Strong proficiency in SQL and Python for handling complex data problems
  • Hands-on experience with Apache Spark (PySpark or Spark SQL)
  • Experience with the Azure data stack
  • Knowledge of workflow orchestration tools like Azure Data Factory or Apache Airflow
  • Experience with containerisation technologies like Docker
  • Proficiency in dimensional modelling techniques
  • Experience with CI/CD pipelines for data solutions
  • Experience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks
  • Strong communication skills for translating complex technical concepts
  • Track record of successful project delivery in a technical leadership capacity

You may also have some of the desirable skills and experience:

  • Experience designing and implementing data mesh or data fabric architectures
  • Knowledge of cost optimisation strategies for cloud data platforms
  • Experience with data quality frameworks and implementation
  • Understanding of data lineage and metadata management
  • Experience with technical project management
  • Experience with data visualisation tools like Power BI or Apache Superset
  • Experience with other cloud data platforms like AWS, GCP or Oracle
  • Experience with modern unified data platforms like Databricks or Microsoft Fabric
  • Experience with Kubernetes for container orchestration
  • Understanding of streaming technologies (Apache Kafka, event-based architectures)
  • Software engineering background with SOLID principles understanding
  • Experience with high-performance, large-scale data systems
  • Knowledge of recent innovations in AI/ML and GenAI
  • Defence/Public Sector consultant experience
Security Clearance:

UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process.

Our Hiring Process
  1. Internal Application Review
  2. Initial Phone Screen
  3. Technical Interview
  4. Pair Programming Exercise
  5. Final Interview
  6. Offer
Benefits

Working at MA

Methods Analytics (MA) exists to improve society by helping people make better decisions with data.

We use a collaborative, creative and user centric approach to data to do good and solve difficult problems.

By joining us you can expect

  • Autonomy to develop and grow your skills and experience
  • Be part of exciting project work that is making a difference in society
  • Strong, inspiring, and thought-provoking leadership
  • A supportive and collaborative environment

As well as this, we offer:

  • Annual two-day technical hackathon bringing together all technical teams for innovation and collaboration
  • Monthly Engineering & Architecture Community of Practice event
  • Bi-annual whole company teambuilding events bringing everyone together for a day of fun and connection
  • Development access to Pluralsight and LinkedIn Learning
  • Volunteering - 2 paid days per year to volunteer in our local communities or within a charity organisation
  • Private Medical Insurance which is non-contributory (spouse and dependants included)
  • Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
  • Discretionary Company Bonus based on company and individual performance
  • Life Assurance of 4 times base salary
  • Time off - 25 days of annual leave a year, plus bank holidays, with the option to buy 5 extra days each year
  • Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
  • Wellness 24/7 Confidential employee assistance programme
  • Social - office parties, pizza Friday and commitment to charitable causes


#J-18808-Ljbffr

Related Jobs

View all jobs

Mid/Senior Data Engineer

Mid/Senior Data Engineer

Mid/Senior Data Engineer

Mid/Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.

Why the UK Could Be the World’s Next Machine Learning Jobs Hub

Machine learning (ML) is becoming essential to industries across the globe—from finance and healthcare to retail, logistics, defence, and the public sector. Its ability to uncover patterns in data, make predictions, drive automation, and increase operational efficiency has made it one of the most in-demand skill sets in the technology world. In the UK, machine learning roles—from engineers to researchers, product managers to analysts—are increasingly central to innovation. Universities are expanding ML programmes, enterprises are scaling ML deployments, and startups are offering applied ML solutions. All signs point toward a surging need for professionals skilled in modelling, algorithms, data pipelines, and AI systems. This article explores why the United Kingdom is exceptionally well positioned to become a global machine learning jobs hub. It examines the current landscape, strengths, career paths, sector-specific demand, challenges, and what must happen for this vision to become reality.