Data Engineer (SC Clearance)

Amber Labs
united kingdom
3 months ago
Create job alert

Location: Remote


Work Pattern: Contract


Security Clearance: Required


The Company: 


At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff.



The Role:



We are seeking a highly skilled Data Engineer with strong expertise in AWS, EMR, Python, and PySpark to join our dynamic team. This role requires a self-starter who is confident in their technical abilities, thrives in a fast-paced environment, and has experience working within the public sector and consulting. You will play a key role in designing, building, and optimizing scalable data pipelines, working closely with cross-functional teams to deliver impactful data solutions.



Key Responsibilities:



Data Pipeline Development: Design, develop, and optimize ETL/ELT pipelines using AWS EMR, Python, and PySparkCloud Infrastructure: Build and manage scalable data processing solutions on AWS, leveraging services such as S3, Lambda, Glue, and RedshiftBig Data Processing: Work with large-scale datasetsin distributed computing environments, ensuring high performance and efficiencyAutomation & Optimization: Develop scripts to automate data ingestion, transformation, and validation processesCollaboration & Stakeholder Engagement: Work closely with clients, data scientists, and business analysts to understand requirements and deliver solutions that meet business needsConsulting & Public Sector Expertise: Provide strategic guidance on best practices in data engineering and analytics within the public sectorData Quality & Governance: Implement data validation, monitoring, and governance best practices to ensure data integrity and compliance




Requirements:


AWS Expertise: Strong experience with AWS EMR and other AWS data services (Glue, S3, Lambda, Redshift, Athena, etc.)


Programming: Proficiency in Python and PySpark for big data processing


Big Data Technologies: Hands-on experience working with distributed computing frameworks such as Spark


Self-Starter & Confident Communicator: Ability to take ownership of tasks, work autonomously, and engage confidently with stakeholders


Public Sector Experience: Previous experience working on government or public sector projects


Consulting Experience: Proven track record of working in client-facing consulting roles, delivering solutions to complex business challenges


Problem-Solving: Strong analytical and troubleshooting skills, with the ability to work under pressure in a fast-paced environment


Nice-to-Have:


Experience with Terraform, Kubernetes, or Docker for infrastructure automation.


Knowledge of SQL, NoSQL databases, and data warehousing solutions.


Familiarity with data security, governance, and compliance in the public sector.



Benefits:





Join a rapidly expanding start-up where personal growth is a part of our DNA. 



Benefit from a flexible work environment focused on deliverable outcomes. 


Receive private medical insurance through Aviva. 


Enjoy the benefits of a company pension plan through Nest. 


25 days of annual leave plus UK bank holidays. 


Access Perkbox, a global employee rewards platform offering discounts, perks, and wellness resources. 


Participate in a generous employee referral program. 


A highly collaborative and collegial environment with opportunities for career advancement. 


Be encouraged to take bold steps and embrace a mindset of experimentation. 


Choose your preferred device, PC or Mac.



Diversity & Inclusion:



Here at Amber Labs, we are dedicated to fostering an inclusive and equitable workplace for all. Our commitment to diversity, equality, and inclusion includes:
Valuing the unique experiences, perspectives, and backgrounds of all employees and creating an environment where everyone feels welcomed, respected, and valued.
Prohibiting all forms of harassment, bullying, discrimination, and victimisation and promoting a culture of dignity and respect for all.
Educating all new hires on our Diversity and Inclusion policies and ensuring they are aware of their rights and responsibilities to create a safe and inclusive workplace.
By taking these steps, we are dedicated to building a workplace that reflects and celebrates the diversity of our employees and communities.
This role at Amber Labs is a permanent position, and all employees are required to meet the Baseline Personnel Security Standard (BPSS). Please be advised that, at this time, we are unable to consider candidates who require sponsorship or hold a visa of any type.















What Happens Next?


Our Talent Acquisition Team will be in touch to advise you on the next steps. We have a two-stage interview process for most of our consultants. In certain cases, we may include a third and final stage, which is a conversation with the company Partners. This will only be considered if deemed necessary.

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Veterans in Machine Learning: A Military‑to‑Civilian Pathway into AI Careers

Introduction Artificial intelligence is no longer relegated to sci‑fi films—it underpins battlefield decision‑support, fraud detection, and even supermarket logistics. The UK Government’s 2025 AI Sector Deal forecasts an additional £200 billion in GDP by 2030, with machine‑learning (ML) engineers cited as the nation’s second most in‑demand tech role (Tech Nation 2024). The Ministry of Defence’s Defence AI Strategy echoes that urgency, earmarking £1.6 billion for FY 2025–28 to embed ML into planning, logistics, and autonomous systems. If you have ever tuned a radar filter, plotted artillery trajectories, or sifted sensor data for actionable intel, you have already worked with statistical modelling—the backbone of machine learning. This guide shows UK veterans how to reframe military experience for ML roles, leverage MoD transition funding, and land high‑impact positions building the models shaping tomorrow’s defence and commercial landscapes. Quick Win: Bookmark our live board for Machine‑Learning Engineer roles to see who’s hiring today.

Rural-Remote Machine Learning Jobs: Finding Balance Beyond the Big Cities

Over the past decade, machine learning (ML) has transformed from a niche research domain into a pervasive technology underpinning everything from recommendation systems and voice assistants to financial forecasting and autonomous vehicles. Historically, the UK’s major tech hubs—particularly London—have been magnets for top ML talent and corporate headquarters. However, remote work has become mainstream, and many ML professionals are realising they can excel in their field while living far beyond the city limits. At MachineLearningJobs.co.uk, we’ve observed a growing interest in positions that allow for a rural lifestyle or a coastal environment, often reflected in search terms like “ML remote countryside” or “tech jobs by the sea.” This surge is no coincidence. Flexible work policies, better rural broadband, and the nature of machine learning tasks—much of which can be done through cloud platforms—are bringing new opportunities to those who wish to swap urban hustle for fresh air and scenic views. Whether you’re a data scientist, ML engineer, researcher, or product manager, a rural or seaside move could reinvigorate your work-life balance. In this article, we’ll unpack why rural-remote ML jobs are on the rise, how you can navigate the challenges of leaving the city, and what you need to do to thrive in a machine learning career beyond the M25. If you’ve dreamt of looking up from your laptop to rolling fields or ocean waves, keep reading—your rural ML role might be closer than you think.

Quantum-Enhanced Machine Learning—Propelling AI into the Next Frontier

Machine learning (ML) has revolutionised how we interpret data, build predictive models, and create intelligent applications. From recommendation engines and self-driving cars to advanced genomics and natural language processing, ML solutions are integral to nearly every corner of modern life. However, as data complexity and model size continue to skyrocket, the computational demands placed on ML systems grow in tandem—often pushing even high-performance classical computers to their limits. In recent years, quantum computing has emerged as a tantalising solution to these challenges. Unlike traditional digital systems, quantum computers exploit quantum mechanics—superposition and entanglement—to process information in ways that defy conventional logic. As these machines mature, they promise exponential speed-ups for certain tasks, potentially reshaping how we approach AI and data-intensive challenges. What does this mean for machine learning? Enter quantum-enhanced ML, a new frontier where quantum processors and classical ML frameworks unite to accelerate model training, tackle high-dimensional data, and solve complex optimisation tasks more efficiently. In this article, we will: Unpack the current state of machine learning, highlighting key bottlenecks. Provide a concise overview of quantum computing—why it’s radical and how it differs from classical technology. Examine potential breakthroughs in quantum-enhanced ML, including real-world use cases and technical approaches. Explore the roles and skill sets that will define this quantum-AI era, with guidance on how to prepare. Discuss the roadblocks (like hardware maturity and ethical concerns) and how they might be addressed in the years to come. If you’re a machine learning engineer, data scientist, or simply an AI enthusiast fascinated by the next wave of computational innovation, read on—quantum computing could become an integral part of your future toolkit, opening up job opportunities and reimagining what ML can achieve.