SC Data Engineer - AWS

LA International
London
2 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer - SC Cleared

Gen AI Developer (SC Clearance required)

Data Engineer

Data Engineer

Configuration and Product Data Management

Configuration and Product Data Management

SC Data Engineer - AWS

IR35: Outside
Rate: £400-450 / day (negotiable)
Clearance: SC
Start: ASAP
Duration: 6 months (extensions expected)
Location: Remote with occasional travel to Bristol / London

Job Brief: We are seeking a skilled and motivated Data Engineer with expertise in AWS to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines that process vast amounts of data across different platforms. They will leverage AWS technologies to ensure seamless integration and optimization of data flows, ensuring high availability, security, and efficiency.

Skills & Qualifications:
* Strong experience with AWS services such as S3, Redshift, EC2, Lambda, Glue, Athena, and EMR.
* Proficiency in programming languages such as Python, Java, or Scala for data engineering tasks.
* Experience with data warehousing, ETL (Extract, Transform, Load) processes, and data integration.
* In-depth knowledge of cloud-based architectures and best practices for deploying data pipelines in AWS.
* Expertise in designing and implementing scalable and efficient data pipelines for both batch and real-time processing.
* Hands-on experience with data transformation and data processing frameworks (e.g., Apache Spark, Apache Kafka).
* Solid understanding of relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., DynamoDB, MongoDB).
* Familiarity with data security, governance, and compliance standards, particularly in cloud environments.
* Strong problem-solving skills and attention to detail.
* Excellent communication skills for collaboration with cross-functional teams.
* Ability to work in an agile development environment and manage multiple priorities.

Preferred Qualifications:
* Experience with containerization technologies like Docker and Kubernetes.
* Knowledge of data lakes, serverless architectures, and microservices.
* Familiarity with DevOps practices and CI/CD pipelines for automated deployment of data solutions.
* Certifications such as AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect are a plus.

Responsibilities:
* Design, develop, and optimize data pipelines on AWS to ingest, process, and transform data.
* Collaborate with data scientists, analysts, and business teams to understand requirements and deliver data solutions.
* Implement and manage efficient data storage solutions using AWS technologies.
* Ensure data quality, security, and compliance across all data engineering processes.
* Continuously monitor and improve data systems to ensure scalability and performance.
* Contribute to the development and implementation of best practices and standards for data engineering.

APPLY NOW!


Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

Tips for Staying Inspired: How Machine Learning Pros Fuel Creativity and Innovation

Machine learning (ML) continues to reshape industries—from personalised e-commerce recommendations and autonomous vehicles to advanced healthcare diagnostics and predictive maintenance in manufacturing. Yet behind every revolutionary model lies a challenging and sometimes repetitive process: data cleaning, hyperparameter tuning, infrastructure management, stakeholder communications, and constant performance monitoring. It’s no wonder many ML professionals can experience creative fatigue or get stuck in the daily grind. So, how do machine learning experts keep their spark alive and continually generate fresh ideas? Below, you’ll find ten actionable strategies that successful ML engineers, data scientists, and research scientists use to stay innovative and push boundaries. Whether you’re an experienced practitioner or just breaking into the field, these tips can help you fuel creativity and discover new angles for solving complex problems.

Careers

Top 10 Machine Learning Career Myths Debunked: Key Facts for Aspiring Professionals

Machine learning (ML) has become one of the hottest fields in technology—touching everything from recommendation engines and self-driving cars to language translation and healthcare diagnostics. The immense potential of ML, combined with attractive compensation packages and high-profile success stories, has spurred countless professionals and students to explore this career path. Yet, despite the boom in demand and innovation, machine learning is not exempt from myths and misconceptions. At MachineLearningJobs.co.uk, we’ve had front-row seats to the real-life career journeys and hiring needs in this field. We see, time and again, that outdated assumptions—like needing a PhD from a top university or that ML is purely about deep neural networks—can mislead new entrants and even deter seasoned professionals from making a successful transition. If you’re curious about a career in machine learning or looking to take your existing ML expertise to the next level, this article is for you. Below, we debunk 10 of the most persistent myths about machine learning careers and offer a clear-eyed view of the essential skills, opportunities, and realistic paths forward. By the end, you’ll be better equipped to make informed decisions about your future in this dynamic and rewarding domain.

Careers

Global vs. Local: Comparing the UK Machine Learning Job Market to International Landscapes

How to evaluate opportunities, salaries, and work culture in machine learning across the UK, the US, Europe, and Asia Machine learning (ML) has rapidly transcended the research labs of academia to become a foundational pillar of modern technology. From recommendation engines and autonomous vehicles to fraud detection and personalised healthcare, machine learning techniques are increasingly ubiquitous, transforming how organisations operate. This surge in applications has fuelled an extraordinary global demand for ML professionals—data scientists, ML engineers, research scientists, and more. In this article, we’ll examine how the UK machine learning job market compares to prominent international hubs, including the United States, Europe, and Asia. We’ll explore hiring trends, salary ranges, workplace cultures, and the nuances of remote and overseas roles. Whether you’re a fresh graduate aiming to break into the field, a software engineer with an ML specialisation, or a seasoned professional seeking your next challenge, understanding the global ML landscape is essential for making an informed career move. By the end of this overview, you’ll be equipped with insights into which regions offer the best blend of salaries, work-life balance, and cutting-edge projects—plus practical tips on how to succeed in a domain that’s constantly evolving. Let’s dive in.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.