Data Engineer

Datatech
London
4 weeks ago
Create job alert

Senior AWS Data EngineerSalary: £70,000-£80,000 Dependent on ExperienceLondon - Hybrid working 3 days per week in the office 2 days Home-based Job Ref: J12931Are you ready to lead and shape the future of data infrastructure at a rapidly scaling company? A leader in consumer behaviour analytics, seeks a driven Senior Data Engineer to guide data infrastructure architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you'll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs). This is an exciting opportunity for someone looking to challenge themselves in a collaborative environment, working with a breadth of diverse data and cutting edge technologies. You'll have proven experience developing AWS Cloud platforms end to end, orchestrating data using Dagster or similar as well as coding in Python and SQL.Key Responsibilities●Develop and optimize ETL/ELT processes to support data transformation and integrity for analytics.●Explore and evaluate new data warehousing solutions, including Snowflake, to improve data accessibility and scalability.●Partner with product and engineering teams to define data architecture and best practices for reporting.●Ensure data security, compliance, and governance across data systems.●Implement and maintain CI/CD pipelines to automate data workflows and enhance system reliability.●Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance. Who are you?A Data Engineer with 5+ years of experienceEssential Skills and Experience:●Hands-on experience with AWS services, including Lambda, Glue, Athena, RDS, and S3.●Strong SQL skills for data transformation, cleaning, and loading.●Strong coding experience with Python and Pandas.●Experience with any flavour of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc. ●Build processes supporting data transformation, data structures, metadata, dependency and workload management.●Experience supporting and working with cross-functional teams in a dynamic environment.●Strong communication skills to collaborate with remote teams (US, Canada)Nice to Have●Familiarity with LLMs including fine-tuning and RAG.●Knowledge of Statistics ●Knowledge of DataOps best practices, including CI/CD for data workflows.Additional RequirementsCandidates must have an existing and future right to live and work in the UK. Sponsorship at any point is not available.If this sounds like the role for you then please apply today!Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: (url removed) <(url removed)

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Tips for Staying Inspired: How Machine Learning Pros Fuel Creativity and Innovation

Machine learning (ML) continues to reshape industries—from personalised e-commerce recommendations and autonomous vehicles to advanced healthcare diagnostics and predictive maintenance in manufacturing. Yet behind every revolutionary model lies a challenging and sometimes repetitive process: data cleaning, hyperparameter tuning, infrastructure management, stakeholder communications, and constant performance monitoring. It’s no wonder many ML professionals can experience creative fatigue or get stuck in the daily grind. So, how do machine learning experts keep their spark alive and continually generate fresh ideas? Below, you’ll find ten actionable strategies that successful ML engineers, data scientists, and research scientists use to stay innovative and push boundaries. Whether you’re an experienced practitioner or just breaking into the field, these tips can help you fuel creativity and discover new angles for solving complex problems.

Top 10 Machine Learning Career Myths Debunked: Key Facts for Aspiring Professionals

Machine learning (ML) has become one of the hottest fields in technology—touching everything from recommendation engines and self-driving cars to language translation and healthcare diagnostics. The immense potential of ML, combined with attractive compensation packages and high-profile success stories, has spurred countless professionals and students to explore this career path. Yet, despite the boom in demand and innovation, machine learning is not exempt from myths and misconceptions. At MachineLearningJobs.co.uk, we’ve had front-row seats to the real-life career journeys and hiring needs in this field. We see, time and again, that outdated assumptions—like needing a PhD from a top university or that ML is purely about deep neural networks—can mislead new entrants and even deter seasoned professionals from making a successful transition. If you’re curious about a career in machine learning or looking to take your existing ML expertise to the next level, this article is for you. Below, we debunk 10 of the most persistent myths about machine learning careers and offer a clear-eyed view of the essential skills, opportunities, and realistic paths forward. By the end, you’ll be better equipped to make informed decisions about your future in this dynamic and rewarding domain.

Global vs. Local: Comparing the UK Machine Learning Job Market to International Landscapes

How to evaluate opportunities, salaries, and work culture in machine learning across the UK, the US, Europe, and Asia Machine learning (ML) has rapidly transcended the research labs of academia to become a foundational pillar of modern technology. From recommendation engines and autonomous vehicles to fraud detection and personalised healthcare, machine learning techniques are increasingly ubiquitous, transforming how organisations operate. This surge in applications has fuelled an extraordinary global demand for ML professionals—data scientists, ML engineers, research scientists, and more. In this article, we’ll examine how the UK machine learning job market compares to prominent international hubs, including the United States, Europe, and Asia. We’ll explore hiring trends, salary ranges, workplace cultures, and the nuances of remote and overseas roles. Whether you’re a fresh graduate aiming to break into the field, a software engineer with an ML specialisation, or a seasoned professional seeking your next challenge, understanding the global ML landscape is essential for making an informed career move. By the end of this overview, you’ll be equipped with insights into which regions offer the best blend of salaries, work-life balance, and cutting-edge projects—plus practical tips on how to succeed in a domain that’s constantly evolving. Let’s dive in.