Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer

Collinson
Haywards Heath
1 day ago
Create job alert

Purpose of the job


The Data Engineering Team is responsible for maintaining and enhancing the data platform, to deliver business value to both internal and external stakeholders.


As a Data Engineer, you’ll be a key member of this team which delivers functionality using the Agile delivery methodology. You will be responsible for designing, building, and maintaining data pipelines under the guidance of a Principal Software Engineer to the agreed development plan and to approved specifications.


You will have the opportunity to bring innovation to the team, using cutting-edge data engineering frameworks and techniques.


Key Responsibilities


-Design, develop, and maintain data pipelines for collecting, transforming, and loading data into various data stores

-Write efficient and scalable code in languages such as Python

-Develop collaborative relationships with internal stakeholders to understand their data requirements and provide solutions

-Resolve day-to-day challenges or issues without the need for technical guidance

-Provide competent, proactive, and professional technical support when required

-Deliver supporting documentation of a high quality

-Actively engage in and contribute to agile planning and design sessions

-Support agile process improvements that will improve productivity, effectiveness, and professionalism of the team, without impacting budgets and delivery plans

-Contribute to the Code Peer Review community to improve the quality of code produced and ensure it adheres to our standards

-Participate in regular team meetings to ensure the correct tasks are being worked on and share key decisions required, risks identified and highlight any issues encountered

-Support, Develop and Improve our CI/CD pipelines

-Maintain a good technical awareness and familiarity with new and forthcoming relevant Technologies



Knowledge, skills and experience required


Required:

-University Degree in computer science, engineering, or related experience required

-At least 5 years’ experience in a Data Engineering role or with similar technical systems and technologies

-Experience with Scrum, Kanban, or another Agile application development methodology

-Experience of working across multiple delivery organisations practising distributed development


Specific Technical Skills:

-In-depth understanding of modern data architectures and data modelling practices

-Strong programming skills in Python, PySpark

-Extensive experience with AWS Technologies (Aurora, Glue, Lambda, Step Functions, S3, API Gateway, SQS, SNS, Athena)

-Familiarity with CI/CD for data pipelines using Terraform, CodeBuild and Flyway

-Usage of Source Control tools (GitHub Enterprise)


Personal Skills:

-The ability to demonstrate through examples, the effective management of stakeholder relationships

-Excellent written and spoken English

-Personable, enthusiastic and a good communicator (ability to present, inform and guide others)

-Ability to bridge communications between technical and business focussed groups

-Passionate about technology – willingness to learn about new and emerging technology within web, cloud, languages, frameworks, and methodologies

-Ability to thrive in a fast moving and changing environment

-Ability to show initiative and to work independently

-Willingness to take on a variety of roles and responsibilities



Collinson is an equal opportunity employer and welcomes differences in all their forms including: colour, race, ethnicity, gender identity, sexual orientation, neurodivergence, family status, age, individuals with disabilities and people from all backgrounds, cultures and experiences as we strongly believe this contributes to our on-going success.


We are focused on continually evolving our purpose driven, high performing culture, providing an environment where our people have the opportunity to achieve their full potential and do interesting and meaningful work. Our company values are: Take Action, Do the right thing, One team and Be insight led. These help guide everything we do internally in terms of how we think, act and interact, right through to how we deliver value to our customers and clients.


In your application, please feel free to note which pronouns you use (For example - she/her/hers, he/him/his, they/them/theirs, etc).


If you need any extra support throughout the interview process, then please email us at

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Neurodiversity in Machine Learning Careers: Turning Different Thinking into a Superpower

Machine learning is about more than just models & metrics. It’s about spotting patterns others miss, asking better questions, challenging assumptions & building systems that work reliably in the real world. That makes it a natural home for many neurodivergent people. If you live with ADHD, autism or dyslexia, you may have been told your brain is “too distracted”, “too literal” or “too disorganised” for a technical career. In reality, many of the traits that can make school or traditional offices hard are exactly the traits that make for excellent ML engineers, applied scientists & MLOps specialists. This guide is written for neurodivergent ML job seekers in the UK. We’ll explore: What neurodiversity means in a machine learning context How ADHD, autism & dyslexia strengths map to ML roles Practical workplace adjustments you can ask for under UK law How to talk about neurodivergence in applications & interviews By the end, you’ll have a clearer sense of where you might thrive in ML – & how to turn “different thinking” into a genuine career advantage.

Machine Learning Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the machine learning jobs market in the UK is going through another big shift. Foundation models and generative AI are everywhere, companies are under pressure to show real ROI from AI, and cloud costs are being scrutinised like never before. Some organisations are slowing hiring or merging teams. Others are doubling down on machine learning, MLOps and AI platform engineering to stay competitive. The end result? Fewer fluffy “AI” roles, more focused machine learning roles with clear ownership and expectations. Whether you are a machine learning job seeker planning your next move, or a recruiter trying to build ML teams, understanding the key machine learning hiring trends for 2026 will help you stay ahead.

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.