Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer

So Energy
London
6 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

🌍 London, Hybrid

⭐️ Our Perks
















  • Personalised Learning and Development Budget














  • Hybrid working hours – Each team has their own Smart Working Charter that empowers you to do your work in the best way you can














  • 25 Holiday Days + your local bank holidays














  • 1 Birthday day – it only happens once a year!














  • 3 So Giving Days - spend these days giving back to your chosen cause














  • Religious Celebrations Leave














  •  Mental Healthcare – Sessions with Unmind














  • Enhanced Family Leave














🤝Values-driven culture – we’re really proud of our culture.

So Energy

Who we are:

So Energy was created in 2015 because we knew energy suppliers could be better. Since then, we’ve grown rapidly but sustainably, with 300,000 customers and over 450 Energists (what we call our people). But we’re not done. We’re on the road to a net zero future, and thanks to our partnership with ESB, we’re well on the way. We’re customer-centric, tech-led, and passionate about sustainability.

We want to do the best we can for our customers, each other, and our planet, so we’ve created a workplace that's encouraging, supportive, and offers the opportunity for growth. As a company, we live by six core values that guide everything we do:
















  • Clear














  • Honest














  • Ambitious














  • Inquisitive














  • Caring














  • Sustainable
















The RoleSenior Data Engineer at SO ENERGY

As a Senior Data Engineer, you will play a key role in the development and maintenance of our data infrastructure, ensuring efficient and scalable data pipelines. You will be responsible for hands-on implementation and optimization of data systems on theGoogle Cloud Platform(GCP), contributing to critical projects while mentoring junior Engineers. This role focuses on delivering technical solutions, applying best practices, and driving innovation within the data engineering team.

Reporting into our Interim Head of Data.

What you’ll be getting up to:


  • Design, develop, and maintain scalable data pipelines using modern data engineering tools and technologies on ourGCP stack.

  • Build and optimize our lake house on GoogleCloud Platform (GCP).

  • Implement data ingestion, transformation, and loading processes for various data sources (e.g., databases, APIs, cloud storage).

  • Ensure data quality, consistency, and security throughout the data pipeline.

  • Leverage GCP services (e.g.,Dataflow, Dataproc, BigQuery, Cloud Storage) to build and maintain cloud-native data solutions.

  • Implement infrastructure as code (IaC) principles usingTerraformto automate provisioning and configuration.

  • Manage and optimize cloud resources to ensure cost-efficiency and performance.

  • Design and implement efficient data models following a star schema approach to support analytical and operational workloads.

  • Collaborate with data analysts to develop advanced analytics solutions.

  • Conduct data quality analysis to drive better data management on outputs in our Curated Layer.

  • Mentor junior data engineers and provide technical guidance.

  • Contribute to the development of data engineering best practices and standards.

  • Collaborate with cross-functional teams to deliver complex data projects.

This role will be a great fit if:



  • Expert in GCP services including BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Storage, and Cloud Functions. GCP Professional Data Engineer Certification is highly favourable.
  • Advanced knowledge ofSQLfor complex data transformation and query optimization.
  • Proven experience inPythonfor scalable data pipeline development and orchestration following best practices.
  • Experience implementing Terraform for Infrastructure as Code (IaC) to automate GCP resource management.
  • Knowledge ofCI/CDpipelines and automated deployment practices.
  • Experience with containerization technologies (e.g.,Docker, Kubernetes)
  • Experience building and optimizing batch and streaming data pipelines.
  • Understanding of data governance principles, GCP security (IAM, VPC), and compliance requirements.

  • Demonstrates a growth mindset by actively seeking to learn from peers and stakeholders, fostering a culture of open communication and shared knowledge.
  • Works effectively across teams, including Data Science, Engineering, and Analytics, to understand their needs and deliver impactful data solutions.
  • Actively participates in design discussions, brainstorming sessions, and cross-functional projects, always striving for continuous improvement and innovation.
  • Builds strong relationships across the organization, using empathy and active listening to ensure alignment on goals and deliverables.
  • Approaches challenges with a growth mindset, viewing obstacles as opportunities to innovate and improve processes.
  • Applies a structured and analytical approach to solving complex problems, balancing immediate needs with long-term scalability and efficiency.
  • Demonstrates resilience under pressure, maintaining a positive and solution-focused attitude when faced with tight deadlines or ambiguity.
  • Actively seeks feedback and lessons learned from past projects to continuously refine problem-solving strategies and improve outcomes.
  • Shares expertise generously, guiding team members in adopting best practices and helping them overcome technical challenges.
  • Leads by example, demonstrating how to approach complex problems pragmatically while promoting curiosity and a willingness to explore new tools and technologies.


Research shows that some people are less likely to apply for a role
unless they are 100% qualified.Your experience, skills and passion will set you apart so tell us about your achievements, irrespective of whether they are personal or work-related, tell us about your journey, and about what you learnt.

So, if this role excites you, don’t let our role description hold you back, get applying!

APPLICATIONS CLOSE ON 13TH AUGUST 2025

Hiring Process


  1. 📞 30 minute Phone Screening with the Talent Team

  2. First Stage interview with Head of Data & BI Lead 

  3. Second Stage interview with Staff Data Engineer & Data Engineer - Technical exercise
  4.  Final Stage Cultural fit interview with Tech Director and People Partner 

Support –If you have a medical condition or an individual need for an adjustment to our process, and you believe this may affect your ability to be at your best – please let us know so we can talk about how we can best support you and make any adjustments that may be needed.

Our Values

We look for people who share our values and can add to our culture. Values are shared beliefs that guide our decision-making, culture is how we function as a group and how we live our values as individuals.

Clear - The energy industry can be pretty complex so we strive to provide clear communication to our customers and colleagues

Honest - Transparency is key, Whether that's providing clear bills to our customers or trusting our staff to do the right thing.

Ambitious - All of us are ambitious about the future of So Energy and what we can contribute to it.

Inquisitive - We are also questioning the Status Quo to see if there is a better way to do things for our customers

Caring - We care about the work we are doing, our customers and our colleagues
Sustainable - As a renewable energy company we are providing sustainable products but we also care about sustainable careers. That's why learning and continuous development is so important to us.

Diversity, Equity, Inclusion & Belonging

At So Energy, we’re committed to cultivating an environment that promotes diversity, equity, inclusion and belonging. We are a global community and we believe our unique qualities should be celebrated as they are critical to our innovation. It’s essential to us that you bring your authentic self to work every single day, no matter your age, ethnicity, religion, citizenship, gender identity, sexual orientation, disability status, caring responsibilities, neurodiversity, or otherwise. Inclusion isn’t just an initiative at So Energy. We strive to embed it not just into our values but throughout our entire culture.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Neurodiversity in Machine Learning Careers: Turning Different Thinking into a Superpower

Machine learning is about more than just models & metrics. It’s about spotting patterns others miss, asking better questions, challenging assumptions & building systems that work reliably in the real world. That makes it a natural home for many neurodivergent people. If you live with ADHD, autism or dyslexia, you may have been told your brain is “too distracted”, “too literal” or “too disorganised” for a technical career. In reality, many of the traits that can make school or traditional offices hard are exactly the traits that make for excellent ML engineers, applied scientists & MLOps specialists. This guide is written for neurodivergent ML job seekers in the UK. We’ll explore: What neurodiversity means in a machine learning context How ADHD, autism & dyslexia strengths map to ML roles Practical workplace adjustments you can ask for under UK law How to talk about neurodivergence in applications & interviews By the end, you’ll have a clearer sense of where you might thrive in ML – & how to turn “different thinking” into a genuine career advantage.

Machine Learning Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the machine learning jobs market in the UK is going through another big shift. Foundation models and generative AI are everywhere, companies are under pressure to show real ROI from AI, and cloud costs are being scrutinised like never before. Some organisations are slowing hiring or merging teams. Others are doubling down on machine learning, MLOps and AI platform engineering to stay competitive. The end result? Fewer fluffy “AI” roles, more focused machine learning roles with clear ownership and expectations. Whether you are a machine learning job seeker planning your next move, or a recruiter trying to build ML teams, understanding the key machine learning hiring trends for 2026 will help you stay ahead.

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.