Senior Backend Engineer - Data Engineer

St James's
3 days ago
Create job alert

Our Energy client seeks a Senior Backend Engineer - Data Engineer to join their team in Mayfair, London.

We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions.

Hybrid working is in play, with 3 days in the office and 2 days at home.

Senior Backend Engineer - Data Engineer - About the role:

My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications, user tools, and automated trading workflows.

You will collaborate closely with analysts, data scientists, and business stakeholders to translate requirements into robust, scalable backend solutions. You’ll be responsible for designing and developing services, APIs, data pipelines, and internal applications that integrate analytics and enable better decision-making and operational efficiency.

This is a hands-on role for someone who thrives in a fast-paced, build-first culture without multiple tiers of management. You should be excited to take full ownership of backend development, lead on best practices, and coach others in a collaborative, delivery-focused team.

Experience in retail or wholesale electricity and gas markets is helpful, but a willingness to become an expert in this field is essential. Our success is based on understanding the subject matter from first principles.

Senior Backend Engineer - Data Engineer - Key Responsibilities:

  • Architect, design, develop and maintain backend systems for analytics-driven applications, user tools, and automation workflows.

  • Build and manage APIs and internal services using Python (FastAPI, Flask) and cloud-native tooling.

  • Develop and manage data pipelines, backend components, and supporting infrastructure.

  • Manage server resources and backend processing environments to ensure reliability and scalability.

  • Monitor and maintain application performance, availability, and data quality across production systems.

  • Implement and maintain CI/CD pipelines, testing frameworks, and DevOps practices to enable robust delivery.

  • Write, test, and document code in line with quality standards and engineering best practices.

  • Collaborate with operations, analytics and commercial teams to gather requirements and translate them into scalable technical solutions.

  • Support analysts and data scientists in deploying and operationalising analytics tools and models.

  • Lead or support the data engineering team, help structure development workflows, and mentor junior team members.

  • Stay current with technological advancements and promote a culture of continuous improvement.

  • Present technical solutions to stakeholders and train non-technical users on tools and workflows.

    Senior Backend Engineer - Data Engineer - Skills Required:

  • Python (FastAPI, Flask)

  • REST API development

  • Containerisation: Docker, Kubernetes

  • CI/CD: Azure DevOps, GitHub Actions

  • Software testing and documentation practices

  • SQL, PySpark, Databricks

  • Relational databases and data lake architecture

  • Model and data pipeline integration (e.g. MLflow)

  • Streamlit or other lightweight UI frameworks

  • Microsoft Azure (Functions, Storage, Compute)

  • Monitoring tools (Grafana, Prometheus, etc.)

  • Performance optimisation and resource management

  • Agile delivery practices (Jira, Azure Boards, etc.)

  • Strong communication with technical and business teams

  • Mentoring and knowledge sharing within the team

    Desirable Skills:

  • Experience in energy supply or trading

  • Familiarity with dbt or modular analytics tooling

  • Exposure to forecasting or optimisation workflows

  • Knowledge of React or frontend tools for internal apps

  • Networking or IoT integration experience

    What they offer:

  • A high-autonomy role in a flat, delivery-focused team

  • Ownership of backend systems for real-time analytics and automation

  • A fast-moving, hands-on culture with meaningful technical challenges

  • The opportunity to apply software and data engineering to real-world energy problems

Related Jobs

View all jobs

Senior Backend Engineer - Data Engineer

Senior Java Backend Engineer

Python Developer

Senior Ad Tech Engineer

Javascript Developer

BackEnd Developer - Abu Dhabi - 12 months - Relocation package

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

UK Visa & Work Permits Explained: Your Essential Guide for International Machine Learning Professionals

Machine learning continues to redefine the global tech landscape, enabling transformative breakthroughs in sectors as diverse as healthcare, finance, retail, gaming, and autonomous vehicles. The United Kingdom has emerged as a hotbed for machine learning (ML) research and development, thanks to its world-class universities, well-funded start-up scene, and a broad base of established corporations adopting AI-driven solutions. For international professionals specialising in ML, the UK’s growing demand and favourable ecosystem offer exciting opportunities to innovate and advance your career. Yet, before you can join this dynamic environment, you’ll need to secure the correct work visa or permit. This article offers a comprehensive breakdown of the UK visa routes most relevant to machine learning specialists, including eligibility criteria, application processes, and practical tips for a successful transition. Whether you’re an ML researcher, data scientist, AI engineer, or deep learning specialist, understanding the UK immigration framework is the first step to pursuing your career goals in Britain’s vibrant tech sector.

Leading UK Machine Learning Labs and Institutes: Pioneering the Future of AI

Over the past decade, machine learning (ML) has transformed from an academic field into a linchpin of commercial innovation. From personalised product recommendations to healthcare diagnostics, it fuels the algorithms behind every major breakthrough in the digital world. For data-driven enterprises and researchers, the United Kingdom offers a vibrant landscape of top-tier ML labs, academic institutes, and forward-looking industries. If you’re aiming to forge a career in this exciting domain—be it in cutting-edge research, industry applications, or policy-making—this comprehensive guide, written for MachineLearningJobs.co.uk, will walk you through the leading UK machine learning hubs. We’ll delve into the opportunities they present, the latest research challenges they tackle, and the career paths that await those ready to shape the future of AI.

Shadowing and Mentorship in Machine Learning: Gaining Experience Before Your First Full-Time Role

How to Find Mentors, Build Industry Connections, and Hone Your Technical & Soft Skills for a Thriving ML Career Machine learning (ML) is transforming industries at a rapid pace, fuelling breakthroughs in healthcare, finance, e-commerce, manufacturing, cybersecurity, and beyond. As the demand for ML expertise skyrockets, the competition for early-career opportunities has intensified. It’s not enough to complete an online course or a university degree; employers are looking for proven, hands-on experience. So, how do you stand out from the crowd? Two powerful strategies—shadowing and mentorship—can help you bridge the gap between academic theory and industry practice. By learning directly from experienced professionals, you gain practical insights and build the confidence needed to excel in real-world ML roles. In this in-depth guide, we’ll explore why mentorship is crucial, how to find the right mentors (both formally and informally), how to demonstrate your value as a mentee, and the best ways to shadow machine learning practitioners. By the end, you’ll be equipped with the knowledge and tactics to jump-start your career and secure your first full-time ML role.