Senior Data Engineer

Hypercube Talent
UK
7 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Databricks

Senior Data Engineer - DV Cleared

Senior Data Engineer - MS Fabric - Remote - £70k - £75k

Compensation £70,000 - £85,000 Base Benefits TL;DR Principal/Staff level data engineer role Fast growing home energy management start-up, based in Liverpool Remote, flexible work arrangements Responsible for shaping, leading, and driving the data platform Ownership of the data lake and integrated technologies Must have AWS, Kafka, Python, Databricks, Spark Experience in Energy and working with data and AI teams, a bonus Who are we? Heatio wants to connect to millions of residential homes and drive down the cost of bills and emissions at scale. Heatio is a young, fast-growing data and AI platform startup looking to disrupt the energy and data industries through real time household modelling and developing best in class agile software culture. Based in Liverpool, our mix of hardware expertise, knowledge of the market, and our expanding virtual power plant (VPP) technology has enabled us to gain rapid traction from large energy providers to cutting-edge home energy technology manufacturers. To understand more about who we are and what we do, visit our website here:https://www.heatio.comTo get a better understanding of how we think and some of the organisations we work with, check out our podcast here:https://open.spotify.com/show/6x4X3u0PjnTM2I7tDZpvGTRole purpose First of all - we're adaptable and interested in a mix of people to make the best team. We're currently looking for someone at the Senior or Principal/Staff level in (or a mix of) the following roles: Data Engineering, Machine Learning Engineering (MLOps), and Software Engineering. This role will primarily be the technical owner of our data lake and the subsequent pipelines and integrations between our platform's services. To keep our data and governance at the highest levels possible. To continually iterate and improve how we use, ingest and model data aligned to our business goals. We are looking to build a best in class engineering and data business, and as such we are looking for an experienced lead to step change our business and technical development. Success in terms of data engineering is developing a cost-effective delivery of our data lake and subsequent outcomes from an insight, automation and modelling perspective. Success in this role will be defined by building a cost-effective delivery of our data lake and subsequent outcomes from an insight, automation and modelling perspective to support the monitoring of homes and their devices in real time and make intelligent, automated, decisions leveraging best-in-class engineer practices to scale AI and machine learning models across a growing diversity of uses cases. Day-to-day work will involve project delivery and collaborating with stakeholders across our internal and customer teams. You will achieve leverage through excellent code, strong practices, and enabling your team to deliver more, at pace, in an agile environment. Technical work will include building, testing, deploying, maintaining, packaging, and explaining software to support our machine learning, data platform, and advanced analytics solutions for our customers - built with modern tools across the open source and cloud platform landscape. You'll spend time shaping requirements and working with the Product team to turn the roadmap into production-grade solutions. You will act as a champion and subject-matter expert for data engineering across the business, helping to cross-skill and upskill others. Accountabilities Work with developers, managers, and business stakeholders to understand and define components of the data landscape and how it relates to the data strategy Understand and translate end-user requirements into designs and delivery plans for effective data and analytics solutions Leverage open source and cloud platform technologies to deliver robust solutions Design, develop, execute, and maintain a data platform to support analytics, AI, and machine learning workflows using the latest best practices in Data Engineering Input into and close collaboration with the emerging MLOps and ML Engineering practices here at Heatio Produce high-quality communications, documentation, and presentations of solutions for colleagues and customers Subject-matter expert and evangelist for data / machine learning engineering Helping to grow both our internal knowledge and skill sets as we scale. Technical skills We understand that this list is extensive, please apply if you fit some or only part of it we're flexible and are mostly looking for bright people who can adapt as the role grows. We want to see the broadest range of possible candidates from a diverse mix of backgrounds. Technical skills are only part of the equation. Ideal candidates will have hands-on experience with the following core skills in a previous role: Kafka Python SQL Databricks (and Spark) Cloud platform architecture in AWS Additional experience with the following would be beneficial, but not essential: Infrastructure-as-Code (Terraform) Data modelling (Kimball, Imnon) Orchestration tools - Apache Airflow / AWS Glue Containers and related services (Docker, Kubernetes) Backend software development (Java, APIs, Scalability, Logging and Monitoring etc.) Warehouse and analytics tools (Spark, Athena) Machine learning Digital twins Energy sector experience Hardware integration Other desirable skills and experience Scale up experience is essential A proven track record of being a leader within scaling engineering teams and culture. Experience in the energy sector, especially home energy management systems, highly beneficial Ability to act as a driving force in a growing technology start-up Strong stakeholder management Analysis/requirements gathering, solution design, and implementation of technology solutions Experience in collaborating in and leading multidisciplinary teams, including software engineers, DevOps and infrastructure teams, data scientists etc. Exceptional communication skills, both written and verbal, able to translate complex technical subject matter into easily understood presentations and written documentation for mixed technical audiences. What's in it for you? We are a small and flat organisation where we believe in radical candour, speed of decision-making, and not being a d\ck. Those are our core values. We believe every hire is an opportunity to change the business, and that is our intention. You'll be one of the earliest hires for our organisation and, therefore, will have a huge impact on the culture and how it is shaped. You'll have the chance to influence decisions in a fast-paced start-up and grow with the organisation. You'll have direct access to our existing team of experienced leaders and their wider network. Benefits Pension Flexible working Private health insurance IMPORTANT Heatio is committed to creating a diverse and inclusive employee environment which is as representative as possible of our society. All qualified applicants will receive consideration for employment without regard to age, disability, gender reassignment, marriage and civil partnership, pregnancy/maternity, race, nationality, religion or belief, gender, and sexual orientation.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

Machine learning is fuelling innovation across every industry, from healthcare to retail to financial services. As organisations look to harness large datasets and predictive algorithms to gain competitive advantages, the demand for skilled ML professionals continues to soar. Whether you’re aiming for a machine learning engineer role or a research scientist position, strong interview performance can open doors to dynamic projects and fulfilling careers. However, machine learning interviews differ from standard software engineering ones. Beyond coding proficiency, you’ll be tested on algorithms, mathematics, data manipulation, and applied problem-solving skills. Employers also expect you to discuss how to deploy models in production and maintain them effectively—touching on MLOps or advanced system design for scaling model inferences. In this guide, we’ve compiled 30 real coding & system‑design questions you might face in a machine learning job interview. From linear regression to distributed training strategies, these questions aim to test your depth of knowledge and practical know‑how. And if you’re ready to find your next ML opportunity in the UK, head to www.machinelearningjobs.co.uk—a prime location for the latest machine learning vacancies. Let’s dive in and gear up for success in your forthcoming interviews.

Negotiating Your Machine Learning Job Offer: Equity, Bonuses & Perks Explained

How to Secure a Compensation Package That Matches Your Technical Mastery and Strategic Influence in the UK’s ML Landscape Machine learning (ML) has rapidly shifted from an emerging discipline to a mission-critical function in modern enterprises. From optimising e-commerce recommendations to powering autonomous vehicles and driving innovation in healthcare, ML experts hold the keys to transformative outcomes. As a mid‑senior professional in this field, you’re not only crafting sophisticated algorithms; you’re often guiding strategic decisions about data pipelines, model deployment, and product direction. With such a powerful impact on business results, companies across the UK are going beyond standard salary structures to attract top ML talent. Negotiating a compensation package that truly reflects your value means looking beyond the numbers on your monthly payslip. In addition to a competitive base salary, you could be securing equity, performance-based bonuses, and perks that support your ongoing research, development, and growth. However, many mid‑senior ML professionals leave these additional benefits on the table—either because they’re unsure how to negotiate them or they simply underestimate their long-term worth. This guide explores every critical aspect of negotiating a machine learning job offer. Whether you’re joining an AI-focused start-up or a major tech player expanding its ML capabilities, understanding equity structures, bonus schemes, and strategic perks will help you lock in a package that matches your technical expertise and strategic influence. Let’s dive in.

Machine Learning Jobs in the Public Sector: Opportunities Across GDS, NHS, MOD, and More

Machine learning (ML) has rapidly moved from academic research labs to the heart of industrial and governmental operations. Its ability to uncover patterns, predict outcomes, and automate complex tasks has revolutionised industries ranging from finance to retail. Now, the public sector—encompassing government departments, healthcare systems, and defence agencies—has become an increasingly fertile ground for machine learning jobs. Why? Because government bodies oversee vast datasets, manage critical services for millions of citizens, and must operate efficiently under tight resource constraints. From using ML algorithms to improve patient outcomes in the NHS, to enhancing cybersecurity within the Ministry of Defence (MOD), there’s a growing demand for skilled ML professionals in UK public sector roles. If you’re passionate about harnessing data-driven insights to solve large-scale problems and contribute to societal well-being, machine learning jobs in the public sector offer an unparalleled blend of challenge and impact. In this article, we’ll explore the key reasons behind the public sector’s investment in ML, highlight the leading organisations, outline common job roles, and provide practical guidance on securing a machine learning position that helps shape the future of government services.