Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Big Data Engineer (Java Focus)

Global Relay
City of London
3 days ago
Create job alert

Senior Big Data Engineer (Java Focus) at Global Relay


Global Relay has set the standard in enterprise information archiving for over 20 years, delivering cloud archiving, surveillance, eDiscovery, and analytics solutions that give highly regulated firms greater visibility and control over their data while ensuring compliance with stringent regulations.


Your Role

Joining the Reporting product line, you will work as a member of a highly focused team that specializes in Java-based data engineering, designing and delivering large-scale ELT/ETL workflows on a data lake house platform. You will work with modern big data technologies to move, transform, and optimize data for high-performance analytics and regulatory reporting. The environment encourages autonomy, problem solving, and system-level thinking.


Tech Stack

  • Micro‑services Container Platforms: Kubernetes, CRC, Docker
  • Big Data Technologies: Apache Spark, Flink, Hadoop, Airflow, Trino, Iceberg
  • Dependency injection frameworks: Spring
  • Observability: Loki/Grafana
  • Large‑scale data processing: Kafka
  • CI/CD Build tools: Maven, Git, Jenkins, Ansible
  • NoSQL Databases: Cassandra, Zookeeper, HBase

Your Responsibilities

  • Develop ETL, ELT and streaming processes using big data frameworks primarily in Java
  • Design, implement and provide architectural guidance in deploying microservices as part of an agile development team
  • Write unit and integration tests for your Java code
  • Collaborate with testers in development of functional test cases
  • Develop deployment systems for Java‑based systems
  • Collaborate with product owners on user story generation and refinement
  • Monitor and support the operation of production systems
  • Participate in knowledge sharing activities with colleagues
  • Engage in pair programming and peer reviews

About you
Required Experience

  • Minimum 5 years of Java development experience in an Agile environment, building scalable applications and services with a focus on big data solutions and analytics
  • At least 3 years of experience in developing ETL/ELT processes using relevant technologies and tools
  • Experience working with data lakes and data warehouse platforms for batch and streaming data sources
  • ANSI SQL or other SQL dialect experience
  • Experience processing unstructured, semi‑structured and structured data
  • Good understanding of ETL/ELT principles, best practices and patterns\
  • Experience with big data technologies such as Hadoop, Spark and Flink, and web services technologies
  • Experience with Test‑Driven Development and CI/CD pipelines

Attributes

  • Good communication skills
  • solving
  • Self‑starter
  • Team player

What you can expect

At Global Relay, there is no ceiling to what you can achieve. You will receive the mentoring, coaching, and support needed to reach your career goals. The culture promotes creativity and rewards perseverance and hard work, and you will work alongside talented individuals from diverse backgrounds.


Global Relay is an equal‑opportunity employer committed to diversity, equity, and inclusion. We seek to ensure reasonable adjustments, accommodations, and personal time are tailored to meet the unique needs of every individual.


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Engineer

London Senior Data Engineer

Senior Data Engineer (UK)

Senior Data Scientists/Data Engineers Needed (multiple Roles) - DV/SC Cleared

Senior Consultant, Data Engineer, AI&Data, UKI, London

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.