Lead Data Engineer(Kakfa/Openshift)

Synechron
London
4 days ago
Create job alert

We are

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 16,500+, and has 60 offices in 20 countries within key global markets.


We are looking for Engineering Tech Leads with strong expertise in Data Engineering, OpenShift Telemetry, Kafka, Splunk, and LLM‑based observability. This role will lead the design and build of enterprise‑scale telemetry and observability platforms


Key Responsibilities:

  • Design, build, and optimize large‑scale OpenShift telemetry pipelines (metrics, logs, traces).
  • Develop Kafka-based streaming solutions—producers, consumers, schemas, and resilient data services.
  • Engineer multi‑tenant observability data models, ensuring lineage, quality, and SLA compliance.
  • Integrate enriched telemetry into Splunk for dashboards, alerting, analytics, and proactive insights (Observability Level 4).
  • Implement schema governance (Avro/Protobuf), versioning, and compatibility controls.
  • Build automated validation, replay, and backfill mechanisms for reliable data operations.
  • Standardize telemetry across platforms using OpenTelemetry for metrics, tracing, and logs.
  • Leverage LLMs to improve observability workflows—query assistance, anomaly summarization, and runbook automation.
  • Collaborate with SRE, platform, and application teams on telemetry integration, alerting, and SLOs.
  • Ensure security, compliance, RBAC, and encryption in all pipeline components.
  • Maintain clear documentation for data flows, schemas, dashboards, and operational guides.


Required Skills:

  • Strong hands‑on experience with Kafka (producers/consumers, schema registry, KSQL, Kafka Streams).
  • Deep understanding of OpenShift/Kubernetes telemetry, Prometheus, OpenTelemetry, and CLI tooling.
  • Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM) and creating dashboards/alerts.
  • Proficiency in Python or similar languages for ETL/ELT, enrichment, and validation workflows.
  • Solid experience with Avro/Protobuf/JSON schemas and compatibility best practices.
  • Knowledge of observability frameworks and ability to drive towards Level 4 maturity (proactive automation).
  • Understanding of multi‑cluster and hybrid cloud telemetry architecture.
  • Strong grounding in data security, RBAC, secrets management, and encryption.
  • Excellent communication, analytical thinking, and documentation skills.


S YNECHRON’S DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer / Architect – Databricks Active - SC Cleared

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Are you considering a career change into machine learning in your 30s, 40s or 50s? You’re not alone. In the UK, organisations across industries such as finance, healthcare, retail, government & technology are investing in machine learning to improve decisions, automate processes & unlock new insights. But with all the hype, it can be hard to tell which roles are real job opportunities and which are just buzzwords. This article gives you a practical, UK-focused reality check: which machine learning roles truly exist, what skills employers really hire for, how long retraining realistically takes, how to position your experience and whether age matters in your favour or not. Whether you come from analytics, engineering, operations, research, compliance or business strategy, there is a credible route into machine learning if you approach it strategically.

How to Write a Machine Learning Job Ad That Attracts the Right People

Machine learning now sits at the heart of many UK organisations, powering everything from recommendation engines and fraud detection to forecasting, automation and decision support. As adoption grows, so does demand for skilled machine learning professionals. Yet many employers struggle to attract the right candidates. Machine learning job adverts often generate high volumes of applications, but few applicants have the blend of modelling skill, engineering awareness and real-world experience the role actually requires. Meanwhile, strong machine learning engineers and scientists quietly avoid adverts that feel vague, inflated or confused. In most cases, the issue is not the talent market — it is the job advert itself. Machine learning professionals are analytical, technically rigorous and highly selective. A poorly written job ad signals unclear expectations and low ML maturity. A well-written one signals credibility, focus and a serious approach to applied machine learning. This guide explains how to write a machine learning job ad that attracts the right people, improves applicant quality and strengthens your employer brand.

Maths for Machine Learning Jobs: The Only Topics You Actually Need (& How to Learn Them)

Machine learning job adverts in the UK love vague phrases like “strong maths” or “solid fundamentals”. That can make the whole field feel gatekept especially if you are a career changer or a student who has not touched maths since A level. Here is the practical truth. For most roles on MachineLearningJobs.co.uk such as Machine Learning Engineer, Applied Scientist, Data Scientist, NLP Engineer, Computer Vision Engineer or MLOps Engineer with modelling responsibilities the maths you actually use is concentrated in four areas: Linear algebra essentials (vectors, matrices, projections, PCA intuition) Probability & statistics (uncertainty, metrics, sampling, base rates) Calculus essentials (derivatives, chain rule, gradients, backprop intuition) Basic optimisation (loss functions, gradient descent, regularisation, tuning) If you can do those four things well you can build models, debug training, evaluate properly, explain trade-offs & sound credible in interviews. This guide gives you a clear scope plus a six-week learning plan, portfolio projects & resources so you can learn with momentum rather than drowning in theory.