Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Principal Data Engineer

IDBS
Woking
1 week ago
Create job alert
Principal Data Engineer

IDBS helps BioPharma organizations unlock the potential of AI/ML to improve the lives of patients. As a trusted long‑term partner to 80% of the top 20 global BioPharma companies, IDBS delivers powerful cloud software and services specifically designed to meet the evolving needs of the BioPharma sector.


IDBS, a Danaher company, leverages 35 years of scientific informatics expertise to help organizations design, execute and orchestrate processes, manage, contextualize and structure data, and gain valuable insights throughout the product lifecycle, from R&D through manufacturing. Known for its signature IDBS E‑WorkBook software, IDBS has extended its flexible, scalable solutions to the IDBS Polar and PIMS cloud platforms to help scientists make smarter decisions with assured confidence in both GxP and non‑GxP environments.


Do you want to work in a dynamic, fast‑paced, high‑performing, safe‑to‑fail and fun environment founded on trust, empowerment and autonomy? Do you enjoy solving complex customer problems as a team?


We are currently seeking a Principal Data Engineer who will be a vital cog in our team, designing and developing IDBS’s data‑driven products. The role involves delivery of data‑rich software, architectural design, technical approach, and implementation mechanisms adopted by the team. You will be directly involved in development of data‑centric products from ingest to egress via pipelines, data warehousing, cataloguing, integrations and other mechanisms.


The role will be involved in all aspects of the software delivery lifecycle including the creation and elaboration of business requirements, functional and technical design specifications, development and maintenance of our software (including prototyping) and driving innovation into our product suite. You will be responsible for ensuring that the development and maintenance of IDBS’s software platforms adheres to IDBS’s architecture vision.


What We’ll Get You Doing

  • Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark (PySpark) to support analytics and other data‑driven initiatives.
  • Support the elaboration of requirements, formulation of the technical implementation plan and backlog refinement. Provide technical perspective to product enhancements & new requirements activities.
  • Optimize Spark‑based workflows for performance, scalability, and data integrity, ensuring alignment with GxP and other regulatory standards.
  • Research, and promote new technologies, design patterns, approaches, tools and methodologies that could optimise and accelerate development.
  • Apply strong software engineering practices including version control (Git), CI/CD pipelines, unit testing, and code reviews to ensure maintainable and production‑grade code.

It Would Be a Plus If You Also Possess Previous Experience In

  • Deployment of Databricks functionality in a SaaS environment (via infrastructure as code) with experience of Spark, Python and a breadth of database technologies.
  • Event‑driven and distributed systems, using messaging systems like Kafka, AWS SNS/SQS and languages such as Java and Python.
  • Data‑centric architectures, including experience with Data Governance / Management practices and Data Lakehouse / Data Intelligence platforms. Experience of AI software delivery and AI data preparation would also be an advantage.

At IDBS we believe in designing a better, more sustainable workforce. We recognize the benefits of flexible working arrangements for eligible roles and are committed to providing enriching careers, no matter the work arrangement. This position is eligible for a flexible work arrangement in which you can work part‑time at the Company location identified above and part‑time remotely from your home. Additional information about this work arrangement will be provided by your interview team. Explore the flexibility and challenge that working for IDBS can provide.


Join our winning team today. Together, we’ll accelerate the real‑life impact of tomorrow’s science and technology. We partner with customers across the globe to help them solve their most complex challenges, architecting solutions that bring the power of science to life.


For more information, visit www.danaher.com.


Job Details

  • Seniority level: Not Applicable
  • Employment type: Full‑time
  • Job function: Information Technology
  • Industries: Software Development


#J-18808-Ljbffr

Related Jobs

View all jobs

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the machine learning jobs market in the UK is going through another big shift. Foundation models and generative AI are everywhere, companies are under pressure to show real ROI from AI, and cloud costs are being scrutinised like never before. Some organisations are slowing hiring or merging teams. Others are doubling down on machine learning, MLOps and AI platform engineering to stay competitive. The end result? Fewer fluffy “AI” roles, more focused machine learning roles with clear ownership and expectations. Whether you are a machine learning job seeker planning your next move, or a recruiter trying to build ML teams, understanding the key machine learning hiring trends for 2026 will help you stay ahead.

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.