Jobs

Big Data Engineer


Job details
  • Robert Half
  • London
  • 5 months ago


Robert Half have partnered with a leading pharmaceutical logistics company who are seeking a talented Data Engineer to join their team, responsible for designing, building, and maintaining robust data pipelines and infrastructure. The ideal candidate will possess expertise in dbt, CI/CD processes, automated unit testing in a data context, and strong SQL skills. This role offers an exciting opportunity to work with cutting-edge technologies and contribute to the advancement of data-driven initiatives.

This role is a day rate contract of 3-6 months.

Outside IR35

Key Responsibilities:

Data Pipeline Development:

Design, develop, and maintain scalable data pipelines using dbt. Collaborate with cross-functional teams to understand data requirements and implement best practices for data modelling. Ensure efficient data processing and transformation to support analytical and reporting needs. Continuous Integration and Deployment (CI/CD): Define and build CI/CD processes in dbt and DevOps environments. Establish quality control measures and automated testing frameworks for data pipeline reliability.

Automated Unit Testing:

Develop and implement automated unit testing strategies tailored to data context. Monitor test results to maintain data pipeline robustness and reliability. SQL Development and Optimisation: Utilise strong SQL skills to optimise database performance and implement schema changes aligned with business requirements. Communication and Collaboration: Communicate effectively with stakeholders and collaborate with data scientists and analysts. Deliver solutions that meet business objectives.

Desirable Knowledge & Skills:

Understanding of data modelling principles and frameworks. Familiarity with ETL techniques, especially Snap logic. Experience in Life Sciences/Pharmaceutical industry is desirable.

Requirements:

Experience of and expertise in dbt. Experience defining and building CI/CD processes (ideally in dbt and DevOps). Experience of automated unit testing in a data context. Strong SQL skills. Proven written and verbal communication skills, and attention to detail. Experience with AirFlow

Qualifications:

Demonstrated experience in data engineering, ETL development, and database management. Certification in relevant technologies or platforms is a plus.

Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to equal opportunity and diversity. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Big Data Engineer - Compliance Technology

Job Description:Job Title :Big Data EngineerLocation :LondonCorporate Title: Assistant Vice PresidentRole DescriptionWhat we'll offer youA healthy, engaged and well-supported workforce are better equipped to do their best work and, more importantly, enjoy their lives inside and outside the workplace. That's why we aremitted to providing an environment with your development...

Deutsche Bank London

Big Data Engineer

Robert Half have partnered with a leading pharmaceutical logistics company who are seeking a talented Data Engineer to join their team, responsible for designing, building, and maintaining robust data pipelines and infrastructure. The ideal candidate will possess expertise in dbt, CI/CD processes, automated unit testing in a data context, and...

Robert Half London

Lead Big Data Engineer - Contract

Requisition ID: R10166531Your Opportunity to Define Possible.Our Opportunity to Deliver the Nation’s Security. Together.Role clearancetype:Must already hold highest level of government clearance.Location:LondonAbout Your Opportunity:As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and...

Northrop Grumman London

Senior Big Data Engineer

Location: London, Greater London, United Kingdom Remote: Remote Type: Temporary Job #25040We are looking for aSenior Big Data Engineer to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets. You will be working on a team that detects fraudulent activity within payments for ads so experience...

Allen Recruitment Consulting London

Data Lake Engineer

Requisitos mínimos:Estar graduado en Ingeniería Informática o de Telecomunicaciones. Tener al menos 4 años de experiencia en un rol de Big Data Engineer, implementando y productivizando soluciones de captación, ingesta y transformación de datos con herramientas de procesamiento distribuido y/o procesamiento en streaming. Experiencia en arquitectura de datos (formato, estructura,...

SDG Group London

Software Engineer

Responsibilitiesand Impact:You will enable S&P ratings business to provide best in class end-to-end analytical,mercial and customer experience by building feature rich solutions including big data engineering, analytics, business intelligence and workflow capabilities. Develop design and architecture exposure and ability to ensure quality across various technologyponents that are developed by geographically...

S&P Global London