Data Engineer

RBC
Newcastle upon Tyne
5 days ago
Create job alert
Job Description

We have an exciting opportunity for a Data Engineer to join the team in Newcastle or London. You will work closely with business and technology teams across Wealth Management Europe (WME) to support the ongoing maintenance and evolution of the Data Lakehouse platform. The primary focus being the ingestion and modelling of new data, and the evolution of the platform itself utilising new technologies to improve performance and accuracy of the data.


RBC’s expectation is that all employees and contractors will work in the office with some flexibility to work up to 1 day per week remotely, depending on working arrangements.


What will you do?

  • Responsible for the development and ongoing maintenance of the Data Lakehouse platform infrastructure using the Microsoft Azure technology stack, including Databricks and Data Factory.


  • Manage data pipelines consisting of a series of stages through which data flows (for example, from data sources or endpoints of acquisition to integration to consumption for specific use cases). These data pipelines must be created, maintained and optimized as workloads move from development to production for specific use cases. Architecting, creating and maintaining data pipelines will be the primary responsibility of the data engineer.


  • Create new and modify existing Notebooks, Functions and Workflows to support efficient reporting and analytics to the business.


  • Create, maintain, and develop Dev, UAT and Production environments ensuring consistency.


  • Responsible for using innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks to minimize manual and error‑prone processes and improve productivity.


  • Competent in using GitHub (or other version control tooling) and in using data and schema comparisons via Visual Studio.


  • Champion for the DevOps process to ensure the latest techniques are being used and that implementation methodologies involving new or changes to existing source code or data structures follow the agreed development and release processes and that all productionised code is adequately documented, reviewed and unit tested where appropriate.


  • Identify, source, stage, and model internal process improvements to automate manual processes and optimise data delivery for greater scalability, as part of the end-to-end data lifecycle.


  • Be curious and knowledgeable about new data initiatives and how to address them. This includes applying their data and/or domain understanding in addressing new data requirements. Additionally, be responsible for proposing appropriate (and innovative) data ingestion, preparation, integration and operationalisation techniques in optimally addressing these data requirements.



What do you need to succeed?
Must-have

  • Proven experience working within Data Engineering and Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management.


  • Proven experience working in cross-functional teams and collaborating with business stakeholders in support of a departmental and/or multi-departmental data management and analytics initiative.


  • Strong experience with popular database programming languages for relational databases (SQL, T‑SQL).


  • Experience working on a cloud data platform such as Databricks or Snowflake.


  • Adept in agile methodologies, and capable of applying DevOps and DataOps principles to data pipelines.


  • Basic experience in working with data governance, data quality and data security teams.


  • Good understanding of datasets, Data Lakehouses, modelling, database design and programming.


  • Knowledge of Data Lakehousing techniques, solutions and methodologies.


  • Strong experience supporting and working with cross-functional teams in a dynamic business environment.


  • Required to be highly creative and collaborative working closely with business teams and IT teams to define the business problem, refine the requirements, and design and develop data deliverables accordingly.



Nice-to-have

  • Knowledge of Terraform or other Infrastructure‑as‑code tools.


  • Experience with advanced analytics tools for Object‑oriented/object function scripting using languages such as Python, Java, C++, Scala, R, and others.


  • Experience using automated unit testing methodologies.



What is in it for you?

We thrive on the challenge to be our best - progressive thinking to keep growing and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.



  • Leaders who support your development through coaching and managing opportunities.


  • Opportunities to work with the best in the field.


  • Ability to make a difference and lasting impact.


  • Work in a dynamic, collaborative, progressive, and high‑performing team.



Agency Notice

RBC Group does not accept agency resumés. Please do not forward resumés to our employees, nor any other company location. RBC Group only pay fees to agencies where they have entered into a prior agreement to do so and in any event do not pay fees related to unsolicited resumés. Please contact the Recruitment function for additional details.


Inclusion and Equal Opportunity Employment

At RBC, we believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.


Join our Talent Community

Stay in‑the‑know about great career opportunities at RBC. Sign up and get customised info on our latest jobs, career tips and Recruitment events that matter to you.


Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well‑being of our clients and communities at jobs.rbc.com.


RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Skills Gap in Machine Learning Jobs: What Universities Aren’t Teaching

Machine learning has moved from academic research into the core of modern business. From recommendation engines and fraud detection to medical imaging, autonomous systems and language models, machine learning now underpins many of the UK’s most critical technologies. Universities have responded quickly. Machine learning modules are now standard in computer science degrees, specialist MSc programmes have proliferated, and online courses promise to fast-track careers in the field. And yet, despite this growth in education, UK employers consistently report the same problem: Many candidates with machine learning qualifications are not job-ready. Roles remain open for months. Interview processes filter out large numbers of applicants. Graduates with strong theoretical knowledge struggle when faced with practical tasks. The issue is not intelligence or effort. It is a persistent skills gap between university-level machine learning education and real-world machine learning jobs. This article explores that gap in depth: what universities teach well, what they routinely miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in machine learning.

Machine Learning Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Are you considering a career change into machine learning in your 30s, 40s or 50s? You’re not alone. In the UK, organisations across industries such as finance, healthcare, retail, government & technology are investing in machine learning to improve decisions, automate processes & unlock new insights. But with all the hype, it can be hard to tell which roles are real job opportunities and which are just buzzwords. This article gives you a practical, UK-focused reality check: which machine learning roles truly exist, what skills employers really hire for, how long retraining realistically takes, how to position your experience and whether age matters in your favour or not. Whether you come from analytics, engineering, operations, research, compliance or business strategy, there is a credible route into machine learning if you approach it strategically.

How to Write a Machine Learning Job Ad That Attracts the Right People

Machine learning now sits at the heart of many UK organisations, powering everything from recommendation engines and fraud detection to forecasting, automation and decision support. As adoption grows, so does demand for skilled machine learning professionals. Yet many employers struggle to attract the right candidates. Machine learning job adverts often generate high volumes of applications, but few applicants have the blend of modelling skill, engineering awareness and real-world experience the role actually requires. Meanwhile, strong machine learning engineers and scientists quietly avoid adverts that feel vague, inflated or confused. In most cases, the issue is not the talent market — it is the job advert itself. Machine learning professionals are analytical, technically rigorous and highly selective. A poorly written job ad signals unclear expectations and low ML maturity. A well-written one signals credibility, focus and a serious approach to applied machine learning. This guide explains how to write a machine learning job ad that attracts the right people, improves applicant quality and strengthens your employer brand.