Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Cloud Data Engineer – Python

Barclays
Glasgow
5 days ago
Create job alert

Join Barclays as a Cloud Data Engineer – Python, where you’ll be part of the Financial Metrics Reporting team within Private Bank. You will be responsible for building, deploying, and maintaining data pipelines on cloud platforms, ensuring data quality, security, and scalability, while also collaborating with teams to deliver actionable insights.


To be successful, you should have:


  • Strong proficiency in Python or Scala programming languages.
  • Experience with Apache Spark and big data processing frameworks.
  • Hands‑on experience with AWS development, including some of the following services: Lambda, Glue, Step Functions, IAM roles, Lake Formation, EventBridge, SNS, SQS, EC2, Security Groups, CloudFormation, RDS, and DynamoDB.

Other highly valued skills may include:


  • Designing, building, and deploying data pipelines and workflows using Databricks.
  • Proven ability to design and develop enterprise‑level software solutions using tools and techniques such as source control, build tools (e.g., Maven), TDD, and GitLab.
  • Knowledge of streaming services (Kafka, MSK, Kinesis, Glue Streaming, etc.) is preferable.
  • Experience with Databricks Delta Lake or MLflow.

You may be assessed on key critical skills relevant to success in this role, including risk and controls, change and transformation, business acumen, strategic thinking, digital and technology skills, as well as job‑specific technical expertise.


This role is based in Glasgow


Purpose of the role

To design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues.


Accountabilities
  • Development and delivery of high‑quality software solutions by using industry aligned programming languages, frameworks, and tools. Ensuring that code is scalable, maintainable, and optimized for performance.
  • Cross‑functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives.
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing.
  • Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth.
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions.
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability.

Analyst Expectations
  • To perform prescribed activities in a timely manner and to a high standard consistently driving continuous improvement.
  • Requires in-depth technical knowledge and experience in their assigned area of expertise.
  • Thorough understanding of the underlying principles and concepts within the area of expertise.
  • They lead and supervise a team, guiding and supporting professional development, allocating work requirements and coordinating team resources.
  • If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others.
  • OR for an individual contributor, they develop technical expertise in work area, acting as an advisor where appropriate.
  • Will have an impact on the work of related teams within the area.
  • Partner with other functions and business areas.
  • Takes responsibility for end results of a team’s operational processing and activities.
  • Escalate breaches of policies / procedure appropriately.
  • Take responsibility for embedding new policies/ procedures adopted due to risk mitigation.
  • Advise and influence decision making within own area of expertise.
  • Take ownership for managing risk and strengthening controls in relation to the work you own or contribute to. Deliver your workand areas of responsibility in line with relevant rules, regulation and codes of conduct.
  • Maintain and continually build an understanding of how own sub‑function integrates with function, alongside knowledge of the organisations products, services and processes within the function.
  • Demonstrate understanding of how areas coordinate and contribute to the achievement of the objectives of the organisation sub‑function.
  • Make evaluative judgements based on the analysis of factual information, paying attention to detail.
  • Resolve problems by identifying and selecting solutions through the application of acquired technical experience and will be guided by precedents.
  • Guide and persuade team members and communicate complex / sensitive information.
  • Act as contact point for stakeholders outside of the immediate function, while building a network of contacts outside team and external to the organisation.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer (Python & Databricks)

Senior Data Engineer

Senior Data Engineer Python AWS

Snowflake Data Engineer

Data Engineer - Python, SQL, Databricks

Data Engineer - Palantir

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.