Jobs

Principal Data Engineer


Job details
  • HSBC Global Services Limited
  • Sheffield
  • 1 week ago

Join a digital first bank that’s powered by people. Our technology team builds innovative digital solutions rapidly and at scale to deliver the next generation of banking services for our customers around the world.
 


The Principal Data Engineer role is a key technical role within the Platform & Data Engineering Team, contributing to, coordinating, and leading data engineering, data acquisition, cloud infrastructure and platform engineering, platform operations, and production support activities using ground-breaking cloud and big data technologies. Cybersecurity-specific knowledge is preferred for the role, but exceptional candidates from other technical disciplines are also encouraged to apply.

As an HSBC employee in the UK, you will have access to tailored professional development opportunities and a competitive pay and benefits package. This includes private healthcare for all UK-based employees, enhanced maternity and adoption pay and support when you return to work, and a contributory pension scheme with a generous employer contribution.

 

In this role you will:

• Ingestion and provisioning of raw datasets, enriched tables, and/or curated, re-usable data assets to enable Cybersecurity use cases.
• Driving improvements in the reliability and frequency of data ingestion including increasing real-time coverage.
• Support and enhancement of data ingestion infrastructure and pipelines.
• Designing and implementing data pipelines that will collect data from disparate sources across the enterprise, and from external sources, transport said data, and deliver it to our data platform.
• Extract Translate and Load (ETL) workflows, using both advanced data manipulation tools and programmatically manipulating data throughout our data flows, ensuring data is available at each stage in the data flow, and in the form needed for each system,       service, and customer along said data flow.
• Identifying and onboarding data sources using existing schemas and, where required, conducting exploratory data analysis

 

To be successful in this role you should meet the following requirements:

 

• Experience with SRE and Azure DevOps
• Ability to script (Bash/PowerShell, Azure CLI), code (Python, C#, Java), query (SQL, Kusto query language) coupled with experience with software versioning control systems (e.g., GitHub) and CI/CD systems.
• Programming experience in the following languages: PowerShell, Terraform, Python Windows command prompt and object orientated programming languages.
• Technical knowledge and breadth of Azure technology services (Identity, Networking, Compute, Storage, Web, Containers, Databases)
• Cloud & Big Data Technologies such as Azure Cloud, Azure IAM, Azure Active Directory (Azure AD), Azure Data Factory, Azure Databricks, Azure Functions, Azure, Kubernetes, Service, Azure Logic    App, Azure Monitor, Azure Log Analytics, Azure Compute, Azure Storage, Azure Data Lake Store, S3, Synapse Analytics and/or PowerBI
• Experience with server, operating system, and infrastructure technologies such as Nginx/Apache, CosmosDB, Linux, Bash, PowerShell, Prometheus, Grafana, Elasticsearch)
• Positive attitude, strong work ethic and passion for learning.

 

This role can be based in both Sheffield and Edinburgh
 

 

Being open to different points of view is important for our business and the communities we serve. At HSBC, we’re dedicated to creating diverse and inclusive workplaces - no matter their gender, ethnicity, disability, religion, sexual orientation, or age. We are committed to removing barriers and ensuring careers at HSBC are inclusive and accessible for everyone to be at their best. We take pride in being a Disability Confident Leader and will offer an interview to people with disabilities, long term conditions or neurodivergent candidates who meet the minimum criteria for the role.

 

If you have a need that requires accommodations or changes during the recruitment process, please get in touch with our Recruitment Helpdesk:

Email:

Telephone:

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

PRINCIPAL DATA ENGINEER - AZURE, DATA

Principal Data Engineer Opportunity - Northwest England / Hybrid working / £50,000 - £60,000 (depending on experience) + attractive benefits.Are you an experienced Principal Data Engineer looking to work for a global leader in professional services? Our client, a prestigious and highly-regarded organisation, is seeking a talented individual to join...

Adecco UK Limited Manchester

Senior Principal Data Engineer

Site Name:UK - London - New Oxford Street, UK - Hertfordshire - StevenagePosted Date:Nov 15 2024GSK is a global leader in pharmaceuticals and healthcare, with a relentless commitment to advancing healthcare for the betterment of humanity. Our mission is to help people around the world do more, feel better, and...

GlaxoSmithKline London

Principal Cloud Data Engineer

As a Principal Data Engineer for Qodea, you'll engage with enterprise-level organisations to offer a consultative view and direction on best practice data architecture using Google Cloud solutions. You'll play a key role in the technical delivery of complex and innovative data solutions for our customers across the Benelux region...

Qodea Manchester

Senior Principal Engineer - Knowledge Graph

Job descriptionSite Name:GSK HQ, Irvine, Poznan Pastelowa, UK - Hertfordshire - Stevenage, UK - Hertfordshire - Ware, Warsaw Rzymowskiego 53Posted Date:Dec 4 2024We create a place where people can grow, be their best, be safe, and feel welcome, valued and included. We offer a competitive salary, an annual bonus based...

GSK Stevenage

Senior Principal Engineer - Knowledge Graph

Job descriptionSite Name:GSK HQ, Irvine, Poznan Pastelowa, UK - Hertfordshire - Stevenage, UK - Hertfordshire - Ware, Warsaw Rzymowskiego 53Posted Date:Dec 4 2024We create a place where people can grow, be their best, be safe, and feel welcome, valued and included. We offer a competitive salary, an annual bonus based...

GSK Ware

Lead Data Engineer - Basingstoke

Company descriptionLocation: Basingstoke (hybrid working 2 office days per week)Employment Type: Permanent, full timeAdditional Benefits: Annual Bonus, Cash-Car Allowance & Private Medical InsuranceThink the AA is just about roadside assistance? Think again.For over a century, we've been evolving and adapting. Today, as the nation's leading motoring organisation, we offer a...

The Automobile Association Basingstoke