Principal Data Engineer

Principal Data Engineer, Consulting

Leeds Based

You must be eligible for SC Clearance

Role Overview
The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build custom solutions, and transfer knowledge to client technical teams. The ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively.

Key Responsibilities as a Principal Data Engineer
Propose and implement data solutions using

AWS services

including

S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion .
Work directly with clients to define requirements, refine solutions, and ensure successful handover to internal teams.
Design and implement

ETL/ELT pipelines

for cloud data warehouse solutions.
Build and maintain

data dictionaries and metadata management systems .
Analyze and cleanse data using a range of tools and techniques.
Manage and process structured and semi-structured data formats such as

JSON, XML, CSV, and Parquet .
Operate effectively in

Linux and cloud-based environments .
Support

CI/CD processes

and adopt infrastructure-as-code principles.
Contribute to a collaborative, knowledge-sharing team culture.

Required Qualifications & Skills
Strong experience in

ETL processes

and

cloud data warehouse patterns .
Hands-on expertise with

AWS services

(S3, Glue, Redshift).
Proficiency with

Matillion

for data transformation.
Experience working with various

relational databases .
Familiarity with

data visualization tools

such as

QuickSight, Tableau, Looker, or QlikSense .
Ability to create well-documented, scalable, and reusable data solutions.

Desirable Skills
Experience with

big data technologies

such as Hadoop, MapReduce, or Spark.
Exposure to

microservice-based data APIs .
Familiarity with data solutions in other

public cloud platforms .
AWS certifications (e.g.,

Solutions Architect Associate ,

Big Data Specialty ).
Experience or interest in

Machine Learning

and AI-driven data solutions.
Public sector experience is preferential

Benefits
£95,000 - £114,000 + bonus