Principal Data Engineer

Principal Data Engineer, Consulting

Bristol Based

You must be eligible for SC Clearance

Role Overview

The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build custom solutions, and transfer knowledge to client technical teams. The ideal candidate is passionate about problem-solving, thrives in greenfield project environments, and enjoys working both independently and collaboratively.

Key Responsibilities as a Principal Data Engineer

• Propose and implement data solutions usingAWS servicesincludingS3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion.
• Work directly with clients to define requirements, refine solutions, and ensure successful handover to internal teams.
• Design and implementETL/ELT pipelinesfor cloud data warehouse solutions.
• Build and maintaindata dictionaries and metadata management systems.
• Analyse and cleanse data using a range of tools and techniques.
• Manage and process structured and semi-structured data formats such asJSON, XML, CSV, and Parquet.
• Operate effectively inLinux and cloud-based environments.
• SupportCI/CD processesand adopt infrastructure-as-code principles.
• Contribute to a collaborative, knowledge-sharing team culture.

Required Qualifications & Skills

• Strong experience inETL processesandcloud data warehouse patterns.
• Hands-on expertise withAWS services(S3, Glue, Redshift).
• Proficiency withMatillionfor data transformation.
• Experience working with variousrelational databases.
• Familiarity withdata visualization toolssuch asQuickSight, Tableau, Looker, or QlikSense.
• Ability to create well-documented, scalable, and reusable data solutions.

Desirable Skills

• Experience withbig data technologiessuch as Hadoop, MapReduce, or Spark.
• Exposure tomicroservice-based data APIs.
• Familiarity with data solutions in otherpublic cloud platforms.
• AWS certifications (e.g.,Solutions Architect Associate,Big Data Specialty).
• Experience or interest inMachine Learningand AI-driven data solutions.
• Public sector experience is preferential

Benefits

• £95,000 - £114,000 + bonus