Jobs

Principal Data Engineer


Job details
  • DiverseJobsMatter
  • Edinburgh
  • 1 week ago

OurPrincipal Data Engineersare experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others.


  • Your role in nutshell:Act as a technical SME within the engineering community to produce and ensure user-centred software is developed based on business requirements and following best practice
  • Work collaboratively with colleagues to explore, design and deliver solutions to client problems
  • Maintain client relationships and troubleshoot issues through collaboration
  • Design and manage software development and deployment pipelines resolving issues and potential bottlenecks before they occur
  • Continuously reviews and prioritises the delivery teams workload and can anticipate the need for realignment with evolving operational prioritise and complex work-streams and assignments
  • Be a strong communicator and presenter, presenting prototypes, solutions and progress to internal/external stakeholders in a clear concise manner
  • Build great relationships with your team and stakeholders, identifying and ensuring that challenges are overcome
  • Lead in the recruitment of other engineers, and support other consultants in their professional development
  • Ensure our Data and Engineering communities contribute to our business at a strategic level
  • Lead on new business opportunities, writing technical bids and proposals
  • Promote Data Herd externally (for example through writing Blogs, Workshops, Seminars or Conferences)



About the Candidate:

  • Excellent experience delivering in Python and experience with at least one other core language
  • Excellent experience of SQL and relational databases. NoSQL databases is also desirable.
  • Solid experience of at least one Cloud provider such as AWS, Azure or GCP.
  • Preference will be given on candidates with strong Azure Cloud and general Microsoft Technology Stacks (e.g. MS SQL and .Net frameworks)
  • Strong experience of working with different data formats, e.g., CSV, JSON and XML
  • Building reliable Data Pipelines
  • Broader knowledge of IT — e.g., Security and Networking
  • Working in an Agile Environment
  • Test-Driven Development and/or Behaviour Driven Development
  • Continuous Integration and Continuous Deployment (CI/CD)
  • Experience of operating as a technical leader on complex projects and able to manage stakeholder expectations and influencing decisions
  • Coaching and guiding others on the best way to achieve an optimal solution
  • Excellent verbal/written communication skills, able to articulate in both technical/non-technical terms depending on audience
  • Technical leadership and/or mentoring
  • Define working procedures and methodologies for the team

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Principal Data Engineer

OurPrincipal Data Engineersare experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others.Your role in nutshell:Act as a...

DiverseJobsMatter Edinburgh

Data Engineer

Job DescriptionOur Direct-to-Consumer (DTC) portfolio is a powerhouse collection of consumer-first brands, supported by media industry leaders, Comcast, NBCUniversal and Sky. When you join our team, you’ll work across our dynamic portfolio including Peacock, NOW, Fandango, SkyShowtime, Showmax, and TV Everywhere, powering streaming across more than 70 countries globally. And...

NBCUniversal Brentford

Principal Data Scientist

Do you enjoy solving problems, looking at problems through a different lens, and working closely with customers to innovate new solutions to complex problems? Do you jump with excitement at the opportunity to identify trends and provide unique business solutions? Do you want to join a team where learning about...

Microsoft London

Principal Architect

. Principal Architect page is loadedPrincipal ArchitectPrincipal ArchitectlocationsLondon time typeFull time posted onPosted Today time left to applyEnd Date: March 31, 2025 (30+ days left to apply) job requisition idSR-29266 Its fun to work in a company where people truly BELIEVE in what they are doing!Were committed to bringing passion...

Fractal London

Principal Data Solution Architect - London

Company descriptionLocation: London (hybrid working 2 office days per week)nEmployment Type: Permanent, full timenAdditional Benefits: Annual Bonus, Cash-Car Allowance & Private Medical InsurancenJoin Our Data & Analytics Team: Transforming Data into Our Superpower!nAre you passionate about data and eager to make a significant impact? The AA is a well-loved brand...

The Automobile Association London

Principal Data Scientist

The RoleWe are recruiting a Principal / Lead Data Scientist who is passionate about solving problems. Creative, innovative, passion, flexibility, adaptability, tenacity and agile, these are just some of the words that describe the culture of our team. This is an opportunity for you to make an impact whilst also...

Ipsos London