Senior Data Engineer

Get AI-powered advice on this job and more exclusive features.

Job Overview:The Benchmarking Network are looking for an experienced Senior Data Engineer with strong technical expertise and innovative mindset to drive our team forward. The primary purpose of the role is to be responsible for designing, building, optimising and maintaining the infrastructure that allows data to flow from various sources to storage systems, supports data storage, processing, and analysis, enables high-quality, secure, and scalable data delivery across the organisation. Data Engineer will be involved in the entire data pipeline from data acquisition to data extraction, ensuring that the data is accurate, reliable, and accessible, and fit-for-purpose for business intelligence, analytics, and data science functions. Data Engineer will be collaborating with cross-functional teams to support the delivery of impactful analytics work for our clients.

Roles and Responsibilities:

1. Designing, building and maintaining data pipelines.

2. Building and maintaining data warehouses.

3. Data cleansing and transformation.

4. Developing and maintaining ETL processes (ELT = extract, transform, load) to extract, transform, and load data from various sources into data warehouses.

5. Validating charts and reports created by systems built in-house. Creating validation tools.

6. Developing and maintaining data models, data tools.

7. Monitoring and optimising the performance of data pipelines, data storage and processes, identifying and resolving bottlenecks to ensure efficient data processing and retrieval.

8. Ability to integrate data from multiple sources, including databases, APIs, websites, and flat files for efficient data processing.

9. Selecting and integrating appropriate tools and technologies.

10. Troubleshooting and resolving data-related issues.

11. Architect scalable data solutions to support advanced analytics, machine learning, and real-time processing needs.

12. Design and implement data governance frameworks, including metadata management, lineage tracking, and cataloging.

13. Ensuring data quality and reliability; ensuring data security and compliance, including GDPR.

14. Document data engineering standards, design decisions, and infrastructure setup for operational transparency.

15. Collaborating with other teams to ensure data availability.

16. Collaborate with data scientists and analysts to ensure data availability for experimentation, model training, and deployment.

17. Defining and delivering clear data engineering work packages and deliverables.

18. Supporting the implementation of new infrastructure to improve the quality and efficiency of projects delivery.

19. Identify opportunities for innovation, improved productivity, efficiency, and quality. 20. Evaluate and prototype new tools or technologies, recommending enhancements to the existing data stack.

Hours of work and location:

You are required to work 37.5 hours per week Monday – Friday with core hours of 10am – 4pm.

We operate a hybrid working environment, which means you may be required to work from our Manchester office on occasions (as required for meetings and events). Your main base will be Manchester, but travel may be required to other locations.

Seniority level

• Seniority levelMid-Senior level

Employment type

• Employment typeFull-time

Job function

• Job functionInformation Technology
• IndustriesBusiness Consulting and Services

Referrals increase your chances of interviewing at The Benchmarking Network Ltd by 2x

Get notified about new Senior Data Engineer jobs inManchester, England, United Kingdom.

Burnley, England, United Kingdom 3 weeks ago

Manchester, England, United Kingdom 1 week ago

Greater Manchester, England, United Kingdom 1 week ago

Python Backend Senior Software Engineer - Remote 4 days a week (Europe)

Manchester, England, United Kingdom $70,000.00-$80,000.00 1 month ago

Manchester, England, United Kingdom 4 months ago

Senior Software Engineer - packaging - optimize Ubuntu Server

Manchester, England, United Kingdom 3 months ago

Burnley, England, United Kingdom 2 weeks ago

Accrington, England, United Kingdom 2 weeks ago

Manchester, England, United Kingdom 1 day ago

Warrington, England, United Kingdom 1 week ago

Burnley, England, United Kingdom 3 weeks ago

Skelmersdale, England, United Kingdom 1 month ago

Greater Manchester, England, United Kingdom 1 week ago

Solution Architect, Advisory, Insights & Data

Manchester, England, United Kingdom 1 week ago

Greater Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 2 weeks ago

Manchester, England, United Kingdom 5 days ago

Actemium Automation Warrington - Senior Software Controls Engineer

Warrington, England, United Kingdom 8 months ago

Warrington, England, United Kingdom 4 hours ago

Senior Software Engineer, Backend - Full or Part Time

Manchester, England, United Kingdom 2 weeks ago

International Business Developer - Data Centres

Manchester, England, United Kingdom 3 days ago

Software Engineer - Data Infrastructure - OpenSearch/ElasticSearch

Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 3 days ago

Senior DevOps Engineer, Clinical Software

Wilmslow, England, United Kingdom 3 weeks ago

Knutsford, England, United Kingdom 3 hours ago

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Manchester, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 2 weeks ago

Manchester Area, United Kingdom 3 weeks ago

Manchester, England, United Kingdom 3 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr