Jobs

Data Engineer


Job details
  • The National College
  • Sheffield
  • 4 weeks ago
Applications closed

Job Purpose / Role Overview This role is responsible for the development and operation of the data warehouse stack and data quality, integrating additional data sources and providing processed data for consumption, BI and reporting. A key focus is enabling the business to make data-driven decisions that will support innovation and continuous sustainable growth.

Key Responsibilities • Responsible for the development and operation of the data warehouse stack and data quality, integrating additional data sources and providing processed data for consumption, BI and reporting. • Build and maintain scalable data pipelines written in Python and SQL and ran on AWS/Snowflake • Management and maintenance of the data architecture and configuration. Deployment of resources within the AWS estate to ensure optimal performance, scalability, and cost efficiency. • Taking ownership of data quality within projects • Managing and educating a range of stakeholders when gathering requirements and delivering data projects • Building effective and collaborative relationships with technical and non-technical colleagues • Reacting to change within the business in a positive and constructive way • Documenting processes and data pipelines • Working as part of an Agile (Scrum, kanban) team, and collaborating with other development, product, design and test teams to ensure the best implementation and highest quality product

Requirements

  • Experience working with complex data sets. • Data pipeline development experience in Python (especially using pandas, parsing API responses, posting data to API’s etc.) • Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines • Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred • An understanding of CICD concepts including having a working knowledge of GitHub
  • Skills and Competencies • A strong data mindset • Ability to thrive in a fast paced and dynamic environment • Exceptional SQL skills including an appreciation for performance tuning on a variety of database engines • Excellent communication, collaboration, and problem-solving skills. • An appreciation for the big picture while delivering short/mid-term solutions • Understanding of different data warehouse architectures is preferred (especially dimensional modelling and data vault 2.0 architectures) • Experience with agile methodologies such as Scrum or Kanban, and tools such as Jira and Git 5.
  • Qualifications • Desirable - Bachelor's degree in computer science, data science, software engineering, information systems or related discipline. • Desirable - Certifications in scripting/programming language, such as python or SQL. • Desirable – Certifications in cloud computing on platforms such as AWS

Benefits

  • Hybrid working, with regular collaboration days in our Sheffield HQ
  • Opportunity to work at an established but rapidly growing EdTech scaleup
  • NEST Pensions scheme
  • Buy & Sell Holiday scheme offering an opportunity to boost holiday allowance to up to 38 days annually
  • Access to company Life Assurance scheme
  • SmartHealth - access to 24/7 virtual GP, mental health support, financial advice and more

Who are The National College

The National College are a fast growing and innovative EdTech business headquartered in Sheffield. We are a market-leading and multi-award-winning provider of professional development and software tools that support over 45,000 schools worldwide to ensure compliance and drive up standards. Our cutting-edge platform has revolutionised online training and now boasts the world's largest professional development library for educators! 

The National College is part of the National Education Group.

CancelAdd Benefits

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer - Contract

Data Engineer (GCP) - 3 Month Contract - Inside IR35Remote (UK)Spinks have partnered with a leading UK Consultancy who are seeking an experienced Lead Data Engineer to support their client on an exciting project.As a Lead Data Engineer, you will have proven experience leading small teams and getting the best...

London

Data Engineer

Are you a data enthusiast who thrives on building robust data solutions that drive business impact? Do you enjoy working with modern data platforms to optimise and transform raw data into meaningful insights?This is an exciting opportunity to join a growing Data & Business Intelligence team and play a key...

Monument

Data Engineer - London - AWS - 70,000 + Benefits

Data Engineer - London - AWS - Up to 70,000 + BenefitsCompany Overview:You will be working within global company who boast offices across the world - from London to Melbourne, Singapore to the US + many more in between! Within this multinational is a multitude of high level business who...

City of London

Data Engineer - London

Data Engineer - London - Hybrid - £100 - £115kThis is a great opportunity for a data engineer and snowflake expert to join a leading global company in the energy commodities industry. This position will play an integral role as the team implements new data management platforms, creates new data...

City of London

Data Engineer

Data EngineerLocation: RG7 4PR, located between Reading and Basingstoke, with free onsite parking.Package: £38,350 - £50,000 (depending on your suitability, qualifications, and level of experience)Working pattern: AWE operates a 9-day working fortnight.Let us introduce the roleAWE is currently recruiting for 2 Data Engineer's/Analyst's for the IS Modernisation group.Responsibilities:Learn how to...

Aldermaston

Data Engineer

Data Engineer Needed for Platform Migration1 Day per week in the office.We are seeking an experienced and highly skilled Data Engineer to support a 3-month contract for a data platform migration project. This role requires expertise in Microsoft Fabric, Python, SQL, and Spark, with the ability to modernise and optimise...

Preston on the Hill