Jobs

Data Engineer


Job details
  • Haystack
  • Birmingham
  • 2 weeks ago

Role Overview

We are looking for aData/BI Engineerto join our technology team and contribute to the development and maintenance of scalable data solutions. This role involves working with structured and unstructured data, integrating new sources, and optimizing data pipelines to support reporting and analytics.

The position focuses onSQL Serveras the primary database technology, with an increasing emphasis oncloud-based services, includingAWS tools such as Athena, Glue, and SageMaker.

This role will play a key part in enabling data-driven decision-making by ensuring efficient data processing and high-quality insights.


Key Responsibilities

  • Collaborate with stakeholders to define and scope data processing requirements.
  • Develop and maintain data pipelines usingSQL, SSIS, AWS Glue, and Athena.
  • Optimize and debugSQL Serverprocedures, functions, and queries for performance and efficiency.
  • Work with internal teams to integrate data from various sources into a centralized data platform.
  • Ensure data quality, consistency, and reliability for business intelligence and analytics.
  • Stay updated on cloud-based data pipeline tools and big data technologies to enhance scalability and performance.


Skills & Experience

Required:

  • Strong proficiency inSQL Server (T-SQL, Query Optimization, Indexing, Partitioning).
  • Experience withSSISfor data integration and ETL processes.
  • Scripting knowledge usingPowerShell.
  • Familiarity withdata modelingand designing efficient database structures.
  • Strong problem-solving and analytical skills.

Preferred:

  • Experience withAWS services(Glue, Lambda, Redshift, Athena).
  • Knowledge ofbig data technologiesand scalable data architectures.
  • Proficiency inPythonfor data processing and automation.


Ideal Candidate Traits

Successful candidates typically:

  • Have a passion for working with data and solving complex challenges.
  • Are curious, detail-oriented, and proactive in optimizing data solutions.
  • Demonstrate strong time management and prioritization skills.
  • Adapt well to changing requirements and business needs.
  • Communicate effectively and collaborate across teams.
  • Take ownership of their work and seek continuous improvement.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer | £60,000 - £65,000 | UK/Remote |

Data Engineer | £60,000 - £65,000 | UK/Remote |Power BI | Synapse | Azure Data Bricks | ADF | SQL | Data Engineer | Reporting | Data Sets | Fabric |Are you a Data Engineer who enjoys getting involved with the architecture side of the role? Or maybe you want...

Opus Recruitment Solutions Sheffield

Data Engineer

Role OverviewWe are looking for aData/BI Engineerto join our technology team and contribute to the development and maintenance of scalable data solutions. This role involves working with structured and unstructured data, integrating new sources, and optimizing data pipelines to support reporting and analytics.The position focuses onSQL Serveras the primary database...

Haystack Nottingham

Data Engineer

Role OverviewWe are looking for aData/BI Engineerto join our technology team and contribute to the development and maintenance of scalable data solutions. This role involves working with structured and unstructured data, integrating new sources, and optimizing data pipelines to support reporting and analytics.The position focuses onSQL Serveras the primary database...

Haystack Glasgow

Data Engineer

Role OverviewWe are looking for aData/BI Engineerto join our technology team and contribute to the development and maintenance of scalable data solutions. This role involves working with structured and unstructured data, integrating new sources, and optimizing data pipelines to support reporting and analytics.The position focuses onSQL Serveras the primary database...

Haystack Birmingham

Data Engineer

Duration = 6 Months with likelihood of extending to 12Location = UK (Remote)Data EngineerDutiesWho you'll work withYou’ll be a member of a global team working on GenAI initiative. Clinet's Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a...

eTeam Sheffield

Data Engineer - Snowflake, dbt & AWS

Data Engineer - Snowflake | dbt | Python | AWSRemote (UK based) | 6-Month Contract | £450-£550 per day (Outside IR35)Are you aData Engineerlooking for your next contract opportunity? We're seeking an experienced professional to support aData Warehouse transformation, leveragingSnowflake, dbt, Python, and AWS.Key Responsibilities:Design, build, and optimisedata pipelineswithinSnowflake.Developdbtmodels and...

iO Associates - UK/EU Manchester