base salary between £70k - £84k dependent on experience
10% Bonus
6% pension contribution
Private Medical
25 days annual leave
Access to our comprehensive flexible benefits including discounts on big brands, wellness and employee assistance programmes, gymflex, buy and sell annual leave, travel and dental insurance
Work. Life. Smarter. Our commitment to a flexible and hybrid working culture
Key Responsibilities:
Collaborate with data engineering manager, business analysts, data architects, and other stakeholders to understand business requirements and design the data lakehouse solution.
Lead and mentor a team of data engineers and developers in building, testing, deploying, and maintaining scalable, reliable, and secure data pipelines and platforms.
Implement data ingestion, processing, storage, and delivery systems using technologies such as Spark, Databricks, AWS, Kinesis, Kafka, Airflow, Glue, Qlik, Great Expectations, GitHub, CodePipeline, Terraform, and Python.
Optimize the performance, reliability, and cost-efficiency of the data lakehouse solution.
Troubleshoot and resolve any data-related issues to ensure data quality and integrity.
Research and evaluate new technologies and trends in data engineering to propose innovative solutions.
Job Requirements:
Bachelor's degree or higher in computer science, engineering, mathematics, statistics, or a related field.
Proven experience in data engineering or a similar role, with significant expertise in Spark, GitHub, CI/CD, Python, and AWS technologies.
Strong big data development background with experience building scalable, distributed, and fault-tolerant systems using microservices architecture and API strategy development.
Excellent SQL skills and experience with various relational and non-relational databases.
Preferably experienced with Databricks, Glue, Kafka, Airflow, Great Expectations, Qlik, Terraform, or related technologies.
Excellent communication skills (both verbal and written) and the ability to present complex technical concepts clearly.
Strong problem-solving and analytical thinking skills.
Ability to work independently and collaboratively in a fast-paced environment.
Benefits:
Competitive salary
Opportunity to work on cutting-edge fintech and technology projects
Professional development and training opportunities
Supportive and innovative work culture
Comprehensive benefits package
If you are a skilled Data Lead ready to take on a challenging and rewarding role, we would love to hear from you. Apply now to join our client's progressive team
The latest news, articles, and resources, sent to your inbox weekly.
Data Analyst - Supporting Families Programme requiredResponsible for:Supporting the delivery of the data transformation requirements of the Supporting Families Programme (SFP)Supporting the data collection, analysis and reporting requirements relating to SFPLead the data work (identification and case tracking) required to support the successful submission of payment by results (PBR) claimsMain...
Greenwich
We are representing Royal Borough of Greenwich in recruiting for a Data Analyst.Purpose of Job:To be responsible for:i) Supporting the delivery of the data transformation requirements of the Supporting Families Programme (SFP)ii) Supporting the data collection, analysis and reporting requirements relating to SFPiii) Lead the data work (identification and case...
Woolwich
A well-established organisation in Cheshire (near Handforth) are looking for a Data Engineer to join their team in this newly created role, as they look to leverage the value in their data and become truly data-driven.They operate flexible working hours and a hybrid working model, where you'll spend 3 days...
Warrington
A well-established organisation in Cheshire (near Handforth) are looking for a Data Engineer to join their team in this newly created role, as they look to leverage the value in their data and become truly data-driven.They operate flexible working hours and a hybrid working model, where you'll spend 3 days...
Manchester
We are looking for a Senior Machine Learning Engineer to join our Data Science team, to support the research and development process of ML/AI services developed in the Group Data Science team. You will trailblaze the development of data science algorithms, while building, leading, nurturing and retaining a high performing...
Paddington
Head of DataRemote / Birmingham officeUp to £100k DOE + BonusWe are recruiting for a Head of Data to join a small, successful IT consultancy who are experiencing exponential growth.They specialise in providing the latest data and cloud technologies for a multitude of clients across the UK and Ireland, with...
Birmingham