Jobs

Senior Data Engineer


Job details
  • Vitesse PSP
  • 1 month ago
Applications closed

Join a growing Product and Technology team which has more than double in size in the last 12 month. Your role will be to help architect and build a robust, secure and scalable data architecture to support real-time observability and reporting. This will entail the design and construction of data engineering solutions on AWS, as well as the design and construction of data service API's. You will be supporting key internal and external stakeholders that require access to real-time and curated data.

In this role, you will be working closely with internal stakeholders across the organisation, rapidly becoming a subject matter expert of the data generated by Vitesse and our ELT pipelines as well as drive data architecture strategy and Terraform deployment.

The successful person will have experience building complex data frameworks in other early-stage businesses. They will have experience with cloud platforms, ideally AWS.

Applicants with the following technology experience will be preferred:

  • AWS
  • Airflow
  • Databricks
  • GitHub
  • Great Expectations
  • PyTest
  • Kafka
  • Mosaic AI
  • Terraform
  • Tableau

 

Your Responsibilities

  • Design, build, and maintain scalable data pipelines and architectures to handle large volumes of structured and unstructured data
  • Develop, enhance, and optimize ELT processes for ingesting, processing, and distributing data across multiple platforms in real time
  • Build and manage data warehouses (to support advanced analytics, reporting, and machine learning
  • Implement data governance, quality checks, and validation processes to ensure the accuracy, consistency, observability, and security of data
  • Optimize query performance and data storage costs through techniques like partitioning, indexing, vacuuming, and compression
  • Build monitoring and alerting systems for data pipelines to proactively detect and resolve issues before they impact business operations
  • Optimize existing data pipelines for better performance, cost-efficiency, and scalability
  • Work with data scientists, analysts, and business stakeholders to understand data needs and ensure availability of relevant data
  • Continuously research and integrate cutting-edge data technologies, tools, and practices to improve data engineering processes
  • Team up with product engineers to identify, root cause, and resolve bugs
  • Update documentation to help users navigate our data products
  • Ensure our data platform performs well and is always available for our blue-chip clients

Requirements

  • Experience with data pipeline orchestration tools such as Airflow, Luigi, or similar
  • Experience with version control systems and CI/CD best practices using GitHub Actions
  • Knowledge of data governance, privacy regulations (e.g., GDPR), and security best practices
  • Proficiency with SQL and experience with distributed data processing tools such as Apache Spark
  • Strong understanding of relational and NoSQL databases (e.g., PostgreSQL, MongoDB, Impala, Cassandra)
  • Experience with cloud infrastructure (Docker and Kubernetes, Terraform)
  • Experience in AWS platform architecture and cloud services
  • A collaborative team member with Agile experience
  • Familiarity with stream processing technologies either Kafka or Kinesis

Nice to have

  • Experience with machine learning frameworks and pipelines.
  • Experience with Delta Live Tables
  • Familiarly with Great Expectations
  •   Experience of search optimisers (ElasticSearch/Lucene), REST alternatives (GraphQL, AsyncAPI etc.), data science kits (Jupyter, Anaconda)

Benefits

    • 25 days Holiday per year (increasing by 1 day per years' service, up to 30 days) + Bank Holidays  
    • Hybrid working arrangements – minimum 2 days in the office, Tuesday - Thursday 
    • Contributory pension scheme  
    • Enhanced Parental leave   
    • Cycle to Work Scheme  
    • Private Medical Insurance with AXA 
    • Unlimited access to therapy sessions through our partner, Oliva   
    • Discounted Gym membership through Gympass 
    • Financial Coaching with Octopus Wealth  
    • 2 days of volunteering leave per year  
    • Sabbatical after 5 years’ service   
    • Life Assurance - MetLife (UK employees only)
    • Ongoing Learning and Development to support you reach your career goals  

We are Vitesse – the payment provider of choice for the insurance and treasury industry.  

Formed in 2014 by a team of proven FinTech entrepreneurs, we are an FCA regulated payments business that is driven to be the payment partner of choice for the insurance market, by providing global payment services and treasury optimisation.  Operating one of the largest domestic banking and payment settlement networks in the world, we give our customers direct access to more than 170 countries and territories, covering over 110 currencies. Through a single integration, insurers can use this network to pay claims in as fast as 45 seconds, delivering a better customer experience to their claimants.  Our market-leading treasury optimisation service brings complete control and transparency to insurers and allows them to have their money in the right place, at the right time, to make that all important payment - fast, and when their customers need it most.   

With now over 160 employees across Europe and our London headquarters, $26m series B funding in 2022 in the bag and approaching £8bn in processed transactions, we are only just getting started.     

We are collaborative, customer centric and work with integrity, whilst partnering with some of the biggest insurance leaders including Lloyd’s of London and Many Pets. We take huge pride in our company culture, ensuring that everyone has a part to play, an opportunity to be heard, be involved, and the ability to make a real difference.   

As we continue to scale up, we want like-minded humans to join us on this exciting journey.  Are you ready?  

Vitesse at our best – our values 

The Vitesse values are a true reflection of what it takes to thrive in our business, so it’s important to us that any employee who joins our business is aligned with these 3 attributes 

Confident Humility 

We don’t do ego and we know that unless we all win, none of us win. We admit when we’re wrong, ask for help and always think about the wider business before ourselves.

Driven to Succeed 

We see the opportunity ahead of us and we won’t stop until we fulfil the potential we know we have. We hold ourselves to high standards and deliver high quality outcomes for Vitesse and our customers.  

Tenacious Responsibility 

We take ownership for our actions and decisions, and face into the challenges that come our way. We are committed to seeing things through to completion, even in the face of adversity. 

We are an Equal Opportunity Employer  We are committed to creating an inclusive environment that enables everyone to perform at their best, where we recognise the rights of all individuals to mutual respect and where there is an unbiased acceptance of others. Our policies and practices aim to promote an environment that is free from all forms of Unfair discrimination and values the diversity of all people. At the heart of our policy, we seek to treat people fairly and with dignity and respect.  

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer (Synapse/Databricks),12m FTC Fully Remote

Leading UK Logistics Company require a Senior Data Engineer to play a pivotal role in leading the design, development and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment. Your expertise will ensure the availability, reliability and scalability of their data platform, empowering the organisation with timely...

Birmingham

Senior Data Engineer

Our client a global Bank company is urgently looking for a Senior Data Engineer to work on leading new cloud-data platform. Will be working on transforming raw data into actionable insights, powering decisions across the organisation and solving complex data. Also, Designing, implementing, and maintaining data pipelines and extract, load,...

Clerkenwell

Senior Data Engineer - London - GCP - 70,000 + Benefits

Senior Data Engineer - London - GCP - Up to £70,000 + BenefitsDo you want to work with cutting edge technology? Grow or develop your skills in AI? - A space that could soon dominate the industry. All while working for a company who value your well-being as well as...

City of London

Senior Data Engineer - Fully Remote - £60k

Senior Data Engineer - Fully Remote - £60kMy client are seeking an experienced and highly skilled Senior Data Engineer to lead the design, development, and maintenance of their data infrastructure. In this role, you will assist in overseeing data integration, streaming systems, and data engineering best practices while collaborating with...

City of London

Senior Data Engineer - London - GCP - Up to £75,000 + Benefits

Senior Data Engineer - London - GCP - Up to £75,000 + BenefitsDo you want to work with cutting edge technology? Grow or develop your skills in AI? - A space that could soon dominate the industry. All while working for a company who value your well-being as well as...

City of London

Senior Data Engineer

Data EngineerPay up to £73,517, plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance.As a Senior Data Engineer you will be working within a high-performing team of engineers, offering guidance and support, developing data-centric solutions that positively impact millions of DWP users, helping them to...

High Heaton