Jobs

Senior/Lead Data Engineer


Job details
  • Recursion Agentic AI
  • 2 days ago

Who we Are

Recursion is an institutionally-backed startup currently in beta mode that is redefining business intelligence and automation with agentic AI. Our mission is to deliver non-obvious insights tailored specifically to each business and to automate complex processes beyond the capabilities of traditional RPA tools. By consolidating all data into a single source of truth and making it accessible in real-time via natural language conversations, we empower enterprises to make quick, confident decisions without delays in data processing or preparation. 


About the Role

The Data Engineer will design and maintain ETL pipelines for our clients, ensuring efficient ingestion, transformation, and storage of data. This person will play a key role in transforming various client’s data in the format most suitable for AI agents.


Key Responsibilities:

  • Design, develop, and maintain scalable ETL pipelines to ingest, transform, and store data tailored to individual client requirements.
  • Implement efficient data processing workflows for structured and unstructured data.
  • Develop processes for raw data ingestion, transformation, and storage.
  • Automate the generation of master data views on a regular basis.
  • Collaborate with data analysts and app development teams for seamless data flow.
  • Monitor and optimize data pipeline performance.


Qualifications:

  • A minimum of 5 years of experience in a professional data engineering role.
  • Expertise in ETL tools and frameworks (e.g., Apache Airflow, AWS Glue).
  • Proficiency in Python, SQL, and cloud services (AWS, GCP, or Azure).
  • Familiarity with data warehousing and transformation techniques.
  • Strong debugging and performance optimization skills.
  • Experience with real-time data processing frameworks.
  • Knowledge of machine learning pipelines and integration.
  • Familiarity with data visualization tools (e.g., Tableau, Looker, or Power BI).
  • Background in working with APIs and integrating external data sources.
  • Ownership: Track record of driving and delivering complete, high quality solutions to problems independently.
  • Experience mentoring junior team members.


How to Apply

Please submit your resume and a brief cover letter explaining your interest in the role and how your experience aligns with the responsibilities and qualifications.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

SR2 | Socially Responsible Recruitment | Certified B Corporation | Senior Data Engineer

Senior / Lead Data Engineer - £90,000 - £110,000 - London/Hyrbid - Immediate hires - World leading consultancy SR2 has just won a whole project of work to start in the new year for an awesome consultancy making an impact across Finance, Retail & Government. We are looking for Data...

SR2 | Socially Responsible Recruitment | Certified B Corporation East London

Senior Data Engineer

Job Title: Senior Data Engineer – AI for HumanityLocation: London or OxfordSalary: Up to £240,000 base + extrasAbout UsWe are one of Europe’s most well-funded research centres, advancing AI initiatives that drive global change across sustainability, climate, decarbonisation, food security, agritech, healthcare, robotics, and ethical AI.Our mission is to develop...

Cubiq Recruitment London

Lead Data Engineer

Lead Data Engineer | FinTech | Scale-up | £80-100k | London/hybridAt G.Digital, we love partnering with business' who are revolutionising their industry and it's a pleasure to be partnered with a scaling, FinTech provider in LondonWe've already supported this business to grow across Test, Engineering and C-Suite and now they...

G.Digital London

Senior/Lead Data Scientist

Role - Senior/Lead Data ScientistLocation - Cardiff (Hybrid 2/3 days per week)Salary - Dependant on experience, up to £80,000 for Senior, negotiable for LeadLooking for a new challenge in 2025… We're seeking a skilled and enthusiastic Data Scientist to Join an innovative team at the forefront of leveraging data to...

Yolk Recruitment Ltd Cardiff

Lead Data Engineer

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?Lead Data Engineer - LondonFirst Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting...

First Derivative London

First Derivative | Lead Data Engineer

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?Lead Data Engineer - LondonFirst Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting...

First Derivative London