Jobs

Data Engineer


Job details
  • Trust In SODA
  • London
  • 2 weeks ago
Applications closed

A leading provider of technology-driven data solutions that empower businesses with transformative insights, this company is a pioneer in data intelligence and is currently seeking to build a new, predictive model.


In this role, you will design, build, and maintain high-performance data pipelines using tools like Dagster and Python. You'll process diverse data sources, collaborate with data teams, and optimize data workflows for both real-time and batch processing. You'll also contribute to data architecture, ensure data governance and security, and maintain comprehensive documentation.


Technical Skills:

  • Proficiency in pipeline orchestration tools (e.g., Dagster, Airflow)
  • Strong Python programming skills with experience in libraries like Pandas and PySpark
  • Expertise in cloud platforms, particularly AWS (e.g., S3, Lambda, Redshift, RDS)
  • Deep understanding of data modeling, ETL workflows, and scalable architecture design
  • Familiarity with integrating machine learning models into production workflows


Experience:

  • 3+ years of experience in a Data Engineering role, with experience in mid-to-senior capacity
  • Proven track record of working with live datasets and building end-to-end data pipelines
  • Strong SQL skills for querying and managing large datasets
  • Hands-on experience in creating architectural diagrams and delivering technical presentations


A big bonus if you have..

  • Experience in building and optimizing propensity models or similar predictive analytics models
  • Strong understanding of feature engineering, predictive modeling, and evaluation metrics
  • Experience with version control tools (e.g., Git) and CI/CD pipelines


Intrigued? Drop me a message!

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer - Security (SIEM)

The Security Data Engineer position is the subject matter expert for our Security Information and Event Management (SIEM) system and leads efforts to aggregate and enrich data for to support our security efforts. Reporting into the Enterprise Security Engineering team, you will engineer new features for our SIEM and detections...

Electronic Arts (EA) Surrey

Data Engineer - Security (SIEM)

The Security Data Engineer position is the subject matter expert for our Security Information and Event Management (SIEM) system and leads efforts to aggregate and enrich data for to support our security efforts. Reporting into the Enterprise Security Engineering team, you will engineer new features for our SIEM and detections...

Electronic Arts (EA) Woking

Data Engineer

Data Engineer£45,000- £50,000Pharmalex is looking for a Data Engineer to join their growing team. This will be a remote based role but there is a requirement to travel to Lutterworth one day of the month.Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into a central...

PharmaLex Manchester

Data Engineer | £60,000 - £65,000 | UK/Remote |

Data Engineer | £60,000 - £65,000 | UK/Remote |Power BI | Synapse | Azure Data Bricks | ADF | SQL | Data Engineer | Reporting | Data Sets | Fabric |Are you a Data Engineer who enjoys getting involved with the architecture side of the role? Or maybe you want...

Opus Recruitment Solutions Newcastle upon Tyne

Data Engineer | £60,000 - £65,000 | UK/Remote |

Data Engineer | £60,000 - £65,000 | UK/Remote |Power BI | Synapse | Azure Data Bricks | ADF | SQL | Data Engineer | Reporting | Data Sets | Fabric |Are you a Data Engineer who enjoys getting involved with the architecture side of the role? Or maybe you want...

Opus Recruitment Solutions London

Data Engineer | £60,000 - £65,000 | UK/Remote |

Data Engineer | £60,000 - £65,000 | UK/Remote |Power BI | Synapse | Azure Data Bricks | ADF | SQL | Data Engineer | Reporting | Data Sets | Fabric |Are you a Data Engineer who enjoys getting involved with the architecture side of the role? Or maybe you want...

Opus Recruitment Solutions Leeds