Senior Data Engineer

Senior Data Engineer

An exciting opportunity has arisen for a Senior Data Engineer to join my clients dynamic and growing data team. In this role, you will work across the full data lifecyclestreaming, enrichment, and curationwithin a cloud-based environment. You will be responsible for ensuring data quality, integrating key data sets, and supporting the insights and data science teams.

As part of this role, you will also develop your expertise in Artificial Intelligence (AI) and Machine Learning (ML), with access to advanced training in ML Ops.

Key Responsibilities:

• Automate and maintain data pipelines within a cloud-based environment (AWS/GCP/Azure).
• Source and verify data from multiple sources, ensuring it is ready for ingestion.
• Gain experience in data infrastructure and contribute to the development of new cloud-based methodologies.
• Analyse large datasets using Python and SQL.
• Set up new pipelines for data streaming, enrichment, and curation.
• Manage and maintain source code repositories (GitHub).
• Investigate and apply AI/ML solutions to enhance cloud capabilities.

Key Skills & Experience:

• Strong proficiency in SQL and Python.
• Experience in cloud data solutions (AWS, GCP, or Azure).
• Experience in AI/ML.
• Experience with PySpark or equivalent.
• Strong problem-solving and analytical skills.
• Excellent attention t...