Job Title: Data Engineer
Salary: up to £65,000 (depending on experience)
Working Arrangement: Hybrid
Key Responsibilities:
· Build a Database from scratch using SQL
· Develop and manage imaging data
· Orchestrate data workflows and pipelines.
· Optimize and manage databases and data warehouses.
· Implement data transformation workflows.
· Collaborate with Software Engineering Team and other stakeholders to understand data requirements and deliver solutions.
· Ensure data quality, integrity, and security across all data platforms.
· Develop and maintain documentation for data engineering processes and systems.
· Monitor and troubleshoot data pipelines and workflows to ensure reliability and performance.
· Implement and manage CI/CD pipelines to automate the deployment and testing of data engineering solutions.
Qualifications:
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering or a related role.
• Strong proficiency in SQL & Python.
• Hands on experience with cloud-based architectures and software stacks
• Deep understanding of large always-on enterprise system architecture
• Proficient with Software Development in a Linux Environment
• Experience with containerization technologies such as Docker.
• Hands-on experience with data transformation, such as DBT.
• Experience with Prefect or similar orchestration tools.
• Strong understanding of ETL/ELT processes, data warehousing concepts and best practices.
• Experience with CI/CD pipelines and version control systems like Git.
• Excellent problem-solving skills and attention to detail.
• Strong experience modelling machine behavioural data
• Understanding of data governance and security
Desirable:
• Worked in an Agile Environment
• Experience within a regulated sector
• Used GUI Libraries
• Experience with Jira & GitHub
If you are interested in taking your career as a Data Engineer to the next level, please apply to this exciting position and we will be in touch soon