Jobs

Devops Engineer - Machine Learning


Job details
  • Crane Venture Partners
  • London
  • 6 days ago

At CoMind, we are developing a non-invasive neuromonitoring technology that will result in a new era of clinical brain monitoring. In joining us, you will be helping to create cutting-edge technologies that will improve how we diagnose and treat brain disorders, ultimately improving and saving the lives of patients across the world.

Below, you will find a complete breakdown of everything required of potential candidates, as well as how to apply Good luck.The RoleCoMind is seeking a skilled DevOps Engineer to join our dynamic Research Data Science team to lead the orchestration of a robust ML training pipeline in AWS. This role is critical to enabling the scalable training and testing of a range of ML models on large volumes of a totally new form of clinical neuromonitoring data.Responsibilities:Architect and implement a scalable solution to support the Research Data Science Team in running a large number of assorted machine learning pipelines, including model training, evaluation, and inference

Create a CI/CD pipeline for building containers from in-house Python packages, running integration tests, and publishing to AWS ECR

Set up ECS or AWS Batch Tasks to run containers stored in AWS ECR

Establish a robust configuration management system to store, version, and retrieve configurations associated with multiple machine learning workflows

Implement robust error handling and monitoring solutions to ensure timely debugging across the pipeline with centralised logging and error reporting

Implement cost monitoring solutions to track and manage compute costs across different runs, building dashboards to provide insights into resource usage and cost optimization

Ensure security and data protection are integrated into the pipelines by applying AWS best practices for security protocols and data management

Monitor and manage the team's compute resources, including both cloud (AWS) and on-premise GPU nodes, ensuring efficient use and scalability

Implement Infrastructure as Code (IaC) to set up and manage the pipeline architecture, using Terraform, AWS CloudFormation, or similar tools.

Skills & Experience:Git or Bitbucket for version control, including experience with managing versioned infrastructure-as-code (IaC) repositories

CI/CD pipelines for automating workflows, including experience with integration testing and containerization pipelines

Experience managing and orchestrating complex cloud workflows (e.g., ECS Tasks, AWS Batch), with a focus on event-driven and parallel processing

Infrastructure as Code (IaC) experience (e.g., Terraform, AWS CloudFormation) for creating, maintaining, and scaling cloud infrastructure

Docker for containerization, including experience with containerizing machine learning workflows and publishing containers to repositories like AWS ECR.

Benefits:Company equity plan

Company pension scheme

Private medical, dental and vision insurance

Group life assurance

Comprehensive mental health support and resources

Unlimited holiday allowance (+ bank holidays)

Hybrid working (3 days in-office)

Quarterly work-from-anywhere policy

Weekly lunches

Breakfast and snacks provided.

#J-18808-Ljbffr

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Devops Engineer

Development Operations EngineerJob Overview:We are seeking a skilled Development Operations Engineer to join our dynamic team. As a Development Operations Engineer, you will play a crucial role in developing, maintaining and enhancing new technologies that will have huge positive environmental impacts.The role is offered with a salary of £50 -...

Hale, Borough of Halton

DevOps Engineer

Job Title: DevOps EngineerJob Type: Fixed Term ContractLocation: Kings Cross, London, United KingdomDuration: 12 Months (Extension Possible)Budget: £70,000 - £90,000/year100% On-Site Required // No Sponsorship AvailableOur client are a global telecommunication company within their AI Infrastructure Team.Brief:We are looking for a highly skilled Senior DevOps Engineer to manage a large-scale...

microTECH Global LTD London

DevOps Engineer

DevOps EngineerWe are seeking a DevOps Engineer to join a blockchain intelligence team helping regulators and law-enforcement fight crypto criminals with real-time analysis.This team is a spin off from a Blockchain as a service giant. They aim to aid in the fight against crypto money laundering at scale, by helping...

Understanding Recruitment London

DevOps Engineer

Position: DevOps Engineer – Global Marketing Data PlatformContract: 1 YearLocation: London, 3 days onsite per weekWe are looking for a skilled DevOps Engineer to join a global project focused on building a centralized Master Data repository for client profiles and marketing preferences. This project aims to consolidate data from multiple...

Airswift London

DevOps Engineer

Job Title:DevOps Engineer(interest in ML a plus) Location:Remote (UK) Salary:up to £75,000 + equity.Role: We are currently seeking a skilled engineer to join our team and contribute to the build, deployment, and machine learning pipelines. This role is an excellent opportunity for individuals with DevOps experience looking to explore machine...

Third Republic London

Senior DevOps Engineer

Complexio is Foundational AI works to automate business activities by ingesting whole company data – both structured and unstructured – and making sense of it. Using proprietary models and algorithms Complexio forms a deep understanding of how humans are interacting and using it. Automation can then replicate and improve these...

Complexio London