Jobs

Senior Cloud/Data Engineer


Job details
  • Rapid7
  • Belfast
  • 1 month ago
Applications closed

Senior Cloud Engineer


Rapid7 seeks an experienced, highly driven, and dynamic Senior Cloud Engineer to take our data engineering function to the next level. Come and join our efforts in unlocking the value of data through industry-leading innovation, cutting edge modern tooling, democratization at scale and building exceptional and trusted data products for the company! 

About the Team
As we spearhead a cultural shift to a data-driven business, Data Engineering serves as the Hub for all teams at Rapid7 from ML Ops, to Sales and Operations to Platform and Engineering. Our team is a highly skilled yet egoless group of data magicians (and humorists) with a penchant for innovation and a knack for problem solving. 

About the Role

As a Senior Cloud Engineer, you will build and maintain data infrastructure within the Data Engineering team's data platform. You’ll be responsible for managing containerized applications and supporting our product event streaming systems in the cloud as you partner with high impact teams such as AI and Product Analytics. You will also build data pipelines using tools such as Airflow, Python, ECS and Snowflake. The Senior Data Engineer will also be expected to drive and mature best practices such as IAC (Terraform) and DevOps within the Data Engineering team. 

In this role, you will:

Build and maintain hosted environments for key tools with AWS ECS/EKS

Manage cloud environments for the data engineering team through Terraform

Support our product events data architecture including Kafka, SQS, EKS &, S3

Develop data pipelines with Fivetran, Snowflake & Airflow using languages such as Python, SQL & Javascript

Provide thought leadership and contribute to the vision of our data engineering function 

Participate in team processes such as on-call rotations, bug triage, technical direction, standards, and execution 

Own delivery architecture/execution of major component(s) from conception to release

Looked up to for technical mentorship within the data engineering team. Make others better through code reviews, focus on documentation, and technical guidance

Understand the tradeoffs between technical and business needs, interact and negotiate with key stakeholders, and deliver solutions that take all of these needs into account 

Regularly take complex designs / codebases and simplify them without being asked

Work closely with leadership to drive adoption of the latest DevOps and DataOps trends and technologies.

The skills you’ll bring include:

5+ years of hands-on software engineering experience 

4+ years working with a major cloud provider (preferably AWS); Experience building/maintaining VPC’s and deploying code using Terraform is a must!

3+ years building and maintaining hosted environments and applications using EKS or another container service is a must!

5+ years of experience in at least one programming language such as Python, Java, Scala is required (Python is our most commonly used language); Advanced SQL expertise is required

Experience working in a modern lakehouse is required (Snowflake is preferred); Modern warehousing best practices should be second nature

Cloud experience is required (AWS is strongly preferred); Terraform is highly preferred

Knowledge and ideally hands on experience working with container services is required (ECS, Kubernetes, etc)

Experience working in a mature SDLC environment (ie: CICD) is required 

Modern tech stack experience is a plus (dbt, Fivetran, Snowflake. Airflow)

Experience as a leader within a data engineering team and ability to mentor teammates 

Strong work ethic, resiliency, persistence, and urgency; Data Engineering holds itself to a high standard so you’ll need to keep up!

Sharp business and interpersonal skills; ability to influence at senior levels across business units to drive change and achieve common goals

BS or MS in Computer Science, Analytics, Statistics, Informatics, Information Systems or
another quantitative field or equivalent experience 


We know that the best ideas and solutions come from multi-dimensional teams. That’s because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don’t be shy - apply today.
 

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Cloud/Data Engineer

Senior Cloud EngineerRapid7 seeks an experienced, highly driven, and dynamic Senior Cloud Engineer to take our data engineering function to the next level. Come and join our efforts in unlocking the value of data through industry-leading innovation, cutting edge modern tooling, democratization at scale and building exceptional and trusted data...

Rapid7 Belfast

Senior Data Engineer

Eames are currently partnered with a speciality (re)insurer who are looking for a Senior Informatica Cloud Data Engineer to support the delivery of a new enterprise-wide data strategy and modern multi-cloud data platform.This role can be based from either Liverpool or Manchester. It is hybrid (2 office days per week)...

Eames Consulting Manchester

Cloud Data Engineer- Senior

The Company The global pace of change is accelerating, and utilities need to rebuild for a more sustainable future. Gentrack provides utilities across the world with market leading products and services to drive their transformation. Working with some of the world’s biggest energy and water companies, as well as innovative...

Gentrack London

Senior Data Engineer - Cloud & Platforms Engineering

Blackstone is the world’s largest alternative asset manager. We seek to create positive economic impact and long-term value for our investors, the companies we invest in, and the communities in which we work. We do this by using extraordinary people and flexible capital to help companies solve problems. Our $1...

Blackstone London

Data Architect (Senior/Principal Level)

Job DescriptionKey Responsibilities: Design and Develop Data Architecture: Create, optimise, and maintain conceptual, logical, and physical data models to support the enterprise data strategy. Data Strategy and Governance: Define and implement data management strategies, including data governance, metadata management, and data quality controls. Database and Cloud Technologies: Select appropriate database...

PA Consulting London

AWS Data Engineer

Senior AWS Data Engineer - Sports Analytics Platform - London (Hybrid)(Tech stack: Senior AWS Data Engineer, AWS, Data Modelling, S3, Data Architecture, Lambda, Athena, SQL, Python, C#, Snowflake, Data Pipelines, Architecture, Cloud, Data Engineering, DevOps)Our client, an exciting and rapidly expanding sports analytics company based in London Bridge, is seeking...

Noir London