What you’ll be doing

Architecture and Implementation: Design and develop scalable, cost-efficient, and secure distributed architectures and solutions by leveraging appropriate GCP and AWS services and technologies.  Leadership and Mentorship: Lead, manage, and mentor a small team of data engineers to design, develop, and implement data platforms, pipelines, and infrastructure for our multi-cloud product across GCP and AWS.  Data Pipeline Development: Design, implement, and maintain robust data pipelines that efficiently collect, process, and store large volumes of data from various sources, ensuring high data quality and integrity.  Optimization and Performance: Continuously monitor, analyze, and optimize data pipelines to enhance performance, reduce costs, and ensure reliability and scalability.  Data Security and Compliance: Ensure that data solutions adhere to relevant data security and privacy regulations, implementing best practices for securing data both at rest and in transit.  Data Catalog Governance: Establish and manage a comprehensive project-wide data catalog that maintains a detailed inventory of all datasets across the platform, with clear descriptions of data items. 

Skills you'll need to succeed

Formal Training and Expertise: Certification or formal training in data engineering concepts, coupled with extensive hands-on experience.  Coding Proficiency: Active coding experience and expertise in one or more programming languages commonly used in data engineering, such as Python, R, Java, or Scala. Strong problem-solving and critical-thinking skills, with the ability to dissect complex issues and devise innovative solutions.  Data Engineering Skills: Proven ability to design, build, and optimize data pipelines, with experience using big data processing tools such as Apache Spark, Hadoop, and Dataflow.  Operational Data Systems: Experience in designing and operating large-scale Operational Data Stores, Data Lakes, and Data Warehouse platforms with high availability.  Data Integration: Proficiency with data integration tools and techniques, including ETL processes, real-time data streaming (e.g., Apache Kafka, Kinesis, Pub/Sub), and exposing data via GraphQL.  Cloud Platform Expertise: Deep understanding of GCP and AWS services, architectures, and best practices, with hands-on experience designing and implementing scalable, cost-effective solutions.  Data Storage and Databases: Strong knowledge of data storage solutions (e.g., relational databases, NoSQL, data lakes) and practical experience in managing and optimizing databases like PostgreSQL, MySQL, BigQuery, and Redshift.  Leadership and Communication: Ability to lead engineering teams, collaborate with cross-functional groups, and articulate complex technical concepts to both technical and non-technical audiences.  Knowledge Sharing: A passion for mentoring and coaching team members on coding practices, design principles, and implementation patterns. We value team players over individual heroes.  Adaptability: Comfort with navigating new and rapidly changing environments. We are building something innovative, and we need someone who can quickly learn and adapt to new technologies and patterns.  Visionary Thinking: Ability to consider long-term goals when selecting technologies and approaches, ensuring that current decisions align with future objectives without sacrificing the bigger picture. 

Experience you'd be expected to have

Educational Background:

Bachelor's or Master's Degree: Preferably in Computer Science, Data Engineering, Information Technology, or a related field. Advanced degrees can be a plus but are not always mandatory.

• Professional Experience:
Solution Engineering Experience:
5-10+ Years of Experience : Extensive experience in solution/data engineering roles with relevant skills is typically required, with progressive responsibility and complexity in projects.

• Leadership and Management:
2-5+ Years in Leadership Roles: Experience leading and managing data engineering teams, including mentoring junior engineers, conducting performance reviews, and fostering a collaborative team environment.

Benefits

Annual On target bonus 15% (personal and company multipliers) Car allowance - worth £5500 a year, can be taken as cash) Private healthcare for you and your family BT Pension scheme; minimum 5% employee contribution, BT contribution 10% Life Assurance Direct share scheme Exclusive colleague discounts on our latest and greatest BT broadband packages 50% off EE mobile pay monthly or SIM only plans and 50% discount for friends and family on EE SIM only plans My Discounts gives colleagues access to unbeatable savings on everyday purchases at hundreds of retailers Discounted EE TV including TNT Sport and the NOW Entertainment membership Great support for working parents including pay whilst on maternity, adoptive, and paternity leave 25 days annual leave (not including bank holidays), increasing with service with buy holiday option Volunteering days so you can give back to your local community Brand new electric vehicle salary sacrifice arrangement, known as ‘My EV’

Our leadership standards

Looking in:
Leading inclusively and Safely
I inspire and build trust through self-awareness, honesty and integrity.
Owning outcomes
I take the right decisions that benefit the broader organisation.

Looking out:
Delivering for the customer
I execute brilliantly on clear priorities that add value to our customers and the wider business.

Looking to the future:
Building for the future
I build diverse future-ready teams where all individuals can be at their best.