Senior / Lead Data Engineer – Eligible for SC AWS or Azure

Senior / Lead Data Engineer – Consultancy – Eligible for SC Clearance – AWS or Azure - LondonI’m looking for an experienced Senior / Lead Data Engineer to join a successful, multinational Consultancy in their London office working on high profile client projects.As a Senior Data Engineer, you'll design and implement cutting-edge data solutions that transform their clients' businesses. You'll work with cross-functional teams to create scalable, efficient architectures that turn complex data challenges into opportunities for innovation.Your role * Design end-to-end data architectures that align with business objectives * Create cloud-native solutions leveraging PaaS, serverless, and container technologies * Build robust data pipelines for both batch and streaming processes * Collaborate with clients to understand their data landscape and requirements * Mentor team members and champion best practices in data architectureTo be considered you will be able to demonstrate skills and experience in many of the following: * Expertise in designing production-grade data pipelines using Python, Scala, Spark, and SQLDeep knowledge of either: * AWS (EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB) * Or * Azure (Data Factory, Synapse, Databricks, Event Hubs, Logic Apps, Cosmos DB) * Experience with data processing across structured and unstructured sources * Strong scripting abilities and API integration skills * Knowledge of data visualization and reporting best practicesDesirable but not essential: * Experience with data mining and machine learning * Natural language processing expertise * Multi-cloud platform experienceThey will with an Agile environment with Scrum practices, Cross-functional collaborative teams and need someone who can work from the London office or client sites 2 days a week.Salary: £80,000 - £100,000 + 25 days holiday (option to buy 5 more) + pension + Performance Bonus + share optionsLocation: Hybrid working – 2 days a week in the London office or on Client siteSC Clearance Eligibility – you must be eligible for SC Security Clearance (or higher) – this means at least 5 years residence in the UK and in that time you’ve not been out the country for more than 29 days consecutively and no more than 6 months out the country per year