Lead Data Engineer - Databricks

Manchester
3 weeks ago
Create job alert

Databricks, Unity Catalog, Azure, Azure Data Factory, Consultancy, Team Leadership, Project Leadership, Data Engineering

A rapidly growing start-up Data Consultancy are about to go into their fourth year with big growth plans off the back of a very successful year 3. Working with their high performing team and blue-chip clients, this Lead Data Engineer should come with deep technical skills with Databricks and Azure.

Key skills and experience includes;

  • Deep technical skills with Databricks, implementation & optimisation, Unity Catalog rollout experience, managemrnt of ingestion pipelines, set up CI/CD, Databricks Asset Bundles would be ideal

  • Expert programming skills with Python, Spark & PySpark

  • Strong experience of Team & Project Leadership, Management, Mentoring / Coaching in Consultancy settings

  • Srong Azure Data Factory, Storage, Key Valult and Networking Concepts, Experience with Fabric would be beneficial

  • Strong Consulting skills and customer engagement - able to communicate complext technical solutions to non-technical customers and stakeholders

    This role will be mostly remote, but you should be willing to travel to client sites (expenses covered) up to 1 day per week.

    The role will be paid at circa £75,000 - £90,000 + benefits and bonus, depending on skills and experience and offers great opportunuties to report directly into the founders and play an essential role in the growth of this exciting scale-up.

    For more information on this excellent role and company, please respond with an up to date CV via the links provided and reach out to Kerry Foreman or Joe Ingleby at Primus Connect

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer - Databricks

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Tips for Staying Inspired: How Machine Learning Pros Fuel Creativity and Innovation

Machine learning (ML) continues to reshape industries—from personalised e-commerce recommendations and autonomous vehicles to advanced healthcare diagnostics and predictive maintenance in manufacturing. Yet behind every revolutionary model lies a challenging and sometimes repetitive process: data cleaning, hyperparameter tuning, infrastructure management, stakeholder communications, and constant performance monitoring. It’s no wonder many ML professionals can experience creative fatigue or get stuck in the daily grind. So, how do machine learning experts keep their spark alive and continually generate fresh ideas? Below, you’ll find ten actionable strategies that successful ML engineers, data scientists, and research scientists use to stay innovative and push boundaries. Whether you’re an experienced practitioner or just breaking into the field, these tips can help you fuel creativity and discover new angles for solving complex problems.

Top 10 Machine Learning Career Myths Debunked: Key Facts for Aspiring Professionals

Machine learning (ML) has become one of the hottest fields in technology—touching everything from recommendation engines and self-driving cars to language translation and healthcare diagnostics. The immense potential of ML, combined with attractive compensation packages and high-profile success stories, has spurred countless professionals and students to explore this career path. Yet, despite the boom in demand and innovation, machine learning is not exempt from myths and misconceptions. At MachineLearningJobs.co.uk, we’ve had front-row seats to the real-life career journeys and hiring needs in this field. We see, time and again, that outdated assumptions—like needing a PhD from a top university or that ML is purely about deep neural networks—can mislead new entrants and even deter seasoned professionals from making a successful transition. If you’re curious about a career in machine learning or looking to take your existing ML expertise to the next level, this article is for you. Below, we debunk 10 of the most persistent myths about machine learning careers and offer a clear-eyed view of the essential skills, opportunities, and realistic paths forward. By the end, you’ll be better equipped to make informed decisions about your future in this dynamic and rewarding domain.

Global vs. Local: Comparing the UK Machine Learning Job Market to International Landscapes

How to evaluate opportunities, salaries, and work culture in machine learning across the UK, the US, Europe, and Asia Machine learning (ML) has rapidly transcended the research labs of academia to become a foundational pillar of modern technology. From recommendation engines and autonomous vehicles to fraud detection and personalised healthcare, machine learning techniques are increasingly ubiquitous, transforming how organisations operate. This surge in applications has fuelled an extraordinary global demand for ML professionals—data scientists, ML engineers, research scientists, and more. In this article, we’ll examine how the UK machine learning job market compares to prominent international hubs, including the United States, Europe, and Asia. We’ll explore hiring trends, salary ranges, workplace cultures, and the nuances of remote and overseas roles. Whether you’re a fresh graduate aiming to break into the field, a software engineer with an ML specialisation, or a seasoned professional seeking your next challenge, understanding the global ML landscape is essential for making an informed career move. By the end of this overview, you’ll be equipped with insights into which regions offer the best blend of salaries, work-life balance, and cutting-edge projects—plus practical tips on how to succeed in a domain that’s constantly evolving. Let’s dive in.