We’ve been helping businesses digitally transform, maximise their assets and futureproof their operations for over 30 years. With deep industry expertise we know how to make our clients more successful by adapting and implementing proven Columbus and Microsoft-based solution sets for immediate business impact.

Job Title:Lead Data Engineer - Databricks 

Location:Home-based with travel to client site or Columbus offices as required 

Salary:Negotiable (We aim to improve your current package)

Bonus:Yes 

Holiday:25 Days, Plus Bank Holidays (Increasing with Service),

Medical Insurance:Yes (terms apply) plus additional Health Cashback Plan

Hours:Full-time (36.5 hpw)

Travel/Expenses: A car is required for travel to client sites - expensed at 45p per mile from home address (excluding travel to any Columbus Office within 35mi)

JOIN US.  BE YOURSELF.

Diversity and Inclusion are close to our H.E.A.R.T!

By joining our team, you will be part of a supportive network that values your voice, respects your ideas, and promotes a healthy work-life balance. Our average length of service in the UK is 8 years, as we are committed to cultivating an inclusive workplace culture that celebrates and supports career growth and advancement in becoming a Trusted Advisor.

We provide equal opportunities for everyone, ensuring a level playing field for all candidates. We actively encourage applications candidates from all backgrounds to apply for positions across our organisation, in return you can expect us toHelp you grow.Empower you.Appreciate you.Respect you, and yourTeam.

Data & AI team, 

At Columbus, we value collaboration, trust-building, curiosity and delivering customer success. By joining our Data & AI team, you will have the opportunity to contribute to these values while continuously developing your skills and knowledge.

This is a brand new and exciting position, offering a unique opportunity to work with Databricks, a leading platform in data engineering, you'll be given the chance to shape our data capabilities and grow within the business. 

The role of Lead Data Engineer - Databricks

We’re looking for an experienced Data Engineer to design and manage scalable data pipelines using Databricks, Python, and PySpark, transforming raw data into meaningful insights. You’ll collaborate with cross-functional teams to develop high-performance workflows, ensuring efficiency, security, and reliability. 

With a focus on best practices like code versioning, modular design, and CI/CD automation, you'll help streamline deployments and maintain smooth data operations. Your expertise will also support presales efforts, providing technical insights to stakeholders and customers.

Travel and Hybrid Working

We have an environment that gives you the flexibility to achieve an effective work-life balance for you and your family, whether you want to work from home, or at one of our luxury Cubo offices around the UK.  

We continue to offer our customers onsite consultancy time if requested, so flexibility around travel and overnight stays is expected dependent on the project requirements. Onsite time is planned ahead of time, within 2-week blocks so you know well in advance where you will be working.

We encourage those in customer-facing roles aim to come into the office at least once a month, the location are usually coordinated within each team for team meetings – but you can work from Nottingham HQ or any Cubo office regularly if you prefer, whichever suits you.

About You (The Essentials)

• Extensive experience with Databricks and Azure Cloud.
• Proficiency in Python and PySpark
• Being able to provide engineering leadership for a team of engineers
• Be able to guide and manage project teams
• Strong understanding of CI/CD practices and tools. 
• Experience with software engineering best practices. 
• Excellent communication skills and the ability to work collaboratively. 
• Full drivers licence and access to vehicle
• Curious, looking to challenge the status quo and improve
• Collaborates well with both internal and external colleagues
• Committed to personal development and becoming a Trusted Advisor in your field.

What we can offer

You will be a part of both a local and global team, where you not only share knowledge but also a laugh or two. We value our employees and leave room for flexibility so that you can enjoy a work-life balance.

As a Columbian you will get;-

• 25 Days Annual Leave (Increasing with Service)
• Columbus Benefits Hub – Discounts on Tickets, Shopping, Car leasing, Holidays, Food and More
  
• Enhanced Maternity Pay
• Access to Free Training Courses Delivered by Columbus Academy
• Free Microsoft Certifications and access to Microsoft Learn
• Modern Airconditioned Office Spaces fully managed by Cubo (multiple UK locations)
• Free Barista Coffee and hot drinks made in-house
• Free Beer and Fizz every day (2 - 5pm)
• Casual Dress-code in our Offices
• Personal Pension Plan
  
• Life Assurance x4 Salary
• Cycle-to-Work Scheme
• £2,500 payment for successful candidate referrals
• Flexi-phone upgrade scheme (if eligible)
• Plus many many more (check out our careers pages for details)

Company Awards & Recognition

• Bi-annual Company Special Recognition Awards with prizes!
• Give a thumbs up through Columbus Cheers.
• Employee of the year and Employees Employee of the year.
• Long Service Awards

Employee Wellbeing Program (terms apply)

• Free 24/7 Access to Cubo Gym(s)
• Vitality Medical Insurance
• Westfield Health Cash plan (includes an Employee Assistance Lines),
• Mental health first aiders
• Suggestions Boxes

Next Steps

If this sounds like the role for you, then please drop a copy of your CV over today via our website and “Apply for this job” or CV not up to date? then apply using your LinkedIn profile in seconds.

You may also be prompted to "Connect with us", but please don’t worry if you don’t have the time, it does not impact your application.

In the meantime, check us out onInstagramorLinkedIn

STAYCURIOUS,COLLABORATE, BUILDTRUST, and DELIVERCUSTOMER SUCCESS

Suitable for candidates working with/as:

Gold Partner and Inner Circle

As a Microsoft Gold Partner for over 20 years, Columbus have access a range of market-leading resources, training and certifications. As well as a host of awards, Columbus have twice been named partner of the year by Microsoft.

As Microsoft Inner Circle members, Columbus have been recognised as part of an elite category of partners. This honour is only awarded to the very best in the industry for thought leadership, innovation and dedication, with Inner Circle partners representing only the Top 1% of the Microsoft ecosystem.