Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Databricks Solutions Architect

Data Intellect
London
6 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer (MS Fabric, Databricks - Legal)

Lead AWS Data Engineer / Architect - Databricks - London

Azure Data Engineer - Manchester

Azure Data Engineer - Manchester

Data Engineering Lead

Lead Azure Data Engineer

Job Description

As a Databricks Solutions Architect at [DI] you will work on a variety of impactful customer technical projects, including designing and building scalable reference architectures and productionalising customer use cases within Capital Markets.

What you will be doing:

  • Define end-to-end data architectures, ensuring best practices for data governance, access control, and cost optimisation using Unity Catalog and Delta Lake 
  • Optimise query performance, storage and compute efficiency for various workloads
  • Develop and deploy ETL/ELT pipelines, enabling real-time and batch data processing
  • Implement best practices for data ingestion and transformation in financial market data environments
  • Guide strategic customers in adopting Databricks Lakehouse as a unified data platform for structured and unstructured market data
  • Enhance and grow your knowledge among subject matter experts in our learning and development ecosystem


Qualifications

  • Proficient in data engineering, data platforms and analytics
  • Deep experience with Python, SQL and/or Scala
  • Knowledge of two or more common Cloud ecosystems (Azure, AWS, GCP) with expertise in at least one.
  • Deep experience with distributed computing with Apache Spark
  • Working knowledge CI/CD for production deployments
  • Working knowledge of MLOps
  • Familiarity with designing and deploying performant end-to-end data architectures
  • Experience with technical project delivery, managing scope and timelines
  • Able to communicate complex technical concepts to business stakeholders
  • Adaptable to evolving technologies and projects
  • At least one Databricks Certification, Data or ML Engineering.



Additional Information

What we offer: 

  • Flexible working – we offer hybrid working so our people can achieve that elusive work/life balance.
  • Professional development – we offer extensive training, ranging from leadership to specific technical skills.
  • Progression opportunities - we run a biannual promotion process. Monthly 121s with your People Leader provides support to guide you and your career in the right direction.
  • International travel opportunities – we offer the opportunity to work internationally, with teams in Belfast, London, New York, Hong Kong & Singapore
  • Healthcare cover – provider is dependent on region, UK is provided by Benenden Health, including 24/7 GP Service & Mental Health Helpline to give you peace of mind when it comes to your health
  • Generous referral scheme – we love to see referrals and referring a friend means cash for you!
  • Regular social events, prizes and giveaways – our talented social committee work hard all year round to provide exciting events across all regions to promote our value of togetherness

Who We Are:

Simply put – we turn big data problems into smart data solutions.

Data Intellect is a leading data and technology consultancy specializing in creating cutting-edge financial and capital markets technology solutions. Our expertise extends to diverse industries, including smart energy and healthcare.

Fair employment and equal opportunities

Data Intellect is an equal opportunity employer, committed to inclusion and diversity.

If you have a disability, accommodations are available on request throughout the assessment and selection processes.

Ready to accept the challenge?

Apply now.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Best Free Tools & Platforms to Practise Machine Learning Skills in 2025/26

Machine learning (ML) has become one of the most in-demand career paths in technology. From predicting customer behaviour in retail to detecting fraud in banking and enabling medical breakthroughs in healthcare, ML is transforming industries across the UK and beyond. But here’s the truth: employers don’t just want candidates who have read about machine learning in textbooks. They want evidence that you can actually build, train, and deploy models. That means practising with real tools, working with real datasets, and solving real problems. The good news is that you don’t need to pay for expensive software or courses to get started. A wide range of free, open-source tools and platforms allow you to learn machine learning skills hands-on. Whether you’re a beginner or preparing for advanced roles, you can practise everything from simple linear regression to deploying deep learning models — at no cost. In this guide, we’ll explore the best free tools and platforms to practise machine learning skills in 2025, and how to use them effectively to build a portfolio that UK employers will notice.

Top 10 Skills in Machine Learning According to LinkedIn & Indeed Job Postings

Machine learning (ML) is at the forefront of innovation, powering systems in finance, healthcare, retail, logistics, and beyond in the UK. As organisations leverage ML for predictive analytics, automation, and intelligent systems, demand for skilled practitioners continues to grow. So, which skills are most in demand? Drawing on insights from LinkedIn and Indeed, this article outlines the Top 10 machine learning skills UK employers are looking for in 2025. You'll learn how to demonstrate these capabilities through your CV, interviews, and real-world projects.

The Future of Machine Learning Jobs: Careers That Don’t Exist Yet

Machine learning (ML) has become one of the most powerful forces reshaping the modern world. From voice assistants and recommendation engines to fraud detection and medical imaging, it underpins countless applications. ML is no longer confined to research labs—it powers business models, public services, and consumer technologies across the globe. In the UK, demand for machine learning professionals has risen dramatically. Organisations in finance, retail, healthcare, and defence are embedding ML into their operations. Start-ups in Cambridge, London, and Edinburgh are pioneering innovations, while government-backed initiatives aim to position the UK as a global AI leader. Salaries for ML engineers and researchers are among the highest in the tech sector. Yet despite its current importance, machine learning is only at the beginning of its journey. Advances in generative AI, quantum computing, robotics, and ethical governance will reshape the profession. Many of the most vital machine learning jobs of the next two decades don’t exist today. This article explores why new careers will emerge, the roles likely to appear, how today’s roles will evolve, why the UK is well positioned, and how professionals can prepare now.