Databricks Solutions Architect

Data Intellect
Belfast
5 days ago
Applications closed

Related Jobs

View all jobs

Databricks Solutions Architect

Resident Solutions Architect - Databricks

Principal Solutions Architect

Principal Solutions Architect

Azure Data Solutions Architect

Development & Cloud Solutions Architect

Job Description

As a Databricks Solutions Architect at [DI] you will work on a variety of impactful customer technical projects, including designing and building scalable reference architectures and productionalising customer use cases within Capital Markets.

What you will be doing:

  • Define end-to-end data architectures, ensuring best practices for data governance, access control, and cost optimisation using Unity Catalog and Delta Lake 
  • Optimise query performance, storage and compute efficiency for various workloads
  • Develop and deploy ETL/ELT pipelines, enabling real-time and batch data processing
  • Implement best practices for data ingestion and transformation in financial market data environments
  • Guide strategic customers in adopting Databricks Lakehouse as a unified data platform for structured and unstructured market data
  • Enhance and grow your knowledge among subject matter experts in our learning and development ecosystem


Qualifications

  • Proficient in data engineering, data platforms and analytics
  • Deep experience with Python, SQL and/or Scala
  • Knowledge of two or more common Cloud ecosystems (Azure, AWS, GCP) with expertise in at least one.
  • Deep experience with distributed computing with Apache Spark
  • Working knowledge CI/CD for production deployments
  • Working knowledge of MLOps
  • Familiarity with designing and deploying performant end-to-end data architectures
  • Experience with technical project delivery, managing scope and timelines
  • Able to communicate complex technical concepts to business stakeholders
  • Adaptable to evolving technologies and projects
  • At least one Databricks Certification, Data or ML Engineering.



Additional Information

What we offer: 

  • Flexible working – we offer hybrid working so our people can achieve that elusive work/life balance.
  • Professional development – we offer extensive training, ranging from leadership to specific technical skills.
  • Progression opportunities - we run a biannual promotion process. Monthly 121s with your People Leader provides support to guide you and your career in the right direction.
  • International travel opportunities – we offer the opportunity to work internationally, with teams in Belfast, London, New York, Hong Kong & Singapore
  • Healthcare cover – provider is dependent on region, UK is provided by Benenden Health, including 24/7 GP Service & Mental Health Helpline to give you peace of mind when it comes to your health
  • Generous referral scheme – we love to see referrals and referring a friend means cash for you!
  • Regular social events, prizes and giveaways – our talented social committee work hard all year round to provide exciting events across all regions to promote our value of togetherness

Who We Are:

Simply put – we turn big data problems into smart data solutions.

Data Intellect is a leading data and technology consultancy specializing in creating cutting-edge financial and capital markets technology solutions. Our expertise extends to diverse industries, including smart energy and healthcare.

Fair employment and equal opportunities

Data Intellect is an equal opportunity employer, committed to inclusion and diversity.

If you have a disability, accommodations are available on request throughout the assessment and selection processes.

Ready to accept the challenge?

Apply now.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers Jobs

Top 10 Books to Advance Your Machine Learning Career in the UK

Machine learning (ML) remains one of the fastest-growing fields within technology, reshaping industries across the UK from finance and healthcare to e-commerce, telecommunications, and beyond. With increasing demand for ML specialists, job seekers who continually update their knowledge and skills hold a significant advantage. In this article, we've curated ten essential books every machine learning professional or aspiring ML engineer in the UK should read. Covering foundational theory, practical implementations, advanced techniques, and industry trends, these resources will equip you to excel in your machine learning career.

Careers

Navigating Machine Learning Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Machine learning (ML) has swiftly become one of the most in-demand skill areas across industries, with companies leveraging predictive models and data-driven insights to solve challenges in healthcare, finance, retail, manufacturing, and beyond. Whether you’re an early-career data scientist aiming to break into ML, a seasoned engineer branching into deep learning, or a product manager exploring AI-driven solutions, machine learning career fairs offer a powerful route to connect with prospective employers face-to-face. Attending these events can help you: Network with hiring managers and technical leads who make direct recruitment decisions. Gain insider insights on the latest ML trends and tools. Learn about emerging job roles and new industry verticals adopting machine learning. Showcase your interpersonal and communication skills, both of which are increasingly important in collaborative AI/ML environments. However, with many applicants vying for attention in a bustling hall, standing out isn’t always easy. In this detailed guide, we’ll walk you through how to prepare meticulously, pitch yourself confidently, ask relevant questions, and follow up effectively to land the machine learning opportunity that aligns with your ambitions.

Jobs

Common Pitfalls Machine Learning Job Seekers Face and How to Avoid Them

Machine learning has emerged as one of the most sought-after fields in technology, with companies across industries—from retail and healthcare to finance and manufacturing—embracing data-driven solutions at an unprecedented pace. In the UK, the demand for skilled ML professionals continues to soar, and opportunities in this domain are abundant. Yet, amid this growing market, competition for machine learning jobs can be fierce. Prospective employers set a high bar: they seek candidates with not just theoretical understanding, but also strong practical skills, business sense, and an aptitude for effective communication. Whether you’re a recent graduate, a data scientist transitioning into machine learning, or a seasoned developer pivoting your career, it’s essential to avoid common mistakes that may hinder your prospects. This blog post explores the pitfalls frequently encountered by machine learning job seekers, and offers actionable guidance on how to steer clear of them. If you’re looking for roles in this thriving sector, don’t forget to check out Machine Learning Jobs for the latest vacancies across the UK. In this article, we’ll break down these pitfalls to help you refine your approach in applications, interviews, and career development. By taking on board these insights, you can significantly enhance your employability, stand out from the competition, and secure a rewarding position in the world of machine learning.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.