Data Engineer - Databricks

Dufrain
Manchester
2 months ago
Create job alert

Dufrain_LinkedIn_Banners_AW_5.jpg

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time reporting, and managing data from mergers and acquisitions.

At Dufrain we prides ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency.

Our mission is to inspire, shape and deliver the data capabilities of tomorrow.

We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy.


Our Data Engineers 

  • Possess a broad range of data engineering skills, with a focus on Microsoft Azure, although experience with other cloud platforms is also desirable.
  • Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues.
  • Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment.
  • Delivering high-quality pieces of work, proven ability to escalate problems to client / senior team members where necessary and propose possible solutions.
  • Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge-sharing activities, and data services.


Essential technical experience you will demonstrate

  • Strong experience designing and delivering data solutions in the Databricks Data Intelligence platform, either on Azure or AWS.
  • Good working knowledge of Databricks components: DeltaLake, Unity Catalog, ML Flow, etc. Expertise in SQL, Python and Spark (Scala or Python)
  • Experience working with relational SQL databases either on premises or in the cloud.
  • Experience delivering multiple solutions using key techniques such as Governance, Architecture, Data Modelling, ETL / ELT, Data Lakes, Data Warehousing, Master Data, and BI.
  • A solid understanding of key processes in the engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and Data Pipelines.
  • Experience working with one or more of Kafka, Snowflake, Azure Data Factory, Azure Synapse or Microsoft Fabric is highly desirable.
  • Knowledge of data modelling and data architectures: Inmon, Kimball, DataVault

About You

  • A high level of drive with the ability to work to tight deadlines.
  • Experience of providing insightful solutions
  • The ability to participate effectively in meetings with senior stakeholders
  • A team player who supports, encourages and shares knowledge with others
  • A self-starter with the ability to work under pressure and with limited supervision
  • A track record of accurate output and responsibility for elements of project delivery
  • The ability to work as part of an integrated team or on an individual basis
  • Awareness of industry standards, regulations and developments

What we offer you

We have a working culture that rewards high performance and nurtures talent, while providing exciting opportunities and challenges to generate positive change for our clients.

You can expect guaranteed investment to your personal development. We have structed learning paths on a number of platform including Udemy and not to mention the in house knowledge that is shared by all of our consultants, our lunch and learn sessions are regular fixtures in the calendar.

 

Benefits

  • Competitive base salary
  • Annual Performance related bonus
  • Hybrid home/onsite/office working – Edinburgh, Manchester & London
  • 25 days annual leave (plus bank and public holidays)
  • Birthday day off – celebrate with an extra holiday
  • Career progress programme - guaranteed learning and development investment and your own career coach
  • Life insurance
  • Private medical health insurance
  • Contributory pension
  • Health and wellbeing group
  • And many more.

 

If you’re passionate about data, and you’re looking to join a leading data and analytics company based, you could find your dream role at Dufrain. Please submit your CV highlighting your relevant experience and certifications. Applicants must have the right to work in the UK and not require sponsorship now or in the future. Visa sponsorship is not available for this role.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, or disability status.

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Common Pitfalls Machine Learning Job Seekers Face and How to Avoid Them

Machine learning has emerged as one of the most sought-after fields in technology, with companies across industries—from retail and healthcare to finance and manufacturing—embracing data-driven solutions at an unprecedented pace. In the UK, the demand for skilled ML professionals continues to soar, and opportunities in this domain are abundant. Yet, amid this growing market, competition for machine learning jobs can be fierce. Prospective employers set a high bar: they seek candidates with not just theoretical understanding, but also strong practical skills, business sense, and an aptitude for effective communication. Whether you’re a recent graduate, a data scientist transitioning into machine learning, or a seasoned developer pivoting your career, it’s essential to avoid common mistakes that may hinder your prospects. This blog post explores the pitfalls frequently encountered by machine learning job seekers, and offers actionable guidance on how to steer clear of them. If you’re looking for roles in this thriving sector, don’t forget to check out Machine Learning Jobs for the latest vacancies across the UK. In this article, we’ll break down these pitfalls to help you refine your approach in applications, interviews, and career development. By taking on board these insights, you can significantly enhance your employability, stand out from the competition, and secure a rewarding position in the world of machine learning.

Career Paths in Machine Learning: From Entry-Level Roles to Leadership and Beyond

Machine learning has rapidly transformed from an academic pursuit to a cornerstone of modern technology, fueling innovations in healthcare, finance, retail, cybersecurity, and virtually every industry imaginable. From predictive analytics and computer vision to deep learning models that power personalisation algorithms, machine learning (ML) is reshaping business strategies and creating new economic opportunities. As demand for ML expertise continues to outstrip supply, the UK has become a vibrant hub for machine learning research, entrepreneurship, and corporate adoption. Whether you’re just starting out or have experience in data science, software development, or adjacent fields, there has never been a better time to pursue a career in machine learning. In this article, we will explore: The growing importance of machine learning in the UK Entry-level roles that can kick-start your ML career The skills and qualifications you’ll need to succeed Mid-level and advanced positions, including leadership tracks Tips for job seekers on www.machinelearningjobs.co.uk By the end, you’ll have a clear view of how to build, grow, and lead in one of the most exciting fields in modern technology.

Job-Hunting During Economic Uncertainty: Machine Learning Edition

Machine learning (ML) has firmly established itself as a crucial part of modern technology, powering everything from personalised recommendations and fraud detection to advanced robotics and predictive maintenance. Both start-ups and multinational corporations depend on machine learning engineers and data experts to gain a competitive edge via data-driven insights and automation. However, even this high-demand sector can experience a downturn when broader economic forces—such as global recessions, wavering investor confidence, or unforeseen financial events—lead to more selective hiring, stricter budgets, and lengthier recruitment cycles. For ML professionals, the result can be fewer available positions, more rivals applying for each role, or narrower project scopes. Nevertheless, the paradox is that organisations still require skilled ML practitioners to optimise operations, explore new revenue channels, and cope with fast-changing market conditions. This guide aims to help you adjust your job-hunting tactics to these challenges, so you can still secure a fulfilling position despite uncertain economic headwinds. We will cover: How market volatility influences machine learning recruitment and your subsequent steps. Effective strategies to distinguish yourself when the field becomes more discerning. Ways to showcase your technical and interpersonal skills with tangible business impact. Methods for maintaining morale and momentum throughout potentially protracted hiring processes. How www.machinelearningjobs.co.uk can direct you towards the right opportunities in machine learning. By sharpening your professional profile, aligning your abilities with in-demand areas, and engaging with a focused ML community, you can position yourself for success—even in challenging financial conditions.