Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Principle Data Engineer

Commify Group
Nottingham
3 weeks ago
Applications closed

Related Jobs

View all jobs

Principle Data Engineer

Principle Data Engineer

Principle Data Engineer in Nottingham - Commify

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Commify is a leading provider of business messaging solutions, focused on empowering businesses to connect with their customers in meaningful and effective ways. With an extensive global presence, serving over 60,000 businesses across various industries, we are at the forefront of innovation in communications technology. As we continue to expand our offerings, we are looking for talented professionals who share our passion for technology and excellence.

We are seeking a highly experienced Principal Data Engineer to lead our data engineering initiatives. In this role, you will be responsible for designing and implementing robust data architectures and pipelines that enhance our ability to derive meaningful insights from our data. You will play a critical role in driving data-driven decision making and will collaborate closely with cross-functional teams to ensure that data is accessible, reliable, and valuable.

  • Lead the design, development, and implementation of high-performance, scalable, and reliable data pipelines and ETL/ELT processes using Azure Data Factory, Databricks, and other Azure data services.
  • Architect and manage data solutions within the Azure ecosystem, including Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures.
  • Drive the adoption of best practices for data governance, data quality, data security, and data lineage.
  • Collaborate closely with data scientists, analysts, and other engineering teams to understand data requirements and translate them into technical solutions.
  • Optimise data processing performance and cost efficiency on Azure Databricks, leveraging Spark capabilities effectively.
  • Develop and maintain robust monitoring, alerting, and logging for data pipelines.
  • Mentor and provide technical guidance to junior and mid-level data engineers, fostering a culture of continuous learning and improvement.
  • Evaluate and recommend new data technologies and tools to enhance our data platform capabilities.
  • Contribute to the overall data strategy and roadmap, ensuring alignment with business objectives.
  • Troubleshoot and resolve complex data-related issues in a timely manner.

The Person:

  • Extensive experience as a Data Engineer, with a significant portion in a principal or lead capacity.
  • Deep expertise in Azure data platform services, including:
    • Azure Databricks (extensive hands-on experience with Spark, Python/Scala for real time data processing).
    • Azure Data Factory (maintaining complex data pipelines).
    • Azure Data Lake Storage.
    • Azure SQL Database and/or Azure Synapse Analytics.
  • Strong proficiency in SQL.
  • Exposure to Infrastructure as Code and CICD deployments.
  • Excellent programming skills in Python (Scala is a strong advantage).
  • Proven experience with data modelling, schema design, and data warehousing concepts.
  • Solid understanding of data governance, data quality, and data security principles.
  • Experience with version control systems (e.g., Git).
  • Strong problem-solving abilities and a methodical approach to complex technical challenges.
  • Excellent communication and interpersonal skills, with the ability to articulate complex technical concepts to both technical and non-technical stakeholders.
  • Proven ability to lead and mentor other engineers.

Desirable:

  • Experience with real-time data streaming technologies (e.g., Azure Event Hubs, Kafka).
  • Knowledge of CI/CD pipelines for data solutions.
  • Familiarity with containerisation technologies (e.g., Docker, Kubernetes).
  • Experience with other cloud platforms (AWS, GCP) is a plus.
  • Relevant Microsoft Azure certifications (e.g., Azure Data Engineer Associate)
  • Competitive Salary (£65 - 80,000)
  • Company Bonus scheme
  • Comprehensive healthcare cash plan
  • A generous 27 days of annual leave in addition to Bank Holidays
  • 2 Wellbeing leave days and 2 days dedicated to giving back to your community
  • Enjoy your birthday off!
  • Employer pension contribution at 5%
  • Death in service benefit (4 times your salary)
  • Annual award recognition
  • Fun monthly and quarterly social events
  • Opportunities for training and professional development
  • Flexible hybrid working arrangements


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.

Jobs

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Jobs

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.