Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

Peregrine
Sheffield
2 days ago
Create job alert

Join Us as a Data Engineer for Our Client


At Peregrine, we’re always seeking Specialist Talent with the ideal mix of skills, experience, and attitude to place with our diverse range of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent to place, now.


How Specialist Talent Works

As a permanent employee of Peregrine, you’ll enjoy all our standard benefits while being deployed across our portfolio of clients as a specialist consultant. You’ll work on a wide array of complex projects across multiple industries, gaining exposure to cutting-edge technologies and high-impact initiatives.


The Role

We’re looking for a Data Engineer to join a highly regulated environment, where you’ll be responsible for designing, building, and maintaining secure, scalable, and efficient data pipelines across cloud and on-premises platforms. Your work will enable seamless data integration, transformation, and delivery to support analytics, reporting, and operational needs.


You’ll collaborate with data architects, cybersecurity experts, and compliance teams to integrate data from diverse sources including databases, APIs, and cloud services. Your pipelines will support batch processing, real-time streaming, and event-driven architectures.


Responsibilities

  • Design, build, and maintain secure and scalable data pipelines using NiFi and other big data tools.
  • Optimize NiFi flows for performance, reliability, and error handling.
  • Integrate data from cloud platforms, SQL/NoSQL databases, APIs, and third-party systems.
  • Ensure data infrastructure complies with regulatory and security standards.
  • Support data migration and disaster recovery strategies.
  • Monitor and improve data infrastructure performance.
  • Collaborate with cross-functional teams to align data solutions with business and compliance needs.
  • Document data flows and engineering processes for transparency and knowledge sharing.


Skills & Experience

Programming & Data Technologies

  • Proficiency in Java and SQL.
  • Experience with C# and Scala is a plus.
  • Familiarity with ETL tools and big data platforms.
  • Knowledge of data modelling, replication, and query optimization.
  • Experience with SQL and NoSQL databases.
  • Exposure to data warehousing tools (e.g., Snowflake, Redshift, BigQuery).

Data Platform Management

  • Experience in hybrid environments (cloud/on-prem).
  • Skilled in integrating diverse data sources.
  • Understanding of secure data transfer and disaster recovery planning.

CI/CD & DevOps

  • Experience with CI/CD pipelines for deploying data flows and infrastructure.
  • Familiarity with Git, Jenkins, Azure DevOps, or similar tools.

Ways of Working

  • Comfortable in Agile/Scrum environments.
  • Experience with Jira, Confluence, Azure DevOps.

Communication & Collaboration

  • Strong communication skills for technical and non-technical audiences.
  • Proven ability to collaborate across engineering, product, and compliance teams.
  • Skilled in stakeholder management and relationship building.

Analytical Thinking

  • Strong problem-solving skills for complex data flow issues.
  • Ability to manage multiple priorities in dynamic environments.
  • Detail-oriented with a focus on quality and delivery.


About Us

At Peregrine, we look beyond the immediate and toward the horizon. We build lasting partnerships with our clients and deliver flexible resourcing solutions to help them grow the workforce they need. Our benefits package supports you throughout your career with us.


Our Culture

We embrace fresh ideas and fast learning. Our solutions are trusted and built on a solid foundation. We value openness, honesty, and collaboration. We believe our work can positively impact society—whether it’s sourcing digital talent or driving social mobility.


Our Commitment to Diversity

We champion diversity and inclusion through company-wide initiatives. Our teams represent a wide range of cultures, languages, and backgrounds. We partner with charities to stay informed and continuously improve our practices, helping our clients build more diverse teams.

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.