Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Junior Data Engineer

Onyx-Conseil
Abbots Langley
2 months ago
Applications closed

Related Jobs

View all jobs

Junior Data Engineer

Senior Data Engineer

AWS Data Engineer - £120,000

Senior Azure Data Engineer

Senior Analytics Data Engineer – Snowflake & DBT (Contract)

Senior Data Scientist - Financial Services - Outside IR35

Data Engineer Skills and Technologies

Data Engineering:

  1. Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc.
  2. Strong understanding of complex JSON manipulation.
  3. Experience working with Data Pipelines using a custom Python/PySpark frameworks.
  4. Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
  5. Strong understanding of Data Security principles.
  6. Experience managing data owners and access controls.
  7. Knowledge of row and column level security, GDPR, and handling sensitive datasets.
  8. Strong problem-solving and analytical skills, particularly able to demonstrate these intuitively.

Required skills:

  1. Languages / Frameworks:
  • JSON
  • YAML
  • Python (as a programming language, not just able to write basic scripts; Pydantic experience would be a bonus)
  • SQL
  • PySpark
  • Delta Lake
  • Bash (both CLI usage and scripting)
  • Git
  • Markdown
  • Scala (bonus, not compulsory)
  • Azure SQL Server as a HIVE Metastore (bonus)
Technologies:
  • Azure Databricks
  • Apache Spark
  • Delta Tables
  • Data processing with Python
  • PowerBI (Integration / Data Ingestion)
  • JIRA

Due to the nature and urgency of this post, candidates holding or who have held high-level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment, which can take up to a minimum of 10 weeks.

LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies.

LA International welcomes applications from all sections of the community and from people with diverse experience and backgrounds.

Award Winning:

LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Top 10 Skills in Machine Learning According to LinkedIn & Indeed Job Postings

Machine learning (ML) is at the forefront of innovation, powering systems in finance, healthcare, retail, logistics, and beyond in the UK. As organisations leverage ML for predictive analytics, automation, and intelligent systems, demand for skilled practitioners continues to grow. So, which skills are most in demand? Drawing on insights from LinkedIn and Indeed, this article outlines the Top 10 machine learning skills UK employers are looking for in 2025. You'll learn how to demonstrate these capabilities through your CV, interviews, and real-world projects.

Careers

The Future of Machine Learning Jobs: Careers That Don’t Exist Yet

Machine learning (ML) has become one of the most powerful forces reshaping the modern world. From voice assistants and recommendation engines to fraud detection and medical imaging, it underpins countless applications. ML is no longer confined to research labs—it powers business models, public services, and consumer technologies across the globe. In the UK, demand for machine learning professionals has risen dramatically. Organisations in finance, retail, healthcare, and defence are embedding ML into their operations. Start-ups in Cambridge, London, and Edinburgh are pioneering innovations, while government-backed initiatives aim to position the UK as a global AI leader. Salaries for ML engineers and researchers are among the highest in the tech sector. Yet despite its current importance, machine learning is only at the beginning of its journey. Advances in generative AI, quantum computing, robotics, and ethical governance will reshape the profession. Many of the most vital machine learning jobs of the next two decades don’t exist today. This article explores why new careers will emerge, the roles likely to appear, how today’s roles will evolve, why the UK is well positioned, and how professionals can prepare now.

Jobs

Seasonal Hiring Peaks for Machine Learning Jobs: The Best Months to Apply & Why

The UK's machine learning sector has evolved into one of Europe's most intellectually stimulating and financially rewarding technology markets, with roles spanning from junior ML engineers to principal machine learning scientists and heads of artificial intelligence research. With machine learning positions commanding salaries from £32,000 for graduate ML engineers to £160,000+ for senior principal scientists, understanding when organisations actively recruit can dramatically accelerate your career progression in this pioneering and rapidly evolving field. Unlike traditional software engineering roles, machine learning hiring follows distinct patterns influenced by AI research cycles, model development timelines, and algorithmic innovation schedules. The sector's unique combination of mathematical rigour, computational complexity, and real-world application requirements creates predictable hiring windows that strategic professionals can leverage to advance their careers in developing tomorrow's intelligent systems. This comprehensive guide explores the optimal timing for machine learning job applications in the UK, examining how enterprise AI strategies, academic research cycles, and deep learning initiatives influence recruitment patterns, and why strategic timing can determine whether you join a groundbreaking AI research team or miss the opportunity to develop the next generation of machine learning algorithms.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.