Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer New

Glencore International AG
London
3 weeks ago
Applications closed

Related Jobs

View all jobs

Data Engineer New York

Data Engineer

Data Engineer

Data Engineer

Data Engineer II (Manchester/Hybrid, UK)

Data Engineer – Snowflake/Snowpark

In details, the position encompasses duties and responsibilities as follows:

An experienced Data Engineer is required for the Surveillance IT team to develop ingestion pipelines and frameworks across the application portfolio, supporting Trade Surveillance analysts with strategy and decision-making. The team has recently developed a new data lake house infrastructure and ingestion architecture and is entering a phase of hardening and re-engineering to enhance the speed, ease, and quality of ingestion across the portfolio.

The ideal candidate disposes of:

  • Bachelor's degree in Information Systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training and experience.
  • 5+ years proven experience in a data engineering role demonstrating a strong track record of designing, building, and maintaining data pipelines and data architectures.
  • Good communicator, with good interpersonal skills and the ability to convey technical issues to stakeholders.
  • Experience in Agile methodologies and in working in SCRUM, KANBAN or similar.
  • Demonstrated ability to pick up new skills and business concepts quickly.
  • Ability to accept change and adapt to organisational change and shifting priorities.
  • High work standards with a quality orientation and good attention to detail
  • Working as part of a team whilst showing an ability to work on own initiative
  • Good problem solving and ability to think quickly under pressure.

Skills:

  • Programming Languages: Strong proficiency in Python and PySpark.
  • Database Management: Expertise in SQL for data manipulation and querying.
  • Data Orchestration: Experience with orchestration tools such as Apache Airflow or Dagster.
  • Containerization: Familiarity with containerization technologies, specifically Kubernetes and Docker.
  • Data Pipelines: Proven experience in designing and implementing data pipelines, working with big data technologies and architectures.
  • Continuous Integration/Continuous Deployment (CI/CD): Knowledge of CI/CD practices and associated tools to automate testing and deployment processes.
  • Financial Knowledge: Understanding of trade and financial concepts, particularly in relation to market data.
  • Exchange Data: Includes real-time and historical market prices, trade details, order book information, market indicators, exchange metadata, news sentiment, and regulatory compliance data.

Desirable skills and experience

  • Experience in Azure/Cloud services: including App Services, Azure Functions, Cosmos DB, and Synapse.
  • Trade Surveillance: Familiarity with trade surveillance systems and methodologies, including monitoring for suspicious trading activities, detecting market manipulation, and ensuring compliance with regulatory requirements. Experience in analyzing trade patterns and anomalies to mitigate risks and enhance market integrity.
  • Commodities experience: Understanding of operations or trading in the commodities context, particularly in Oil, Gas, Shipping, and related activities.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

The Future of Machine Learning Jobs: Careers That Don’t Exist Yet

Machine learning (ML) has become one of the most powerful forces reshaping the modern world. From voice assistants and recommendation engines to fraud detection and medical imaging, it underpins countless applications. ML is no longer confined to research labs—it powers business models, public services, and consumer technologies across the globe. In the UK, demand for machine learning professionals has risen dramatically. Organisations in finance, retail, healthcare, and defence are embedding ML into their operations. Start-ups in Cambridge, London, and Edinburgh are pioneering innovations, while government-backed initiatives aim to position the UK as a global AI leader. Salaries for ML engineers and researchers are among the highest in the tech sector. Yet despite its current importance, machine learning is only at the beginning of its journey. Advances in generative AI, quantum computing, robotics, and ethical governance will reshape the profession. Many of the most vital machine learning jobs of the next two decades don’t exist today. This article explores why new careers will emerge, the roles likely to appear, how today’s roles will evolve, why the UK is well positioned, and how professionals can prepare now.

Jobs

Seasonal Hiring Peaks for Machine Learning Jobs: The Best Months to Apply & Why

The UK's machine learning sector has evolved into one of Europe's most intellectually stimulating and financially rewarding technology markets, with roles spanning from junior ML engineers to principal machine learning scientists and heads of artificial intelligence research. With machine learning positions commanding salaries from £32,000 for graduate ML engineers to £160,000+ for senior principal scientists, understanding when organisations actively recruit can dramatically accelerate your career progression in this pioneering and rapidly evolving field. Unlike traditional software engineering roles, machine learning hiring follows distinct patterns influenced by AI research cycles, model development timelines, and algorithmic innovation schedules. The sector's unique combination of mathematical rigour, computational complexity, and real-world application requirements creates predictable hiring windows that strategic professionals can leverage to advance their careers in developing tomorrow's intelligent systems. This comprehensive guide explores the optimal timing for machine learning job applications in the UK, examining how enterprise AI strategies, academic research cycles, and deep learning initiatives influence recruitment patterns, and why strategic timing can determine whether you join a groundbreaking AI research team or miss the opportunity to develop the next generation of machine learning algorithms.

Jobs

Pre-Employment Checks for Machine Learning Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in machine learning reflects the discipline's unique position at the intersection of artificial intelligence research, algorithmic decision-making, and transformative business automation. Machine learning professionals often have privileged access to proprietary datasets, cutting-edge algorithms, and strategic AI systems that form the foundation of organizational competitive advantage and automated decision-making capabilities. The machine learning industry operates within complex regulatory frameworks spanning AI governance directives, algorithmic accountability requirements, and emerging ML ethics regulations. Machine learning specialists must demonstrate not only technical competence in model development and deployment but also deep understanding of algorithmic fairness, AI safety principles, and the societal implications of automated decision-making at scale. Modern machine learning roles frequently involve developing systems that impact hiring decisions, financial services, healthcare diagnostics, and autonomous operations across multiple regulatory jurisdictions and ethical frameworks simultaneously. The combination of algorithmic influence, predictive capabilities, and automated decision-making authority makes thorough candidate verification essential for maintaining compliance, fairness, and public trust in AI-powered systems.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.