Engineer the Quantum RevolutionYour expertise can help us shape the future of quantum computing at Oxford Ionics.

View Open Roles

Data Engineer (Real Time) (Remote)

RemoteStar
Cambridge
2 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

DATA ENGINEER (Real Time)

About client:

At RemoteStar we are currently hiring for a client who is a world-class iGaming operator offering various online gaming products across multiple markets, both through their proprietary gaming sites and partner brands.

Their iGaming platform is central to their strategy, supporting over 25 online brands and growing, and it's used by hundreds of thousands of users worldwide. Our client embraces a Hybrid work-from-home model, with the flexibility of working three days in the office and two days from home.


About the Data Engineer role:

In this role, you will contribute to the design and development of Real-Time Data Processing applications to fulfil business needs.

For any Technical Data wiz out there, this is the perfect environment to put your skills to the test by building a consolidated Data Platform with innovative features and most importantly joining a bunch of talented and fun group of people.


What you will be involved in:

  1. Development and Maintenance of Real-Time Data Processing Applications by using frameworks and libraries such as: Spark Streaming, Spark Structured Streaming, Kafka Streams and Kafka Connect.
  2. Manipulation of Streaming Data: Ingestion, Transformation and Aggregation.
  3. Keeping up to date on Research and Development of new Technologies and Techniques to enhance our applications.
  4. Collaborating closely with the Data DevOps, Data-Oriented streams and other multi-disciplined teams.
  5. Comfortable working in an Agile Environment involving SDLC.
  6. Familiar with the Change and Release Management Process.
  7. Have an investigative mindset to be able to troubleshoot - thinking outside the box when it comes to troubleshooting problems and incident management.
  8. Full ownership of Projects and Tasks assigned together with being able to work within a team.
  9. Able to document well processes and perform Knowledge Sharing sessions with the rest of the team.


You're good with:

  1. Have strong knowledge in Scala.
  2. Knowledge or familiarity of Distributed Computing like Spark/KStreams/Kafka.
  3. Connect and Streaming Frameworks such as Kafka.
  4. Knowledge on Monolithic versus Microservice Architecture concepts for building large-scale applications.
  5. Familiar with the Apache suite including Hadoop modules such as HDFS, Yarn, HBase, Hive, Spark as well as Apache NiFi.
  6. Familiar with containerization and orchestration technologies such as Docker, Kubernetes.
  7. Familiar with Time-series or Analytics Databases such as Elasticsearch.
  8. Experience with Amazon Web Services using services such as S3, EC2, EMR, Redshift.
  9. Familiar with Data Monitoring and Visualisation tools such as Prometheus and Grafana.
  10. Familiar with software versioning tools like Git.
  11. Comfortable working in an Agile environment involving SDLC.
  12. Have a decent understanding of Data Warehouse and ETL concepts - familiarity with Snowflake is preferred.
  13. Have strong analytical and problem-solving skills.
  14. Good learning mindset.
  15. Can effectively prioritize and handle multiple tasks and projects.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Seasonal Hiring Peaks for Machine Learning Jobs: The Best Months to Apply & Why

The UK's machine learning sector has evolved into one of Europe's most intellectually stimulating and financially rewarding technology markets, with roles spanning from junior ML engineers to principal machine learning scientists and heads of artificial intelligence research. With machine learning positions commanding salaries from £32,000 for graduate ML engineers to £160,000+ for senior principal scientists, understanding when organisations actively recruit can dramatically accelerate your career progression in this pioneering and rapidly evolving field. Unlike traditional software engineering roles, machine learning hiring follows distinct patterns influenced by AI research cycles, model development timelines, and algorithmic innovation schedules. The sector's unique combination of mathematical rigour, computational complexity, and real-world application requirements creates predictable hiring windows that strategic professionals can leverage to advance their careers in developing tomorrow's intelligent systems. This comprehensive guide explores the optimal timing for machine learning job applications in the UK, examining how enterprise AI strategies, academic research cycles, and deep learning initiatives influence recruitment patterns, and why strategic timing can determine whether you join a groundbreaking AI research team or miss the opportunity to develop the next generation of machine learning algorithms.

Pre-Employment Checks for Machine Learning Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in machine learning reflects the discipline's unique position at the intersection of artificial intelligence research, algorithmic decision-making, and transformative business automation. Machine learning professionals often have privileged access to proprietary datasets, cutting-edge algorithms, and strategic AI systems that form the foundation of organizational competitive advantage and automated decision-making capabilities. The machine learning industry operates within complex regulatory frameworks spanning AI governance directives, algorithmic accountability requirements, and emerging ML ethics regulations. Machine learning specialists must demonstrate not only technical competence in model development and deployment but also deep understanding of algorithmic fairness, AI safety principles, and the societal implications of automated decision-making at scale. Modern machine learning roles frequently involve developing systems that impact hiring decisions, financial services, healthcare diagnostics, and autonomous operations across multiple regulatory jurisdictions and ethical frameworks simultaneously. The combination of algorithmic influence, predictive capabilities, and automated decision-making authority makes thorough candidate verification essential for maintaining compliance, fairness, and public trust in AI-powered systems.

Why Now Is the Perfect Time to Launch Your Career in Machine Learning: The UK's Intelligence Revolution

The United Kingdom stands at the epicentre of a machine learning revolution that's fundamentally transforming how we solve problems, deliver services, and unlock insights from data at unprecedented scale. From the AI-powered diagnostic systems revolutionising healthcare in Manchester to the algorithmic trading platforms driving London's financial markets, Britain's embrace of intelligent systems has created an extraordinary demand for skilled machine learning professionals that dramatically exceeds the current talent supply. If you've been seeking a career at the forefront of technological innovation or looking to position yourself in one of the most impactful sectors of the digital economy, machine learning represents an exceptional opportunity. The convergence of abundant data availability, computational power accessibility, advanced algorithmic development, and enterprise AI adoption has created perfect conditions for machine learning career success.