National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior/Lead Big Data Engineer (Scala/Spark)

Grid Dynamics
Horsham
3 weeks ago
Create job alert

Join to apply for theSenior/Lead Big Data Engineer (Scala/Spark)role atGrid Dynamics.


Responsibilities


  1. Development of Spark jobs for data synchronization between different storage systems.
  2. Development of big data pipelines and infrastructure.
  3. Planning and deploying data schemas for data warehousing.
  4. Designing, developing, and maintaining RESTful services and microservices.
  5. Managing real-time data streams using Kafka.
  6. Writing efficient backend code in Java/Scala.
  7. Optimizing Postgres databases and handling complex queries.
  8. Creating automated build processes using Gradle.


Requirements


  1. Strong expertise in Spark and Scala.
  2. Hands-on experience with Hadoop.
  3. Proficiency with data processing frameworks like Kafka and Spark.
  4. Experience with database engines such as Oracle, PostgreSQL, Teradata, Cassandra.
  5. Understanding of distributed computing technologies, approaches, and patterns.


Nice to have


  • Experience with Data Lakes, Data Warehousing, or analytics systems.


We offer


  • Opportunity to work on cutting-edge projects.
  • Collaboration with a motivated and dedicated team.
  • Flexible schedule.
  • Opportunities for professional development.


About Us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Founded in 2006 and headquartered in Silicon Valley, we have offices across the Americas, Europe, and India. We focus on enterprise AI, data, analytics, cloud & DevOps, application modernization, and customer experience, enabling positive business outcomes for our clients.


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Azure Data Engineer - UK remote

Senior Data Architect

Data Engineering Lead

Senior Azure Data Engineer - Remote

Senior Azure Data Engineer - Remote

Senior Azure Data Engineer - Remote

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

LinkedIn Profile Checklist for Machine Learning Jobs: 10 Tweaks to Drive Recruiter Interest

The machine learning landscape is rapidly evolving, with demand soaring for experts in modelling, algorithm tuning and data-driven insights. Recruiters hunt for candidates proficient in Python, TensorFlow, PyTorch and MLOps processes. A generic profile simply won’t cut it. Our step-by-step LinkedIn for machine learning jobs checklist covers 10 targeted tweaks to ensure your profile ranks in searches and communicates your technical impact. Whether launching your ML career or seeking leadership roles, these optimisations will sharpen your professional narrative and boost recruiter engagement.

Part-Time Study Routes That Lead to Machine Learning Jobs: Evening Courses, Bootcamps & Online Masters

Machine learning—a subset of artificial intelligence—enables computers to learn from data and improve over time without explicit programming. From predictive maintenance in manufacturing to recommendation engines in e-commerce and diagnostic tools in healthcare, machine learning (ML) underpins many of today’s most innovative applications. In the UK, demand for ML professionals—engineers, data scientists, research scientists and ML operations specialists—is growing rapidly, with roles projected to increase by over 50% in the next five years. However, many aspiring ML practitioners cannot step away from work or personal commitments for full-time study. Thankfully, a rich ecosystem of part-time learning pathways—Evening Courses, Intensive Bootcamps and Flexible Online Master’s Programmes—empowers you to learn machine learning while working. This comprehensive guide examines each route: foundational CPD units, immersive bootcamps, accredited online MSc programmes, funding options, planning strategies and a real-world case study. Whether you’re a software developer branching into ML, a statistician aiming to upskill, or a professional exploring AI-driven innovation, you’ll discover how to build in-demand ML expertise on your own schedule.

The Ultimate Assessment-Centre Survival Guide for Machine Learning Jobs in the UK

Assessment centres for machine learning positions in the UK are designed to reflect the complexity and collaboration required in real-world ML projects. From psychometric assessments and live model-building tasks to group data science challenges and behavioural interviews, recruiters evaluate your statistical understanding, coding skills, communication and teamwork. Whether you specialise in deep learning, reinforcement learning or NLP, this guide offers a step-by-step approach to excel at every stage and secure your next ML role.