National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior Software Engineer - Query Planner & Reflections

Dremio
London
3 months ago
Applications closed

Related Jobs

View all jobs

Senior Software Engineer – API & ML Infrastructure

Senior Software Engineer - Machine Learning

Software Engineer III - Data Engineer - Python, SQL - Senior Associate

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

About the role

In this role, you will work on some of Dremio’s core features, including Reflections—a key feature of Dremio’s query engine that combines the power of materialized views with sophisticated automatic query rewrites through deep integration in Dremio’s distributed query optimizer. You will grow as a leader through mentoring, collaborating with other developers and taking ownership of complex issues to deliver high quality distributed systems at a massive scale.

What you'll be doing

  • Own design, implementation, testing, and support of next-generation features related to Dremio’s Query Planner and Reflections technologies
  • Work with open source projects like Apache Calcite and Apache Iceberg
  • Use modular design patterns to deliver an architecture that’s elegant, simple, extensible and maintainable
  • Solve complex technical problems and customer issues while improving our telemetry and instrumentation to proactively detect issues before they arise and make debugging more efficient
  • Design and deliver architectures that run optimally on public clouds like GCP, AWS, and Azure
  • Mentor other team members for high quality and design
  • Collaborate with Product Management to innovate and deliver on customer requirements and with Support and field teams to ensure customer success

What we're looking for

  • B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
  • 5+ years of experience developing production-level software
  • Fluency in Java/C++
  • Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
  • Strong database fundamentals including SQL, performance, and schema design is a big plus
  • Experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
  • Passion for learning, quality, zero downtime upgrades, availability, resiliency, uptime of the platform, and using latest technologies
  • Ability to solve ambiguous, unexplored, and cross-team problems effectively
  • Understanding of distributed file systems such as S3, ADLS, or HDFS
  • Experience with AWS, Azure, and Google Cloud Platform and background in large scale data processing systems (e.g., Hadoop, Spark, etc.) is a plus
  • Ability to scope and plan solutions for big problems and mentors others on the same
  • Interested and motivated to be part of a fast-moving startup with a fun and accomplished team

Bonus points if you have

  • Experience with materialized views and incremental view maintenance.
  • Experience with distributed query engines.
  • Hands on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, storage systems, heap management, Apache Arrow, SQL Operators, caching techniques, and disk spilling
  • Hands on experience with multi-threaded and asynchronous programming models

#J-18808-Ljbffr

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Part-Time Study Routes That Lead to Machine Learning Jobs: Evening Courses, Bootcamps & Online Masters

Machine learning—a subset of artificial intelligence—enables computers to learn from data and improve over time without explicit programming. From predictive maintenance in manufacturing to recommendation engines in e-commerce and diagnostic tools in healthcare, machine learning (ML) underpins many of today’s most innovative applications. In the UK, demand for ML professionals—engineers, data scientists, research scientists and ML operations specialists—is growing rapidly, with roles projected to increase by over 50% in the next five years. However, many aspiring ML practitioners cannot step away from work or personal commitments for full-time study. Thankfully, a rich ecosystem of part-time learning pathways—Evening Courses, Intensive Bootcamps and Flexible Online Master’s Programmes—empowers you to learn machine learning while working. This comprehensive guide examines each route: foundational CPD units, immersive bootcamps, accredited online MSc programmes, funding options, planning strategies and a real-world case study. Whether you’re a software developer branching into ML, a statistician aiming to upskill, or a professional exploring AI-driven innovation, you’ll discover how to build in-demand ML expertise on your own schedule.

The Ultimate Assessment-Centre Survival Guide for Machine Learning Jobs in the UK

Assessment centres for machine learning positions in the UK are designed to reflect the complexity and collaboration required in real-world ML projects. From psychometric assessments and live model-building tasks to group data science challenges and behavioural interviews, recruiters evaluate your statistical understanding, coding skills, communication and teamwork. Whether you specialise in deep learning, reinforcement learning or NLP, this guide offers a step-by-step approach to excel at every stage and secure your next ML role.

Top 10 Mistakes Candidates Make When Applying for Machine-Learning Jobs—And How to Avoid Them

Landing a machine-learning job in the UK is competitive. Learn the 10 biggest mistakes applicants make—plus tested fixes, expert resources and live links that will help you secure your next ML role. Introduction From fintechs in London’s Square Mile to advanced-research hubs in Cambridge, demand for machine-learning talent is exploding. Job boards such as MachineLearningJobs.co.uk list new vacancies daily, and LinkedIn shows more than 10,000 open ML roles across the UK right now. Yet hiring managers still reject most CVs long before interview—often for avoidable errors. Below are the ten most common mistakes we see, each paired with a practical fix and a live resource link so you can dive deeper.