Senior Data Engineer (Equity Only)

Luupli
Glasgow
1 month ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Remote Working

Senior Data Scientist

Senior Data Scientist (MLOps)

Data Engineering Manager

Job Title: Senior Data Engineer

About Luupli:

Luupli is a social media app that has equity, diversity, and equality at its heart. We believe that social media can be a force for good, and we are committed to creating a platform that maximises the value that creators and businesses can gain from it, while making a positive impact on society and the planet. Our app is still in development, but we are excited about the possibilities it presents. Our team is made up of passionate and dedicated individuals who are committed to making Luupli a success.

About the Role:

We’re seeking a skilled Senior Data Engineer with experience in recommendation systems to join our team. This role is pivotal in enhancing our backend systems, managing databases, and optimising recommendation algorithms. You’ll play a critical role in the architecture and performance of our recommendation infrastructure, ensuring accurate, relevant, and efficient recommendations for our users.

Responsibilities:

Data and Database Management:

  • Design, optimise, and maintain tables and data structures to support recommendation and trending content data.
  • Work with structured data storage solutions, including PostgreSQL and JSONB, to manage recommendation and interaction data.

Recommendation Systems:

  • Implement and refine recommendation algorithms (e.g., collaborative filtering, content-based, and hybrid approaches) to enhance relevancy.
  • Use similarity search libraries like Annoy or Faiss to optimise recommendation speed and accuracy.
  • Continuously evaluate recommendation logic to better serve user preferences, ensuring real-time delivery.

Data Aggregation and Analysis:

  • Aggregate, analyses, and process user interaction data to support recommendations and trending content.
  • Design efficient queries and implement aggregation methods to capture relevant data and insights for recommendations.

Debugging and Optimization:

  • Identify, troubleshoot, and resolve data handling issues to ensure accurate recommendation delivery.
  • Optimize queries, processing workflows, and containerized services for high performance and scalability within AWS ECS.

Requirements:

  • Proven experience as a Data Engineer or Backend Engineer, with a focus on recommendation systems.
  • Proficient in SQL and database management, especially with PostgreSQL and JSONB for structured data handling.
  • Solid understanding of recommendation algorithms (collaborative filtering, content-based, hybrid approaches).
  • Experience with similarity search libraries such as Annoy or Faiss.
  • Strong programming skills in Python, with experience in building backend logic for data-intensive applications in a containerized environment.
  • Familiarity with AWS ECS for container management, including task scheduling and scaling.
  • Experience using AWS Event Bridge to trigger workflows or automate tasks in response to application events.
  • Analytical skills for data aggregation, querying, and insights generation.
  • Strong debugging and optimization skills for handling large-scale data processing in cloud-based environments.

Preferred Qualifications:

  • Knowledge of data aggregation pipelines, ETL processes, and data handling at scale.
  • Familiarity with additional AWS services (e.g., S3, Lambda) for data storage and event-driven architectures.
  • Experience with machine learning libraries or tools used in recommendation systems.

Compensation:

This is an equity-only position, offering a unique opportunity to gain a stake in a rapidly growing company and contribute directly to its success.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Job-Hunting During Economic Uncertainty: Machine Learning Edition

Machine learning (ML) has firmly established itself as a crucial part of modern technology, powering everything from personalised recommendations and fraud detection to advanced robotics and predictive maintenance. Both start-ups and multinational corporations depend on machine learning engineers and data experts to gain a competitive edge via data-driven insights and automation. However, even this high-demand sector can experience a downturn when broader economic forces—such as global recessions, wavering investor confidence, or unforeseen financial events—lead to more selective hiring, stricter budgets, and lengthier recruitment cycles. For ML professionals, the result can be fewer available positions, more rivals applying for each role, or narrower project scopes. Nevertheless, the paradox is that organisations still require skilled ML practitioners to optimise operations, explore new revenue channels, and cope with fast-changing market conditions. This guide aims to help you adjust your job-hunting tactics to these challenges, so you can still secure a fulfilling position despite uncertain economic headwinds. We will cover: How market volatility influences machine learning recruitment and your subsequent steps. Effective strategies to distinguish yourself when the field becomes more discerning. Ways to showcase your technical and interpersonal skills with tangible business impact. Methods for maintaining morale and momentum throughout potentially protracted hiring processes. How www.machinelearningjobs.co.uk can direct you towards the right opportunities in machine learning. By sharpening your professional profile, aligning your abilities with in-demand areas, and engaging with a focused ML community, you can position yourself for success—even in challenging financial conditions.

How to Achieve Work-Life Balance in Machine Learning Jobs: Realistic Strategies and Mental Health Tips

Machine Learning (ML) has become a cornerstone of modern innovation, powering everything from personalised recommendation engines and chatbots to autonomous vehicles and advanced data analytics. With numerous industries integrating ML into their core operations, the demand for skilled professionals—such as ML engineers, research scientists, and data strategists—continues to surge. High salaries, cutting-edge projects, and rapid professional growth attract talent in droves, creating a vibrant yet intensely competitive sector. But the dynamism of this field can cut both ways. Along with fulfilling opportunities comes the pressure of tight deadlines, complex problem-solving, continuous learning curves, and high-stakes project deliverables. It’s a setting where many professionals ask themselves, “Is true work-life balance even possible?” When new algorithms emerge daily and stakeholder expectations soar, the line between healthy dedication and perpetual overwork can become alarmingly thin. This comprehensive guide aims to shed light on how to achieve a healthy work-life balance in Machine Learning roles. We’ll discuss the distinctive pressures ML professionals face, realistic approaches to managing workloads, strategies for safeguarding mental health, and how boundary-setting can be the difference between sustained career growth and burnout. Whether you’re just getting started or have been at the forefront of ML for years, these insights will empower you to excel without sacrificing your well-being.

Transitioning from Academia to the Machine Learning Industry: How PhDs and Researchers Can Thrive in Commercial ML Settings

Machine learning (ML) has rapidly evolved from an academic discipline into a cornerstone of commercial innovation. From personalising online content to accelerating drug discovery, machine learning technologies permeate nearly every sector, creating exciting career avenues for talented researchers. If you’re a PhD or academic scientist thinking about leaping into this dynamic field, you’re not alone. Companies are eager to recruit professionals with a strong foundation in algorithms, statistical methods, and domain-specific knowledge to build the intelligent products of tomorrow. This article explores the essential steps academics can take to transition into industry roles in machine learning. We’ll discuss the differences between academic and commercial research, the skill sets most in demand, and how to optimise your CV and interview strategy. You’ll also find tips on networking, developing a commercial mindset, and navigating common challenges as you pivot your career from the halls of academia to the ML-driven tech sector.