Principal Data Engineer (Remote)

Metapack
London
11 months ago
Applications closed

Related Jobs

View all jobs

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

About us

At Auctane, we are united by a passion to help sellers — wherever they are, however they operate — fulfil the promises they make to consumers. The Auctane mission is to fuel commerce through exceptional delivery. We make it possible for businesses to meet the ever-rising expectations of their customers, and we make the world smaller and more accessible to consumers everywhere. Auctane brands enable hundreds of thousands of merchants to annually deliver billions of products — over $200 billion worth — to customers around the globe. And Auctane is just getting started.

Auctane is a team of shipping and software experts with a passion for helping merchants move their ideas, dreams and innovations around the globe. The Auctane family includes ShipStation, ShipWorks, ShipEngine, ShippingEasy, Stamps, Endicia, Metapack, Shipsi, GlobalPost, and Packlink. Our partners include Amazon, UPS, USPS, eBay, BigCommerce, Shopify, WooCommerce, and Walmart.

Our values

About the role

This is a hands-on role for aPrincipal Data Engineerseating within the Data Products team. In this role, you will have an enormous impact on the design, implementation and maintenance of existing and greenfield customer-facing data products. Data is key to Auctane’s strategy. We work at a scale pace and with the latest architecture patterns and tech. We process thousands of events per second and our massive dataset keeps growing at a staggering pace. We keep improving our data platform and data engineering stack to accommodate growth, enable novel solutions and provide the best service to our customers. We have a flat and open engineering culture where data & evidence beat opinion and hierarchy, backed by honest discussions. We passionately believe in forming autonomous, cross-functional teams who are empowered to deliver our ambitious strategy. Energy and passion for our business and customers are a part of the Auctane culture – and we love working with like-minded people.

What you'll be doing?

Contribute to the design, build and operational management of our data pipelines and analytics solution on top of proven AWS data technologies like S3, Athena, Lambda, Kinesis and ECS. Motivate and grow the team to develop their skills and increase their ownership and impact Collaborate with the Product Owner and other stakeholders to implement the Data Products strategy. Develop frameworks and solutions that enable us to acquire, process, monitor and extract value from our massive dataset. Drive the design and architecture of Auctane’s data product. Contribute directly to the implementation and operations of our systems. Support the Data Analysts and Data Scientists with automation, tooling, data pipelines and data engineering expertise, enabling them to build rich and complex analytical features and machine learning solutions for our data products. Be an advocate of data quality and observability principles and use state-of-the-art technologies like Airflow, dbt and Spark to process data and get our datasets just right. Define the roadmap of the team based on the input from the Product Owner, other leads and stakeholders. Foster engineering excellence by delivering highly reliable software and data pipelines using Software Engineering best practices like automation, version control, continuous integration/continuous delivery, testing, security, etc. Define, implement and enforce automated data security and data governance best practices within the solutions designed. Mentor more junior colleagues and coach the team on coding and data engineering best practices and patterns.

What are we looking for?

A strong Data Engineering background. Experience developing and supporting robust, automated and reliable data pipelines in Python and SQL. Experience with data processing frameworks like Athena (Trino), Spark and tools like Pandas or DBT. Experience with cloud computing platforms (AWS, Azure or Google Cloud). Experience with streaming data processing. Continuous integration/delivery environment experience with a passion for automation. Knowledge of a Data Orchestration solution like Airflow, Oozie, Luigi or Prefect. Knowledge of both relational and non-relational database design. Knowledge of how to design distributed systems and the trade-offs involved  Experience working with software engineering best practices for development, including source control systems, automated deployment pipelines like Jenkins and DevOps tools like Terraform. Comfortable working within a geographically distributed team

What will make you stand out?

Production experience working with very large datasets. Experience with AWS and big data cloud technologies like EMR, Athena (Trino), Glue, Big Query, Dataproc, Dataflow. Direct experience with Infrastructure as Code tools (e.g. Terraform, CloudFormation) Knowledge and direct experience of using business intelligence and analytics tools (Tableau, Looker, Power BI, etc.)  Practical understanding of PII related issues and other considerations regarding data security MLOps know-how. A desire to constantly challenge the norm Proven track record of promoting and maintaining high engineering standards. Fast learner with a keen interest in evaluating and adopting new technologies: Apache Iceberg, Dagster, DBT, GreatExpectations, Prefect, Snowflake, etc.  Willing to attend conferences, webinars and meet-ups and share the learning

What do we offer?

💷Clear compensation. The salary range for this position is up to£ 97,000 per year. We'll ask you about your salary expectations in the first interview to ensure we're on the same page. 💻 Tools for the job: Auctane will provide you with all equipment you need, ensuring you can seamlessly and securely work from either the London office or the comfort of your home.🏠 Flexible hybrid working approach: Hybrid working offers the flexibility to balance on-site collaboration and remote productivity, leading to enhanced efficiency and well-being. As part of our approach, we ask that you attend the office two days a week, ensuring a blend of in-person connection and remote work benefits.🏢 Central London location: Experience the best of both worlds and join us at our fantastic office. Immerse yourself in our dynamic and open culture. Enjoy the array of complimentary drinks and snacks, and join our monthly social activities. Our London office serves as a vibrant hub within our global community, embodying true international diversity with representatives from over 20 different nationalities, speaking 10 languages. 🌇 25 days holiday (plus public holidays). Your holiday entitlement will increase to max. of 30 days, based on your length of service(2 yrs / 27 days, 3yrs / 28 days, 4yrs / 29 days and 5 yrs / 30 days)📈 CompanyPension:Auctane operates a contributory pension scheme on behalf of its employees, and will contribute up to 4%, providing the employee matches the contribution.❤️‍🩹 Life insurance:Auctane will provide 4x of base salary. This benefit is available from the first day of employment. 💰 Long term income protection: 50% of your base salary for up to 5 years. This benefit is available from the first day of employment. 🏥 PrivateMedical and Dental Insurance:Both benefits are via our partner Bupa and available post probation. (Dental enrolment only occurs in May)📚 Personal Training Budget. We offer a generous training budget of up to £2000 per year dedicated to your professional development. Whether it's investing in certifications, attending conferences, or exploring other educational opportunities, we are committed to supporting you in enhancing your expertise. We also provide access to LinkedIn Learning. This benefit is available post-probation. 🏐 Health and Wellbeing: We have a wealth of health and wellbeing benefits available. Here’s just some of what we offer; gym membership and subsidies, 24/7 EAP, virtual GP appointments, subsidised eye care, counselling sessions, physiotherapy sessions, PT, and nutrition advice, financial and legal support. There is also an extensive resource library of podcasts, webinars and articles.🚼 Tax-Free Childcare: You may be eligible for tax-free childcare, subject to the criteria set by the government. If successful, you can get up to £500 every 3 months (£2,000 a year) for each of your children to help with the costs of childcare.🚲 Cycle to work scheme: Auctane offers a subsidised cycle purchase scheme, Through this scheme, you will enjoy exclusive benefits, including attractive savings and convenient payment plans. This benefit is available post-probation. Interest-free season ticket loan: Auctane can provide an interest-free loan of up to £7,000 to purchase an annual season ticket for travel requirements. This benefit is available post-probation.  🔗Referral Bonus:Our Employee Referral Bonus Program is designed to reward you for helping us build an even stronger and more talented team. You could earn up to £3,000, depending on the role and subject to the bonus program criteria.  📦Postal Services:Auctane offers 99% discount on personal shipments using Packlink.pro

#LI-REMOTE

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Write a Winning Cover Letter for Machine Learning Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for machine learning jobs with this proven 4-paragraph structure. Ideal for entry-level candidates, career switchers, and professionals looking to advance in the machine learning sector. When applying for a machine learning job, your cover letter is a vital part of your application. Machine learning is an exciting and rapidly evolving field, and your cover letter offers the chance to demonstrate your technical expertise, passion for AI, and your ability to apply machine learning techniques to solve real-world problems. Writing a cover letter for machine learning roles may feel intimidating, but by following a clear structure, you can showcase your strengths effectively. Whether you're just entering the field, transitioning from another role, or looking to advance your career in machine learning, this article will guide you through a proven four-paragraph structure. We’ll provide practical tips and sample lines to help you create a compelling cover letter that catches the attention of hiring managers in the machine learning job market.

Veterans in Machine Learning: A Military‑to‑Civilian Pathway into AI Careers

Introduction Artificial intelligence is no longer relegated to sci‑fi films—it underpins battlefield decision‑support, fraud detection, and even supermarket logistics. The UK Government’s 2025 AI Sector Deal forecasts an additional £200 billion in GDP by 2030, with machine‑learning (ML) engineers cited as the nation’s second most in‑demand tech role (Tech Nation 2024). The Ministry of Defence’s Defence AI Strategy echoes that urgency, earmarking £1.6 billion for FY 2025–28 to embed ML into planning, logistics, and autonomous systems. If you have ever tuned a radar filter, plotted artillery trajectories, or sifted sensor data for actionable intel, you have already worked with statistical modelling—the backbone of machine learning. This guide shows UK veterans how to reframe military experience for ML roles, leverage MoD transition funding, and land high‑impact positions building the models shaping tomorrow’s defence and commercial landscapes. Quick Win: Bookmark our live board for Machine‑Learning Engineer roles to see who’s hiring today.

Rural-Remote Machine Learning Jobs: Finding Balance Beyond the Big Cities

Over the past decade, machine learning (ML) has transformed from a niche research domain into a pervasive technology underpinning everything from recommendation systems and voice assistants to financial forecasting and autonomous vehicles. Historically, the UK’s major tech hubs—particularly London—have been magnets for top ML talent and corporate headquarters. However, remote work has become mainstream, and many ML professionals are realising they can excel in their field while living far beyond the city limits. At MachineLearningJobs.co.uk, we’ve observed a growing interest in positions that allow for a rural lifestyle or a coastal environment, often reflected in search terms like “ML remote countryside” or “tech jobs by the sea.” This surge is no coincidence. Flexible work policies, better rural broadband, and the nature of machine learning tasks—much of which can be done through cloud platforms—are bringing new opportunities to those who wish to swap urban hustle for fresh air and scenic views. Whether you’re a data scientist, ML engineer, researcher, or product manager, a rural or seaside move could reinvigorate your work-life balance. In this article, we’ll unpack why rural-remote ML jobs are on the rise, how you can navigate the challenges of leaving the city, and what you need to do to thrive in a machine learning career beyond the M25. If you’ve dreamt of looking up from your laptop to rolling fields or ocean waves, keep reading—your rural ML role might be closer than you think.