Jobs

Senior Data Engineer - 12 month FTC


Job details
  • Wincanton
  • Allington
  • 1 month ago

Summary and purpose of position: This is a 12 month FTC remote position. As a Senior Data Engineer at Wincanton, you will play a pivotal role in leading the design, development, and maintenance of robust data pipelines and infrastructure within our Microsoft Azure environment. Your expertise will ensure the availability, reliability, and scalability of our data platform, empowering the organisation with timely and accurate information to recognise the value of our data. You will be responsible for designing, developing, and maintaining our data infrastructure, as well as ensuring the smooth flow and transformation of data within our organisation. You will collaborate with the Data Science and Analytics teams to implement data models, create data integration pipelines, and optimise data workflows. This role requires a strong background in data engineering, with a solid understanding of data management principles and techniques. In addition to your technical responsibilities, you will support the development of junior data engineers, providing guidance and mentorship to help them build their skills. You will lead the technical aspects of our data strategy, ensuring best practices, governance, and security in all data-led projects. You will be involved in the operational management of the data landscape, providing support and advice to help design and develop data solutions for data modelling and warehousing, data integration, and analytics. You will work with data providers and various stakeholders to define requirements and create interfaces, and help integrate new data sources. You will also troubleshoot data feeds and contribute to building ETL pipelines and data warehouse/data lake solutions. You will understand and help address the problems of various big data platforms and technologies, and support research, analysis, and the implementation of technical approaches for solving challenging and complex development and integration problems. You will assist in developing logical data models and processes to transform, clean, and normalise raw data into high-quality datasets in line with analytical requirements. This will involve working closely with our Business Intelligence (BI) team to deliver data in line with their requirements. About us: Wincanton is a leading supply chain partner for British business, providing supply chain solutions up and down the country. With over 20,000 colleagues across more than 200 sites and an 8,500 strong fleet of vehicles, we put our customers at the heart of everything we do. We are “Great people delivering sustainable supply chain value”. Duties and responsibilities: Lead the support of our Strategic Data Platform (SDP), ensuring it is robust, reliable, and cost-effective in providing high-quality data. Design, develop, and uphold data integration processes, including the creation and execution of scalable and effective data pipelines for managing and transforming large datasets. Optimise data storage and retrieval processes to meet performance and scalability requirements. Ensure data quality and consistency by implementing data validation and cleansing techniques. Collaborate with stakeholders to define requirements and integrate new data sources. Monitor and troubleshoot data pipeline issues, identify and resolve bottlenecks, and implement performance optimisations. Collaborate with the Business Intelligence (BI) team to define and implement data models for analysis and reporting purposes. Maintain best practices, governance, and security in data projects. Stay up-to-date with the latest trends and technologies in the field of data engineering, and make recommendations for improvement. Provide guidance and mentorship to junior data engineers, supporting their development and skill-building; to ensure they become self-sufficient. Lead the technical aspects of our data strategy, ensuring alignment with organisational goals and objectives. Experience, Skills, and Attributes: Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field (or equivalent experience). Strong programming skills in Python, Java, or Scala, with proficiency in database management systems and excellent SQL skills. Proven experience in designing and implementing data pipelines, ETL processes, data warehousing, and scaled data consumption patterns. Knowledge of data integration, data modelling concepts, and familiarity with cloud data platforms and storage technologies, ideally within Azure. Proficient in Azure data services (e.g., Synapse Analytics, SQL, Data Factory, Data Lake, Databricks, Cosmos DB). Experience in Agile development, branch-based source control/DevOps concepts, and gathering and analysing system requirements. Excellent problem-solving, troubleshooting, communication, and collaboration skills. Attention to detail and a commitment to delivering high-quality work. Azure Data Engineer Associate/DP-203 certification or equivalent practical experience preferred. Aptitude for learning new technologies and analytical methodologies, with experience in data visualisation tools (e.g., Power BI) and familiarity with machine learning/statistical analysis techniques being a plus. Demonstrated ability to lead and mentor junior team members, fostering a collaborative and supportive work environment. Our Values: Our Commitment: Our people are our most important asset and as such we are constantly expanding our capability programs to provide you with opportunities to build and extend your professional skills and career opportunities. Continuous learning takes place through a broad variety of opportunities and types of engagements. Access to the latest technological innovations in the logistics and supply chain industry, as well as Wincanton’s deep knowledge and expertise in our field, constitute a superb platform for your professional development. We are committed to providing equality of opportunity for all employees. We want to create an environment where all colleagues feel safe, supported, and valued, whilst feeling they can be their whole selves within our workplaces. We are proud our colleagues represent us and our successes. Attracting diverse teams, we believe in creating an inclusive, respectful organisational culture for our colleagues and future potential talent joining us. Find out more: Wincanton champions a diverse workforce .

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer

You will join the Service Performance team that monitors the entire suite of DWPs digital services a grand total of 700 software applications and systems. We use Splunk, ServiceNow and Power BI tooling to bring data together and develop quality dashboards which are relied upon and widely used by service...

Department for Work and Pensions Manchester

Senior Data Engineer

Senior Data Engineer needed for AI Startup Do you want to work on genuine greenfield projects? Want to use your skills to aid Education? Want to work with like minded individuals with the latest technologies? The Role Youll play a pivotal role in designing, building and optimising their data systems,...

Ocho Belfast

Senior Data Engineer

Senior/Lead Data EngineerA Senior/Lead Data Engineer is required by a rapidly growing Fintech based in London. The Senior/Lead Data Engineer will have extensive knowledge of modern technologies. This would ideally suit a Data Engineer with a passion for driving excellence and experience in a platform engineering or data engineering team....

Dragonfly People London

Senior Data Engineer web3

Hiring CriteriaMUST have experience setting up A/B testing pipelines & MUST have GCP experience.Experience working within the Crypto industry is a plus.Experience working at a fast moving impressive crypto company or FAANG level company or scale-up.Can work full time in London 5 days week. (West End)

TBC Holdings LLC London

Senior Data Engineer (start up experience)

Senior Data engineer- PermanentWant to help save lives?*Hybrid in Central London**2 stage interview*Did you know a frontline worker loses their life every 10 seconds?Imagine leading a team in developing a risk management platform to help save lives.Your role is crucial in creating and maintaining an innovative mobile application that will...

trg.recruitment London

Senior Data Engineer

Senior Data EngineerTech- Python, Airflow, Kafka, AWS/GCP/AzureSalary –£70,000 - £120,000Location– Full Remote (UK)A growing digital consultancy that specialises in transformation is looking for a highly skilled Senior Data Engineer to join a growing and highly experienced team solely focused on building modern data platforms. You will focus on exciting client...

Formula Recruitment Birmingham