Data Engineer
Location: Horsham
Who you be working with:
our client is a leader in the field of clean energy technology, enabling the world's most progressive companies to decarbonize at scale and pace. their technology includes advanced power generation and alternative energy solutions. Their partnerships with global companies have paved the way for developing clean energy systems that revolutionize power generation, transportation, industry, and everyday living.
Purpose of the role:
This role sits within the department of Modelling and Digitalisation, consisting of highly skilled and dedicated modelling and simulation engineers, data scientists, and data engineers. The department specialises in advanced multi-domain computational modelling, data analysis, and creates bespoke data products and cloud data platform solutions to support all core areas of the business, with a focus on accelerating the company’s product and technology development.
The role will be working in our dedicated data team, who develop and maintain our data Lakehouse platform, built on Azure Databricks, and our data pipelines using IOT and Databricks streaming services. You will have a responsibility to build and maintain robust, secure end-to-end data pipelines and data models from internal and remote sources to deliver trusted datasets to our end customers both within and outside of the business.
​
Key Accountabilities:

• Maintain and enhance our Azure Databricks Data Platform by working collaboratively with our dedicated data team and other stakeholders in the business.
  
• Build and maintain ingestion data pipelines to Delta Lake through Python coded Databricks workflows.
  
• Best practice configuration and support of Databricks compute services.
  
• Support evolution of our data platform to migrate fully into Unity Catalog and take advantage of the new capabilities.
  
• Build and maintain IOT data Streaming pipelines from source to Cloud.
  
• Build robust, automated monitoring and alerting solutions to support SLA targets and rapid responses to outages.
  
• Continuous review and piloting and data engineering technologies for solution improvements and best practices.
  
• Ensuring our data resilience and DR solutions are delivered, tested and appropriate.
  
• Work with all core business functions, including customer facing projects to identify and create data domains, models, and datasets that integrate with our latest data products – enabling fast data driven decisions to be made across the business.
  
• Where needed, lead the delivery of work-packages within cross disciplinary teams to deliver data platform solutions that meet critical business requirements.
  
• Contribute to the long-term strategy and the future direction of the department.
  ​
  Knowledge and skills required for the role:ure
  
• University level qualification in a relevant subject is desirable (e.g. Computer Science, Data Science, Engineering)
  
• Several years of experience in Data engineering, using Databricks, python, SQL Server Services/T-SQL, Azure Data Services including storage and IOT services, Azure Devops or similar Agile framework tools
  
• Experience in working in engineering and/or manufacturing sectors is desirable
  
• Experience in delivering structured streaming solutions, Unity Catalog, Azure networking and security, maintenance and optimizing of TB+ delta tables is desirable
  
• Excellent communicator: capable of communicating and building and maintaining effective relationships at all levels
  
• Creative, methodical problem solver
  
• Fast learner of new domain knowledge, proactive, self-starter able to work with minimal instructions in a fast-paced collaborative environment, not afraid to fail and try again
  You will be working with a leading developer of clean energy technology who care deeply about our purpose, our people, our customers, and our planet. We have created a fantastic working environment and offer professional development, excellent career opportunities, and comprehensive benefits. You can expect to work collaboratively with like-minded colleagues in the knowledge that together we are creating a better future.
  Benefits:
  
  • Gym Discounts
    
  • Life Insurance
    
  • Save as you Earn
    
  • Cycle to work scheme
    
  • Mental health Access
    
  • Annual Leave of 25 days + Bank Holidays
    Plus many more
    ​TPA are a specialist recruitment agency recruiting on behalf of our client.
    If you think you are a close fit for this position, please do apply and we will also register you for any upcoming positions that may be suitable