Lead Data Engineer

Job Overview Interviews are expected to take place week commencing 14th October, 2024 The post holder will ensure specialist or complex IM&T information is processed in accordance with policies and procedures. Contribute to meeting strategic data and analytics planning and assist with the delivery of data, reporting and analytical products, with some small team leadership/mentorship aspects. The Trust is redeveloping its data, reporting, and analytics infrastructure, moving to a cloud-based Lakehouse solution hosted on Databricks with Power BI for presentation. We're looking to add to the team to support this development work, with the successful candidate being a technical lead and mentor for data skills within the team and wider-organisation as it seeks to efficiently meet requirements and improve ability to derived value from its data. Main duties of the job Oversee data flow functions including procedure setting and review. Investigate and implement resolutions or provide guidance on appropriate corrective actions when standard operations are interrupted. Contribute to design and co-lead on development cycles to ensure high quality production of automated data flows and resulting data assets. Administrate on-premises and cloud-based information management and reporting systems. Co-lead on planning and development of data tools and product use. Be a subject matter expert within the team and wider organisation regarding data management, data analysis, and associated software and system use. Be a mentor to team colleagues ensuring best practice is established and shared across the team. Lead on activities that develop and maintain transform data into valuable insights and presentation through a range of presentation tools and advanced techniques. Working for our organisation We are an award winning and CQC rated good health and social care Trust delivering integrated services across Hull, East and North Yorkshire. Find out more on our website We are a forward thinking and dynamic Trust with a real commitment to staff development. We value our colleagues and invest in them to ensure they have the right skills to deliver outstanding care. We are proud to score above or equal to the average for all NHS People Promise theme areas demonstrating our commitment to improve the experience of working in the NHS for everyone. Wherever you work we know you will receive a warm welcome and all the support you’ll need to get you started. We recognise the positive value of diversity and promotes equality whilst challenging discrimination. We welcome and encourage job applications from people of all backgrounds. Work life balance is about having influence and flexibility over when, where and how you work. If the work pattern for this role does not meet your needs, we welcome an application and are happy to discuss working arrangements that differ from those advertised. We offer a unique range of benefits that go above and beyond other NHS Trusts including an enhanced leave package and health and wellbeing support. From city to countryside, market towns to moors you’ll find a place to call home including some of the most affordable places to live in the UK. Find out more and search live jobs. Person specification Qualification and Knowledge Essential Criteria Post-degree level qualification in the relevant area, or equivalent experience and relevant specialist knowledge. Knowledge of NHS terminology and healthcare information concepts. Desirable criteria Data modelling techniques and their application. Awareness or emerging trends and techniques relating to data management & processing for analytics. Experience Essential criteria Demonstrable experience of working in the field where the post is held. Writing complex and easy-to-read SQL statements, and how implementation might impact performance. Desirable criteria Working with Spark-based information management systems, or other similar data systems. Data Integration systems and techniques Skills And Competencies Essential criteria Advanced SQL programming, including DML and DDL. Python and/or PowerShell. Logical approach to technical problems with attention to detail and numeracy skills. Desirable criteria Azure or other cloud infrastructure concepts. Different data formats and transmission technologies and their application. Work to deadlines and prioritise work accordingly.