Lead Data Engineer

Join to apply for theLead Data Engineerrole atITV.

This range is provided by ITV. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Contract Type: Perm Full Time

Workplace: White City, London - expectation is 2 days in the office.

Closing Date: 15th May 2025

The role

As a Lead Data Engineer, both directly and via your team of data engineers, you will be responsible for developing, maintaining, and optimising our data pipeline infrastructure using our proprietary central data platform, which is based on Databricks. You will collaborate with cross-functional teams to design and implement scalable data solutions, ensuring efficient data ingestion, transformation, storage, and analysis.

This role offers the chance to lead impactful projects, work with cutting-edge technologies, and shape the future of data engineering at ITV. If you’re passionate about data, leadership, and innovation, we’d love to hear from you!

Key responsibilities

1. 
   
2. Lead and Inspire:Take charge of a talented team of data engineers, providing technical leadership, mentorship, and fostering a collaborative environment. Drive productivity, set clear objectives, and support professional growth while contributing to performance reviews and recruitment.
   
3. Design & Build Scalable Data Solutions:Own the end-to-end design, development, and maintenance of data pipelines and infrastructure usingDatabricks. Innovate with new approaches, ensuring efficient data ingestion, transformation, and storage at scale.
   
4. Collaborate Across Teams:Work closely with data scientists, analysts, and stakeholders to define data product requirements and deliver impactful visualisation solutions.
   
5. Performance & Quality Assurance:Monitor and optimise data pipelines for peak performance and reliability. Implement automated quality processes to ensure data accuracy and report outcomes through observability tools.
   
6. Governance & Security:Champion data governance, ensuring compliance with privacy and security regulations. Establish access controls, encryption, and retention policies to safeguard sensitive information.
   
7. Continuous Improvement:Stay ahead of industry trends, identify opportunities for automation and innovation. Engage with the ITV Symphony team to enhance features and contribute to the broader data engineering community.
   

Qualifications and Skills

1. 
   
2. Experience leading a small team of data engineers.
   
3. Extensive knowledge as a Data Engineer.
   
4. Proven success in designing and building data products on Databricks, Snowflake, GCP Big Data, Hadoop, Spark, etc.
   
5. Excellent problem-solving, analytical, and troubleshooting skills.
   
6. Strong communication and team collaboration abilities.
   
7. Programming skills in Python (PySpark preferred), Scala, or SQL.
   
8. Experience designing and implementing enterprise-level data pipelines, with knowledge of ETL processes.
   
9. Ability to write production-grade, automated testing code.
   
10. Experience deploying via CI/CD platforms like Github Actions or Jenkins.
    
11. Proficiency with distributed frameworks like Apache Spark.
    
12. Experience with cloud platforms (AWS, Azure, GCP) and services (S3, Redshift, BigQuery).
    
13. Knowledge of data modelling, database systems, and SQL optimisation.
    

Other key criteria

1. 
   
2. Knowledge of UK broadcast industry & broadcast/OTT advertising market.
   
3. Understanding of digital marketing and advertising industry.
   
4. Familiarity with data design for classification, regression, A/B testing, and statistical modelling.
   
5. Knowledge of Data Mesh, Data Architecture, BI Architecture, and Enterprise Architecture.
   
6. Understanding of data governance, privacy, and security principles.
   
7. Familiarity with data management tools: data engineering, governance, quality, metadata, master data management.
   
8. Experience building data visualisation solutions with Tableau, AWS QuickSight, Looker, etc.
   

Seniority level

• 
  
• Mid-Senior level
  

Employment type

• 
  
• Full-time
  

Job function

• 
  
• Information Technology
  

Industries

• 
  
• Broadcast Media Production and Distribution
  

#J-18808-Ljbffr