Jobs
Senior Data Engineer, Prime Video Core Analytics and Tooling
- Job details
-
- Amazon Digital UK Limited
- London
- 4 months ago
Come build the future of entertainment with us. Are you interested in shaping the future of movies and television? Do you want to define the next generation of how and what Amazon customers are watching?
Prime Video is a premium streaming service that offers customers a vast collection of TV shows and movies - all with the ease of finding what they love to watch in one place. We offer customers thousands of popular movies and TV shows from Originals and Exclusive content to exciting live sports events. We also offer our members the opportunity to subscribe to add-on channels which they can cancel at anytime and to rent or buy new release movies and TV box sets on the Prime Video Store. Prime Video is a fast-paced, growth business - available in over 240 countries and territories worldwide. The team works in a dynamic environment where innovating on behalf of our customers is at the heart of everything we do. If this sounds exciting to you, please read on.
The team presents opportunities to work on very large data sets in one of the world's largest and most complex data warehouse environments. Our data warehouse is built on AWS cloud technologies like Redshift, Kinesis, Lambda, S3, MWAA, performing ETL processing on multi terabytes of relational data in a matter of hours. Our team is serious about great design and redefining best practices with a cloud-based approach to scale, resilience and automation.
Key job responsibilities
You'll solve data warehousing problems on a massive scale and apply cloud-based AWS services to solve challenging problems around: big data processing, data warehouse design, self-service data access, automated data quality detection and building infrastructure as a code. You'll be part of the team that focuses on automation and optimization for all areas of DW/ETL maintenance and deployment.
You'll work closely with global business partners and technical teams on many non-standard and unique business problems and use creative problem solving to deliver data products that underpin Prime Video strategic decision making, from content selection to on-platform customer experience. You'll develop efficient systems and tools to process data, using technologies than can scale to seasonal spikes and easily accommodate future growth. Your work will have a direct impact on the day-to-day decision making across Prime Video.
We are open to hiring candidates to work out of one of the following locations:
London, GBR
BASIC QUALIFICATIONS
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience as a Data Engineer or in a similar role
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
- Knowledge of distributed systems as it pertains to data storage and computing
- Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
PREFERRED QUALIFICATIONS
- Experience operating large data warehouses
- Experience building data products incrementally and integrating and managing data sets from multiple sources
- Experience communicating with users, other technical teams, and management to collect requirements, describe data modeling decisions and data engineering strategy
- Experience with MPP databases such as Amazon Redshift
Sign up for our newsletter
The latest news, articles, and resources, sent to your inbox weekly.