Job Description
Representing the Ford Credit Europe Data Engineering Organization as a Google Cloud Platform (GCP) Data Engineer, specialising in migration and transformation, you will lead initiatives as part of a global team to migrate complex data systems to the Google Cloud Platform. This role involves designing, implementing, and optimizing data pipelines, ensuring data integrity during migration, and leveraging GCP services to enhance data transformation processes for scalability and efficiency.
This role is for an experienced GCP Data Engineer who can build cloud analytics platforms to meet expanding business requirements with speed and quality using lean Agile practices. You will work on analysing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and Analytics in the GCP. You will be responsible for designing the transformation and modernization on GCP, as well as landing data from source applications to GCP. Experience with large scale solutions and operationalising of data warehouses, data lakes and analytics platforms on Google Cloud Platform or other cloud environment is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design right solutions with appropriate combination of GCP and 3rd party technologies for deploying on the Google Cloud Platform.
The key deliverables include Data Platform migration and modernisation from Teradata to GCP, to enable a modern technical solution that can, not only handle existing products and services, but also provides leading edge digital data product capability, along with operational efficiency, with the tools to manage the business day-to-day to grow and innovate into the future.
Responsibilities
- Support/Lead technical Data Engineering team in Europe, working closely with Data business partners to help them transition from legacy platform to GCP.
- Responsible for code reviews and data certification with the external vendors converting the legacy code
- This role will work closely with teams in UK, US, and India to ensure robust, integrated migration aligned with Global Data Engineering patterns and standards
- Design and deploying data pipelines with automated data lineage.
- Develop, reusable Data Engineering patterns
- Design and build production data engineering solutions to deliver pipeline patterns using Google Cloud Platform (GCP) services: BigQuery, DataFlow, Pub/Sub, BigTable, Data Fusion, DataProc, Cloud Composer, Cloud SQL, Compute Engine, Cloud Functions, and App Engine
- Ensure the timely migration of FCE Data to GCP to enable Teradata platform decommissioning by end 2025 with a strong focus on ensuring continued, robust, and accurate Regulatory Reporting capability
- Responsible for parallel testing strategy and execution between Teradata and GCP
- Responsible for end-user and downstream consumption switch over from Teradata to GCP
Qualifications
Essential:
- 3-5 years of experience in data engineering, with a focus on data warehousing and ETL development (including data modelling, ETL processes, and data warehousing principles).
- 3-5 years of SQL development experience
- 3+ years of Cloud experience (GCP preferred) with solutions designed and implemented at production scale
- Strong understanding of key GCP services, especially those related to data processing (Batch/Real Time) leveraging Terraform, BigQuery, Dataflow, DataFusion, Dataproc, Cloud Build, AirFlow, and Pub/Sub, alongside and storage including Cloud Storage, Bigtable, Cloud Spanner
- Experience with data security, governance, and compliance best practices in the cloud.
- Excellent problem-solving skills, with the ability to design and optimize complex data pipelines
- Strong communication and collaboration skills, capable of working effectively with both technical and non-technical stakeholders as part of a large global and diverse team
- Experience developing with micro service architecture from container orchestration framework
- Designing and developing pipelines and architectures for data processing
- Strong evidence of self-motivation to continuously develop own engineering skills and those of the team
- Proven record of working autonomously in areas of high ambiguity, without day-to-day supervisory support
- Evidence of a proactive mindset to problem solving and willingness to take the initiative
- Strong prioritisation, co-ordination, organisational and communication skills, and a proven ability to balance workload and competing demands to meet deadlines
- Minimum 2.2 degree or international equivalent (for current employees, where supported, an exception may be applied), ideally in in Computer Science, Engineering, or a related technical field
- An understanding of current architecture standards and digital platform services strategy
Desired:
- Certification in GCP (e.g. Professional Data Engineer).
- Data engineering or development experience gained in a regulated, financial environment
- Strong expertise in SQL and experience with programming languages such as Python, Java, and/or Apache Beam
- Experience working with and managing Stakeholder expectations and delivering against a strategic road map within a product organisation
- Experience of coaching and mentoring other Data Engineers
- Knowledge of additional cloud services and infrastructure as code (Terraform, CloudFormation).
- Experience in building solution architecture, provision infrastructure, secure and reliable data-centric services and application in GCP
- Experience with DataPlex or Informatica EDC is preferred
- Experience with development eco-system such as Git, Jenkins and CICD
Additional Information:
The Company is committed to diversity and equality of opportunity for all and is opposed to any form of less favourable treatment or harassment on the grounds of race, religion or belief, sex, marriage and civil partnership, pregnancy and maternity, age, sexual orientation, gender reassignment or disability
This position is based in Dunton, and it is expected the successful candidate will be able to attend the Dunton office for typically 4 days a week and remain flexible on the days they are required to attend the office according to business requirements.
As part of our pre-employment checks process, successful candidates will be required to undergo a criminal record check. This will be conducted in line with the Rehabilitation of Offenders Act 1974 and applied only to unspent convictions.
#LI-JC2 #FordCredit
#J-18808-Ljbffr
