Job Title:Python Developer with AWS Glue Experience

Location:Northampton(Hybrid)

Employment Type:Contract

About the Role:
We are seeking a skilledPython Developerwith a strong background inAWS servicesand experience in building and managingGlue jobs. The ideal candidate will design and implement scalable data pipelines and transformation solutions using AWS Glue and other AWS services, contributing to the success of data-driven projects.

Key Responsibilities:

• Develop, deploy, and maintain data pipelines usingAWS Glue,Python, and related AWS services.
• Write efficient ETL scripts for data extraction, transformation, and loading across various sources and destinations.
• Collaborate with data engineers, data scientists, and stakeholders to gather requirements and ensure optimal data workflows.
• Monitor and optimize performance for Glue jobs, ensuring cost-effectiveness and scalability.
• Implement and enforce best practices for data governance, security, and compliance using AWS services.
• Utilize other AWS services likeS3, Lambda, Athena, CloudWatch, IAM, DynamoDB, andRedshiftfor data integration and processing tasks.
• Troubleshoot and resolve issues in existing data pipelines and workflows.
• Participate in Agile ceremonies such as sprint planning, daily standups, and retrospectives.

Key Requirements:

• 6+ years of experiencein Python programming with a focus on data processing.
• Proficient inAWS Glue, including Glue ETL scripts and Glue Studio.
• Solid experience with other AWS services likeS3, Lambda, CloudWatch, Athena, andRedshift.
• Strong understanding ofdata pipeline designandETL processes.
• Hands-on experience withSQLfor querying and transforming data.
• Familiarity withSparkor distributed data processing frameworks.
• Knowledge ofdata formatslike JSON, Parquet, and Avro.
• Experience with version control tools likeGitand CI/CD pipelines.
• Strong problem-solving skills and ability to troubleshoot complex data workflows.
• Familiarity with Agile methodologies and tools like Jira.

Preferred Qualifications:

• AWS certification (e.g.,AWS Certified Developer,AWS Certified Solutions Architect).
• Experience withDevOps practicesand Infrastructure as Code (IaC) using tools likeCloudFormationorTerraform.
• Knowledge ofData Lakes,Data Warehousing, andBig Datatechnologies.
• Familiarity with scheduling tools likeApache Airflowor AWS Step Functions.
• Experience working withserverless architecturesand microservices.