Job Title:Senior Data Engineer
Location:North East
Salary:Competitive
We're on the lookout for strong and enthusiastic Data Engineers for an exciting opportunity with one of our fantastic clients. This is your chance to join a thriving organization that's at the forefront of data innovation, where you'll be working alongside a team of experienced and talented professionals. If you're passionate about building cutting-edge data solutions and want to take the next step in your career, this could be the perfect role for you.
Our client offers an environment that encourages growth, creativity, and collaboration, providing you with the tools and support to make a real impact. Whether it's working with the latest cloud technologies or solving complex data challenges, this is a great opportunity to elevate your skills and be part of something truly transformative.
If you’re a dedicated data engineer ready for your next challenge, we'd love to have a chat!
The Role:
As a Senior Data Engineer, you will play a pivotal role in designing, developing, and maintaining our cloud-based data infrastructure. Your main focus will be on leveraging Azure technologies to build robust data architectures that support the needs of various business units. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure our data is reliable, secure, and scalable.
Key Responsibilities:
- Design and implement end-to-end data pipelines on Microsoft Azure.
- Develop, optimize, and maintain Azure Data Lake, Azure Synapse, Azure Databricks, and other cloud-based data platforms.
- Implement data transformation processes using Azure Data Factory and Databricks to support analytics and business intelligence needs.
- Ensure high performance, availability, and scalability of our data pipelines and systems.
- Collaborate with data scientists, analysts, and other stakeholders to deliver clean, reliable, and accessible data.
- Manage and monitor cloud resources, ensuring security, compliance, and best practices in data governance.
- Automate workflows and optimize data processes to minimize manual intervention and improve efficiency.
- Lead data engineering initiatives, mentoring junior team members, and sharing best practices in data architecture and development.
Required Skills and Experience:
- 5+ yearsof experience in data engineering, with a focus on cloud-based solutions.
- Strong expertise inMicrosoft Azureservices such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks, and Azure SQL.
- Proficiency inSQL,Python, orScalafor data processing.
- Experience withETL/ELTdesign patterns and building scalable, distributed data architectures.
- Deep understanding ofdata modelling,data warehousing, anddata integrationbest practices.
- Knowledge ofAzure DevOpsand infrastructure automation tools likeTerraformorARM templates.
- Strong problem-solving skills and ability to work independently or in a team.
- Experience withCI/CD pipelinesand containerization technologies such asDockerandKubernetesis a plus.
Preferred Qualifications:
- Experience withbig data technologieslikeSpark,Hadoop, orKafka.
- Knowledge ofdata governance,security, andcomplianceframeworks in the cloud.
- Azure certifications such asAzure Data Engineer AssociateorAzure Solutions Architect.
If this sounds of interest, click apply now and a member of our team will be in touch!