Jobs

Senior Data Engineer


Job details
  • Tech 4 Careers
  • Northumberland
  • 1 week ago


Senior Data Engineer - Python / Data Pipelines / Data Platform / AWS - is required by fast growing, highly successful and tech focused organisation.

About the job

You will play a crucial role in designing, building, and maintaining their data platform, with a strong emphasis on streaming data, cloud infrastructure, and machine learning operations.

Key Responsibilities:

  • Architect and Implement Data Pipelines:
    • Design, develop, and maintain scalable and efficient data pipelines
    • Optimize ETL processes to ensure seamless data ingestion, processing, and integration across various systems
  • Streaming Data Platform Development:
    • Lead the development and maintenance of a real-time data streaming platform using tools like Apache Kafka, Databricks, Kinesis.
    • Ensure the integration of streaming data with batch processing systems for comprehensive data management
  • Cloud Infrastructure Management:
    • Utilize AWS data engineering services (including S3, Redshift, Glue, Kinesis, Lambda, etc.) to build and manage our data infrastructure
    • Continuously optimize the platfor...

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer

Senior Data EngineerJob DescriptionData is at the heart of how the most complex problems and critical challenges are solved. A unique position has risen due to the access to vast quantities of data, world leading domain specialists on tap and an extremely diverse range of clients with unique challenges.The Data...

Cheltenham

Senior Data Engineer - Remote - £60k

Senior Data Engineer - Fully Remote - £60kMy client are seeking an experienced and highly skilled Senior Data Engineer to lead the design, development, and maintenance of their data infrastructure. In this role, you will assist in overseeing data integration, streaming systems, and data engineering best practices while collaborating with...

City of London

Senior Data Engineer - London - £85,000

Senior Data Engineer - London - £85,000I am looking for a Senior Data Engineer to join a well-known and successful organisation to deliver on a variety of data driven projects. The business is looking for someone to add a level of expertise to their team of Data Engineers and you...

City of London

Senior Data Engineer - Snowflake - £85,000 - London - Hybrid

Senior Data Engineer - Snowflake - £85,000 - London - HybridCompany Overview:My client is a global leader in the insurance industry, serving millions of customers worldwide. With strong financial foundations established over decades, their commitment to utilising innovative solutions and cutting-edge technologies is a key pillar of their recent success....

City of London

Senior Data engineer

Role: Senior Data EngineerLocation: UK Remote Rate £400.00 As a Senior Data Engineer, you’ll play a key role in crafting the data platforms, models and pipelines that inform strategic decision-making for our customers and prepare data for a plethora of use cases from simple analytics to Generative AI and Data...

London

Senior Data Engineer

Jackson Hogg are currently working with one of their Financial Services client based in Sunderland on the search for a Senior Data Engineer.The successful candidate will be looking to take ownership of their Azure platform, ensuring data quality, support on data migrations and maintain architecture.Skills:Data FactoryDatabricksData Lake ServicesLead data migrationsRe-architect...

Sunderland