Jobs

Senior Data Engineer


Job details
  • ONYX Insight
  • Nottingham
  • 4 weeks ago
Applications closed

The Role:

As a Data Engineer at ONYX Insight, you will play a pivotal role in developing and maintaining the data infrastructure that powers our advanced analytics and solution development. Working within our innovative team, you will design and build high-performance batch and real-time data pipelines, create ETL processes, and transform raw data into insightful, consumable datasets for both technical and non-technical stakeholders.

You'll collaborate with engineering, analytics, and data science teams to deploy machine learning models, automate workflows, and ensure our data platforms are secure, scalable, and optimized for performance. This is an opportunity to immerse yourself in cloud technologies, leverage AWS, and work with a talented, multidisciplinary team to drive impact in the global wind energy space.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines for real-time and batch processing.
  • Build robust ETL processes to extract, transform, and load data from diverse sources.
  • Automate data ingestion, aggregation, and processing workflows to streamline operations.
  • Prepare and optimize datasets in data lakes and warehouses, making them accessible for analytics and decision-making.
  • Partner with Data Scientists, Analysts, and Engineers to deploy machine learning models into production.
  • Ensure data integrity, security, privacy, and compliance across all data workflows.
  • Continuously monitor system performance and implement strategies to enhance efficiency.

Ideally you'll have/be:

  • Strong expertise in AWS cloud platforms and data engineering tools.
  • Proficiency in building and maintaining data lake/warehouse solutions.
  • Advanced skills in SQL and relational database design.
  • Experience with data ingestion and ETL tools.
  • Strong programming skills in Python or other object-oriented languages.
  • Familiarity with data pipeline and workflow management tools.
  • Excellent problem-solving abilities, with a passion for working on complex, real-world challenges.

About ONYX

ONYX Insight is a growing technology and engineering organisation in the renewable energy sector. Our vision is to build a more efficient future by becoming the world's most innovative provider of predictive technology solutions. Our advanced sensing, software and analytics combined with our engineering experience are deployed on wind turbines around the world to maximise production and make turbines more reliable for longer, optimising energy production.

ONYX Insight is part of the Macquarie Group. Macquarie is a global financial services group operating in 34 markets in asset management, leasing and asset financing, market access, commodity trading, renewables development, specialist advisory services, capital raising and principal investment. The diversity of the Macquarie Group operations combined with a strong capital position and robust risk management framework has contributed to a 54 year-record of unbroken profitability.

For any further information, or to understand our products and services better, please feel free to look through our website:https://onyxinsight.com/

ONYX Insight are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer

You will join the Service Performance team that monitors the entire suite of DWPs digital services a grand total of 700 software applications and systems. We use Splunk, ServiceNow and Power BI tooling to bring data together and develop quality dashboards which are relied upon and widely used by service...

Department for Work and Pensions Manchester

Senior Data Engineer

Senior Data Engineer needed for AI Startup Do you want to work on genuine greenfield projects? Want to use your skills to aid Education? Want to work with like minded individuals with the latest technologies? The Role Youll play a pivotal role in designing, building and optimising their data systems,...

Ocho Belfast

Senior Data Engineer

Senior/Lead Data EngineerA Senior/Lead Data Engineer is required by a rapidly growing Fintech based in London. The Senior/Lead Data Engineer will have extensive knowledge of modern technologies. This would ideally suit a Data Engineer with a passion for driving excellence and experience in a platform engineering or data engineering team....

Dragonfly People London

Senior Data Engineer web3

Hiring CriteriaMUST have experience setting up A/B testing pipelines & MUST have GCP experience.Experience working within the Crypto industry is a plus.Experience working at a fast moving impressive crypto company or FAANG level company or scale-up.Can work full time in London 5 days week. (West End)

TBC Holdings LLC London

Senior Data Engineer (start up experience)

Senior Data engineer- PermanentWant to help save lives?*Hybrid in Central London**2 stage interview*Did you know a frontline worker loses their life every 10 seconds?Imagine leading a team in developing a risk management platform to help save lives.Your role is crucial in creating and maintaining an innovative mobile application that will...

trg.recruitment London

Senior Data Engineer

Senior Data EngineerTech- Python, Airflow, Kafka, AWS/GCP/AzureSalary –£70,000 - £120,000Location– Full Remote (UK)A growing digital consultancy that specialises in transformation is looking for a highly skilled Senior Data Engineer to join a growing and highly experienced team solely focused on building modern data platforms. You will focus on exciting client...

Formula Recruitment Birmingham