A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of Python, C#, .NET, Databricks, and Azure, ensuring alignment with business objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work independently with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning features to serve trading and analytics needs.
The Senior Data Engineer will also collaborate with quantitative analysts, traders, and commercial stakeholders to design new application features, dashboards, and analytics for portfolio management, pricing, and risk analysis. Additionally, they will support broader IT initiatives by ensuring compliance with corporate standards, best practices, and robust architectural design. This position will be officially managed by the IT department but will work very closely with the trading team. It requires strong problem-solving skills, a willingness to learn new technologies and markets, and the ability to thrive in a highly collaborative, agile environment. Excellent communication and collaboration skills are essential, along with proven experience in the relevant technologies and processes.
This position is 3 days a week onsite in Mayfair, London. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching.
Must Haves:
- Strong Python, C#, .NET development skills – proven ability to write efficient, production-quality code (e.g., data structures, error handling, code optimization).
- Proficiency in SQL – comfortable designing databases, writing complex queries, and handling performance tuning.
- Experience with Databricks (or a comparable Spark environment) – ability to build data pipelines, schedule jobs, and create dashboards/notebooks.
- Experience with Azure services (Data Factory, Synapse, or similar) and knowledge of cloud-based data solutions.
- Familiarity with version control (Git), CI/CD pipelines, and Agile/Scrum methodologies.
- Ability to communicate technical topics to non-technical stakeholders.
- Demonstrated problem-solving capabilities and willingness to learn new technologies, markets, and business concepts.
Plusses:
- Exposure to Dash Plotly (or similar Python frameworks like Streamlit) for dashboard creation.
- Experience with Machine Learning model development and data science workflows (including frameworks such as scikit-learn, PyTorch, or TensorFlow).
- Experience in Quantitative Finance or strong interest in mathematical/financial modeling, derivatives pricing, or algorithmic trading.
- Familiarity with ETRM platforms (e.g., OpenLink Endur).
- Master’s degree in computer science, Engineering, or a related technical field.
- Experience building highly scalable data applications in a cloud environment.
