Insight Investment is looking for an experienced Data Engineer to join our growing team building our strategic data platform as we look to adopt best-in-class data governance and democratize data around the business.

The successful candidate will play a pivotal role in shaping and executing our data strategy, leveraging our data assets to the full, elevating our decision-making, streamlining processes, and drive innovation within our organisation.

You will be part of the long-standing Data Platform team using Agile methods to deliver solutions on top of our cloud platform. Starting with Azure Databricks as a foundational component, we will look to integrate other technologies and grow capability to meet the demands of the business. You will work closely with a variety of business areas and be involved in all aspects of the Secure System Development Lifecycle (S-SDLC).

Role Responsibilities

• Lead the design and implementation of a robust and scalable data platform using Azure Databricks and complementary tooling to meet the organisation's needs.
• Contribute to and evolve the Insight Data Strategy, communicate outcomes at an executive through to team level Set the firm-wide standards and conventions for ingesting, governing, transforming, persisting, and democratising data.
• Enable the adoption of advanced analytics & AI by configuring best-in-class tooling. Evolve the usage of infrastructure-as-code in collaboration with cloud engineering.
• Align technical designs with internal data, privacy, security and compliance policies.
• Stay abreast of industry trends and emerging technologies related to Databricks and big data processing, recommending relevant advancements for consideration.

Experience Required

• Azure Databricks (Unity Catalog, Delta Lake, Delta Live Tables, Apache Spark, Structured Streaming) Python3 Terraform in Azure Integration with Collibra Integration with Snowflake Experience with CI/CD pipelines (GitHub Actions / TeamCity / Artifactory).
• Demonstrate initiative and independence to solve problems.
• Be able to communicate abstract or complex ideas or solutions effectively.
• Stand by software engineering principles around quality and doing things the right way. Experience working in and with Agile teams performing iterative development.
• Ability to collaborate with end users, stakeholders, teams, and team members.
• Have a constant desire to improve knowledge and drive adoption of new tech or approaches within the teams.
• Own mistakes and work with your colleagues to redress them, learn from them and make improvements for the long-term.

Insight is committed to being an inclusive employer and encourages applications from all suitably qualified applicants irrespective of background, circumstances, age, disability, gender identity, ethnicity, religion or belief, sexual orientation or other factors protected by federal, state and/or local laws. If you are a candidate with a disability, or are assisting a candidate with a disability, and require an accommodation to apply for one of our jobs, please email us at

About Insight Investment Insight Investment is a leading asset manager focused on designing investment solutions to meet its clients' needs. Founded in 2002, Insight's collaborative approach has delivered both investment performance and growth in assets under management. Insight manages assets across its core liability-driven investment, risk management, full-spectrum fixed income, currency and absolute return capabilities.

Insight is a global network of operations in the UK, Ireland, Germany, US, Japan and Australia. More information about Insight Investment can be found at: www.insightinvestment.com