Jobs

Data Engineer


Job details
  • Senitor Associates
  • Chelmsford
  • 1 week ago

** Senior Data Engineer - Hybrid/Remote - Salary £55-65K **


This is an exceptional opportunity for a hands-on, talented data engineer who wants to lead the design and build out of a new data platform for reporting and analytics within a fast-growing Insurtech business.


The successful applicant will be a skilled data professional that can lead on building out a new companywide data platform, reporting and analytics solutions. The successful applicant will have strong experience in data modeling, data engineering and visualization for business analytics and reporting. The successful applicant will be a highly motivated and self-directed individual with excellent communication and teamwork skills. They will also have a proven track record of delivering data engineering and business intelligence solutions.



Experience


Minimum 6+ years commercial experience in a data engineering role

Have strong data modelling experience (star schema / Kimball), SQL and Python experience

Have a proven track record in data modelling, building out data infrastructure and ETL pipelines

Strong data visualisation experience in Power BI using DAX

Be experienced using Azure data platform tools including Azure Data Lake, Azure Data Factory, Synapse / Fabric, Databricks, Spark and other data tools



Advantageous to have:


Insurance domain knowledge a plus

Knowledge of machine learning and advanced analytics within the Azure ecosystem (e.g. Azure ML).

Familiarity with Data Governance practices in conjunction with Azure Purview (data lineage, data categorization, and data certification)

Certification such as Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Azure Solutions Architect Expert.



Key Responsibilities:


Design, build and maintain dimensional and relational models based on the business requirements.

Design data models and lakehouse’s using medallion architecture that integrate data from Azure Data Lake Storage Gen2, Azure SQL databases, and other sources for consumption in Power BI and Synapse SQL pools.

Develop, maintain, and optimize semantic data models using Azure Synapse Analytics / Fabric, Spark notebooks.

Ensure data model accuracy, scalability, and performance.

Use PySpark within Azure notebooks to extract, transform, and load (ETL/ELT) data from raw formats (e.g. Delta, Parquet, CSV) stored in ADLS Gen2.

Implement data transformation pipelines and workflows in PySpark.

Partner with DevOps teams to deploy and maintain data models in production environments.

Optimizing data models from various sources such as Azure SQL databases and Azure Data Lake Storage Gen2 for usage in Power BI

Ensure efficient querying of large datasets and troubleshoot any performance issues related to data retrieval or processing.

Create and maintain detailed documentation and schematics of data models, metadata, and processes using suitable tools, such as Visio.

Develop and enforce data governance and data modelling standards to ensure consistency and accuracy across all models.

Ensure all data modelling practices adhere to security and compliance requirements, including role-based access control, encryption, and data privacy laws (e.g., GDPR).

Applying RL/CL/OL security within the data models as defined by business use and target audience

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer {Music Tech Start-up

Data Scientist/Data Engineer {Music Tech Start-up}Cape TownR60,000 - R100,000 p/m + Company BenefitsAre you a Data crunching Data Scientist/Engineer looking to join a super disruptive music tech start-up who are just about to scale up?Do you want to work in a company who have a solid backing and a product...

Cape Town

Data Engineer - London / Hybrid - £75,000

My client is based in the London area are currently looking to recruit for an experienced Data Engineer to join their team. They are one of the leaders within the Legal Industry, and are currently going through a period of growth and are looking for an experienced Data Engineer to...

City of London

Data Engineer - Azure - Altrincham - £70k

Data Engineer - Azure - Hybrid - Manchester - £70kThis is a fantastic opportunity for a data engineer to join an expanding IT consultancy based in Manchester! If you are an expert in the MS Azure tech stack, experienced overseeing a team of data professionals and building ETL pipelines, this...

Wilmslow

Data Engineer

Data EngineerPermanentLocation: Home / Crawley (3 days a week on site)Salary: £75,000 - £85,000 (+ benefits)Skills: SQL, Postgre SQL, CockroachDB, Docker, Flyway, SC ClearanceWe are looking to recruit an SC Cleared Data Engineer for a leading software & solutions organisation. The Data Engineer will rive data enablement that underpins cutting-edge...

Crawley

Data Engineer

Are you a Data Engineer who loves to experiment and brings empathy and creativity to your work?Then you’ll fit right in at this people-first, agile tech company. Where collaboration, creativity and a shared commitment to a continuous improvement drives it’s success.Guided by core values – Empathise, Enable, Empower, and Experiment...

Bishopsgate

Data Engineer or Data Strategy Consultant

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in...

Bromley