Clear Business are looking for someone who is passionate about data, able to weave together traditional and emerging technologies by applying innovative thinking to deliver business priorities for reporting and insights, whilst strengthening our internal knowledge, skills, and capability.
As a Data Engineer, you will play a vital role in developing and maintaining our data infrastructure, pipelines, and systems. You will be responsible for integrating data from various sources, ensuring its quality, and making it available for analysis and reporting. This role offers an exciting opportunity for someone with a strong technical background and a passion for data to contribute to our organization's data-driven initiatives.
We are going through an exciting transition in the Data & Insight team as we transition from a legacy on-premises to a cloud base data lake as well as enabling the business to make empowered data driven decisions. Data is a key differentiator for Verastar and this is a fantastic opportunity to help shape our future success
Responsibilities of therole
Design, develop, and maintain scalable data pipelines and ETL processes to support the collection, processing, and storage of data from diverse sources.
Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions, ensuring alignment with business objectives.
Implement data models and schemas to support business needs, ensuring data integrity, performance, and scalability.
Optimize data storage and retrieval processes for improved performance, reliability, and cost-effectiveness.
Work with stakeholders to identify opportunities for automation and optimization of data processes, driving efficiency and innovation.
Ensure compliance with data governance and security standards, implementing best practices for data handling and access control.
Stay updated on industry trends and emerging technologies in data engineering, continuously learning and applying new tools and techniques to improve our data infrastructure and processes.
Success Measures
Successfully design and implement scalable data pipelines and ETL processes that meet business requirements and performance goals.
Collaborate effectively with cross-functional teams to deliver timely and accurate data solutions that enable informed decision-making.
Demonstrate strong problem-solving skills and attention to detail in troubleshooting data issues and optimizing data processes.
Adhere to data governance and security standards, ensuring data integrity, confidentiality, and compliance with regulatory requirements.
Contribute to a culture of continuous improvement by actively seeking opportunities to enhance our data infrastructure and processes.
Experience
2+ years of experience in a data-focused role, with a proven track record of designing, implementing, and maintaining data pipelines and ETL processes.
Strong technical background with expertise in database concepts, SQL, data modeling, and data integration techniques.
Experience with programming languages such as Python, Java, or Scala, as well as data processing frameworks like Apache Spark.
Familiarity with cloud platforms and services, such as AWS, Azure, or Google Cloud, and proficiency in deploying and managing data solutions in a cloud environment.
Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
Bachelor's degree in Computer Science, Engineering, or related field is preferred.
Skills
Communication skills (data). know how to communicate to and between technical and non-technical stakeholders as well as facilitate discussions within a multidisciplinary team, with potentially difficult dynamics. You can advocate for the team externally. You know how to manage different perspectives.
Data analysis and synthesis. know how to undertake data profiling and source system analysis and can present clear insights to colleagues to support the end use of the data.
Data development process. You can design, build and test data products that are complex or large-scale. You know how to build teams to complete data integration services.
Data innovation. You understand the impact of emerging trends on the organisation in data tools, analysis techniques and data usage.
Data integration design. You know how to select and implement the appropriate technologies to deliver resilient, scalable and future-proofed data solutions.
Data modelling. You understand the concepts and principles of data modelling and can produce relevant data models across multiple subject areas. You know how to reverse-engineer data models from a live system. You understand industry-recognised data modelling patterns and standards and when to apply them. You can compare and align different data models.
Metadata management. You can design an appropriate metadata repository and present changes to existing metadata repositories. You understand a range of tools for storing and working with metadata. You can provide oversight and advice to more inexperienced members of the team.
Problem resolution (data). You know how to respond to problems in databases, data processes, data products and services as they occur. You can initiate actions, monitor services and identify trends to resolve problems. You can determine the appropriate remedy and assist with implementation of it as well as preventative measures.
Programming and build (data engineering). You know how to use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate.
Technical understanding (data engineering). You understand core technical concepts and can apply them with guidance.
Testing. You can review requirements, specifications and define test conditions. You can identify issues and risks associated with work while being able to analyse and report test activities and results.
Qualificationsand other requirements
Academic qualifications in data/ analytics/ engineering and/ or work experience in a relevant data role.
Demonstrable understanding of data integration and engineering.
Strong working experience with SQL and python. Understanding of databricks
Experience in the Microsoft Azure suite advantageous.
Experience with data governance and security standards is desirable.
Ability to work effectively in a fast-paced and collaborative environment.
In return for your hard work, you’ll get
It takes all kinds of people to make Clear Business the success that we are, and we’ve got a range of benefits to make sure everyone is happy.
- Pension contributions and life assurance coverage.
- Generous discounts at numerous high street and online retailers.
- 25 days of annual leave, increasing to 28 days based on tenure.
- Enjoy your birthday off every year.
- Ability to purchase up to 10 additional holidays and sell up to 5 days per year.
- Cycle to work and travel loans for people wanting a greener commute.
- Comprehensive well-being support, including round-the-clock access to a GP, mental health assistance, fitness programs, and complimentary legal and financial advice.
The important extras
- Hybrid working model: the choice to work remotely for three days.
- Engage in charity fundraising and volunteering activities as part of our giving back initiative.
- Enjoy fantastic on-site amenities including a complimentary gym, free parking, a subsidized café, and an on-site bar for post-work drinks, quiz nights, and social gatherings.
- Full time/Permanent contract of 37.5 hours per week.
- No weekends and every bank holiday off.
What happens next
If you’re looking for a new challenge with great benefits at an award-winning company, then Clear Business is the place for you. To be part of our continued success click ‘Apply’ today to take the next step in your career.
Across Clear Business, we’re passionate about creating an inclusive team and celebrating our diversity. We want talented people with great skills and matching values to join our teams.
All successful candidates will be subject to pre-employment checks.
#LI-KT1
