Data Engineer

Purpose of position Data sits at the heart of the company. This role is to ensure that Awin is able to leverage the data it has access to across the group and build out reporting to ensure we are able to make better commercial decisions and provide best-in-class campaign management to support client facing departments.As a Data Engineer, your responsibility is collecting data from a different source, sanitizing, cleansing, transforming and consolidating these collected data and make them available for further analysis and/or publish them as a report.You understand data, business and technical requirement. You write clean and high-quality code that is easy to understand and maintain. You clearly understand the various methodology of data extraction, transformation and storage and successfully applying your experience and knowledge of scripting, SQL, and conceptual OLTP and/or OLAP database. Within the role, you will be responsible for smooth running of data warehouse day to day operation and be working with a global team of data engineer, analyst and reporting team amongst other big data engineer within the organization. Key Tasks & accountabilities Write clean, elegant and maintainable code with data warehousing best practices and modelling techniques (Kimball, Star Schema etc.) Troubleshoot data transformation error by debugging and formulate plan to fix it. Presents clearly and confidently findings of bugs and system improvement to stakeholders. Create new Azure pipelines, data bricks notebook to add data points to existing and new source. Add new datapoint to existing AAS cube. Create new reports and update existing report definition Find new innovative way to improve performance of existing process and transformation function. Accountable for quality and accuracy of data and report. Education & experience Bachelor degree or higher in data science, data engineering, business intelligence, business administration or similar education with focus on data engineering / intelligence / analytics is preferred 2 years working experience as data warehouse developer, data engineer with python or similar Hands on with full Microsoft Azure data engineering pipelines Excellent knowledge in database and dimensional modelling technologies. Excellent knowledge of Azure Data Factory, Azure Data Bricks, Python (NumPy, Pandas), ADLS, Azure Event Hub, Azure SQL DB Excellent knowledge of SQL, T-SQL, Python and PySpark Have working knowledge of scrum and Agile practices. Proven communication and analysis skills Ideally, any of: experience working in a big data environment, AI/ML framework/libraries (MLlib, MLops, Scikit-learn, TensorFlow, Matplotlib), Spark and JSON is preferred Skills & Core competencies Ability to create complex ETL Python/PySpark functions to support application development Very strong analytical skills to translate business needs into actions with a proactive approach to tasks and challenges, delivering projects on time and budget Strong mathematical skills, ability to learn concept and apply them to problems. Create a mind-set to bring new ideas and push the data warehouse development Willing to change, learn, and start initiatives Ability to face existing challenges self-reliant with the courage to make autonomous decisions if needed Very strong communication and interaction skills Very strong project and process management competency, keen to deliver your project on time/budget without compromising on quality and results Team player, willing to improve yourself Our Offer Flexi-Week and Work-Life Balance: We prioritize your mental health and well-being, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves. Working Wherever: Do you prefer to work from our cool office, from home, or in a completely different environment? With us, the choice is yours. We offer the flexibility to work wherever you want within our Awin locations. Health & Well-Being: With our support and access to various initiatives and sports offers, you can devote yourself to your mental and physical well-being. Development: We’ve built our extensive training suite Awin Academy to cover a wide range of skills that nurture you professionally and personally, with trainings conveniently packaged together to support your overall development. Remote Working: You will receive a monthly allowance to cover a part of your running costs. In addition, we will support you in setting up your remote workspace appropriately. Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program, and show your appreciation for colleagues who have gone the extra mile to support you. Established in 2000, Awin is proud of our dynamic, social, and inclusive culture. Like all businesses, we’ve had to adapt and nurture our culture in a virtual environment. Our virtual ‘Life Awin’ hub brings our colleagues from across the globe together for various social activities. Diversity & Inclusion are paramount to us, and we proudly pursue and hire diverse team members. We champion uniqueness and authenticity; this is who we are at our core. Our network of affiliate partnerships is diverse and transparent, as are the employees powering our vision to build the world’s leading open partner ecosystem. We welcome all backgrounds, identities, and experiences. If you need support at any point in the application or interview process, please let us know. Apply now to begin the next stage of your career at a progressive company that supports both your professional and personal development.