We are seeking a skilled and experienced Data Engineer with in-depth knowledge on data processing, data modelling, and data products for integration and visualization to join our Customer Insights & Analytics team at StarTech.com
Reporting to the Manager, Business Intelligence and Data Engineering, the Data Engineer will focus primarily on data engineering, data architecture and data management processes. This role is critical in enabling the organization to leverage data effectively for decision-making and strategic initiatives by ensuring the availability, reliability, and quality of data.
What you will be responsible for:
Designing and implementing data pipelines to extract, transform, and load (ETL) data from various sources into storage systems (e.g., data warehouses, data lakes). This involves understanding the data sources, defining data extraction methods, and ensuring the integrity and quality of the data throughout the process. Integrating data from multiple sources and systems to create a unified view of the data landscape within the organization. This involves understanding data formats, protocols, and APIs to facilitate seamless data exchange and interoperability between systems. Developing algorithms and scripts to clean, preprocess, and transform raw data into a format suitable for analysis and reporting. This may involve data normalization, denormalization, aggregation, and other data manipulation techniques. Designing data models and schemas to represent the structure and relationships of the data stored in databases. This involves understanding the business requirements and data usage patterns to design models that support efficient data access and analysis. Implementing data quality checks and validation processes to ensure the accuracy, completeness, and consistency of the data. This includes identifying and resolving data anomalies, errors, and discrepancies to maintain data integrity and reliability. Documenting data engineering processes, workflows, and systems to facilitate knowledge sharing and collaboration within the Data and Analytics team and across the organization, including creating documentation for data pipelines, data models, and infrastructure configurations. Providing day-to-day support and technical expertise to both technical and non-technical teams. Assisting with optimizing the infrastructure and resources required to support data processing and analysis, including servers, clusters, storage systems, and cloud services. Collaborating with the IT organization to ensure data security, compliance, and governance standards are consistently met across the data platform, adhering to global data engineering standards and principles. Assisting with creating, documenting, and improving repeatable patterns for accessing specific data sources, such as: repeatable playbook for consuming 3rd party APIs.
Essential Qualifications:
At least 2+ years post degree experience with design, implementation, and operationalization of large-scale data and analytics solutions. Strong background in technology with experience in data engineering, data warehousing and data product development. Strong knowledge base of modern data lakehouse technologies (e.g. Microsoft Fabric, Databricks, etc.). Experience with Azure Data Lake, Azure Data Factory. Knowledge of Spark, Spark SQL, PySpark. Experience using Python for Data Engineering. Strong ability to build relationships, work collaboratively, and resolve problems. Willingness to embrace new, improved and unconventional ways to address business and technical issues and opportunities. Ownership of what is being worked on as well as willingness to take credit, accept and learn from failures when applicable. Ability to adapt to a fast-paced, dynamic work environment. Self-motivated, ability to take direction and work independently.
Benefits& Perks:
Comprehensive Benefit Plan and RRSP Matching Competitive Vacation Policy Fitness Subsidy Training and Development Program Paid Charity Day and Regular Company Fun Events StarTech.com Product Discount Bonus Plan
About us
We are in the business of human-centered experiences starting with yours. We believe delivering on our promise of "hard-to-find, made easy" begins with an employee experience founded in opportunity, teamwork, empowerment, and curious minds always asking what if. Not only does our commitment to the exceptional deepen relationships with our partners and customers, it also ignites connection within our team.
Born and raised in London, Ontario, Canada and now taking on the world, we are a vibrant and growing tech company with a proven track-record of success. StarTech.com makes it easy for IT professionals around the globe to identify, find, get and use the hard-to-find connectivity parts they need to enable and enhance their technology solutions.
Operating in 26 countries globally, we are proud to be included as one of Canada's Best Managed Companies for 2023 and for the 13th consecutive year. In 2022, StarTech.com was proud to be included in Financial Post's FP500, a ranking of Canada's largest corporations based on revenue. We are honoured to be named by Kincentric in 2019 as one of Canada’s “Best Employers” as well as “one of Canada’s fastest growing companies” for a ninth year in a row by “Profit 500”.
StarTech.com is an Equal Opportunity Employer. In accordance with the Accessibility for Ontarians with Disabilities Act, 2005 and the Ontario Human Rights Code, StarTech.com will provide accommodations throughout the recruitment, selection and/or assessment process to applicants with disabilities. If selected to participate in the recruitment, selection and/or assessment process, please inform Human Resources of the nature of any accommodation(s) that you may require in respect of any materials or processes used to ensure your equal participation.
