Principal Data Engineer

Principal Data Platform Engineer

We are seeking aPrincipal Data Platform Engineerto drive the development and optimization of our modern, cloud-based data platform. This is a high-impact role ideal for a technically hands-on leader with deep experience inDatabricks,cloud data infrastructure, andorchestration engineering.

You will play a key role in ourSQL-to-Databricks migration, helping design and implement scalable, repeatable solutions across multiple data sets. This includes setting up infrastructure, writing orchestration pipelines, and engineering parameterized ETLs to support reuse and automation.

Key Responsibilities

• Lead themigration of data assets from SQL Server to Databricks, including both infrastructure setup and pipeline engineering
• Build and maintainparameterized ETL pipelinesthat support multiple data sets with minimal code duplication (e.g., a single ETL pattern adaptable for 8–12 similar data sets)
• Own theend-to-end orchestrationof data workflows using tools likeAzure Data Factory,dbt, or similar, ensuring repeatability, scalability, and reliability
• Set up and manage cloud infrastructure components for the data platform (preferably inAzure), including networking, security, and deployment automation
• Collaborate with architecture and engineering teams to define standards and ensure best practices are followed across data platform components
• Provide technical leadership and mentorship to engineers across the team

Experience

• Strong,hands-on experience with Databricks, including migration projects, performance tuning, and solution delivery (not just high-level design)
• Experience migrating data and logic from traditionalSQL Server environments to Databricks, including rewriting stored procedures and workflows
• Deep understanding ofdata orchestration and automation, with proven ability to engineerreusable, parameter-driven ETL pipelines
• Solid experience withinfrastructure-as-code, deployment automation, and DevOps in data environments (e.g., Azure DevOps, Terraform, ARM templates)
• Excellent skills inT-SQL, performance tuning, and optimizing large-scale data solutions

Key Skills & Attributes

• Strong balance ofhands-on engineeringandstrategic architectural thinking
• Able to independently lead large technical initiatives while collaborating with cross-functional teams
• Excellent problem-solving, documentation, and communication skills
• Focused on reusability, scalability, and platform standardization
• Thrives in a fast-paced environment with a proactive, delivery-focused mindset