Data Engineering Manager

Huron Consulting Group Inc.
Belfast
4 days ago
Create job alert
  • Lead and mentor junior data engineers—provide technical guidance, conduct code reviews, and support professional development. Foster a culture of continuous learning and high-quality engineering practices within the team.* Manage complex multi-workstream data engineering projects—oversee project planning, resource allocation, and delivery timelines. Ensure projects meet quality standards and client expectations while maintaining technical excellence.* Design and architect end-to-end data solutions—from source extraction and ingestion through transformation, quality validation, and delivery. Make key technical decisions and own the overall data architecture.* Lead development of modern data transformation layers using dbt—implementing modular SQL models, testing frameworks, documentation, and CI/CD practices that ensure data quality and maintainability at scale.* Architect lakehouse solutions using open table formats (Delta Lake, Apache Iceberg) on Microsoft Fabric, Snowflake, and Databricks—designing schemas, optimizing performance, and implementing governance frameworks.* Establish DataOps best practices—define and implement CI/CD pipelines for data assets, data quality monitoring, observability, lineage tracking, and automated testing standards to ensure data infrastructure remains reliable in production.* Serve as a trusted advisor to clients—build long-standing partnerships, understand business problems, translate data requirements into technical solutions, and communicate architecture decisions to both technical and executive audiences.* Contribute to business development—participate in business development activities, develop reusable assets and methodologies, and help shape the technical direction of Huron's data engineering capabilities.* 5+ years of hands-on experience building and deploying data pipelines in production—not just ad-hoc queries and exports. You've built ETL/ELT systems that run reliably, scale, and are maintained over time.* Experience leading and developing technical teams—including coaching, mentorship, code review, and performance management. Demonstrated ability to build high-performing teams and develop junior talent.* Strong SQL and Python programming skills with deep experience in PySpark for distributed data processing. SQL for analytics and data modeling; Python/PySpark for pipeline development and large-scale transformations.* Experience building data pipelines that serve AI/ML systems, including feature engineering workflows, vector embeddings for retrieval-augmented generation (RAG), and data quality frameworks that ensure model reproducibility. Familiarity with emerging agent integration standards such as MCP (Model Context Protocol) and A2A (Agent-to-Agent), and the ability to design data services and APIs that can be discovered and consumed by autonomous AI agents.* Experience with modern data transformation tools, dbt particularly. You understand modular SQL development, testing, documentation practices, and how to implement these at scale across teams.* Experience with cloud data platforms and lakehouse architectures—Snowflake, Databricks, Microsoft Fabric, and familiarity with open table formats (Delta Lake, Apache Iceberg). We're platform-flexible but Microsoft-preferred.* Proficiency with workflow orchestration tools such as Apache Airflow, Dagster, Prefect, or Microsoft Data Factory. You understand DAGs, scheduling, dependency management, and how to design reliable orchestration at scale.* Solid foundation in data modeling concepts: dimensional modeling, data vault, normalization/denormalization, and understanding of when different approaches are appropriate for different use cases.* Excellent communication and client management skills—ability to communicate technical concepts to non-technical stakeholders, lead client meetings, and build trusted relationships with executive audiences.* Bachelor's degree in Computer Science, Engineering, Mathematics, or related technical field (or equivalent practical experience).* Flexibility to work in a hybrid model with periodic travel to client sites as needed.* Experience in Financial Services, Manufacturing, or Energy & Utilities industries.* Background in building data infrastructure for ML/AI systems—feature stores (Feast, Databricks Feature Store), training data pipelines, vector databases for RAG/LLM workloads, or model serving architectures.* Experience with real-time and streaming data architectures using Kafka, Spark Streaming, Flink, or Azure Event Hubs, including CDC patterns for data synchronization.* Familiarity with MCP (Model Context Protocol), A2A (Agent-to-Agent), or similar standards for AI system data integration.* Experience with data quality and observability frameworks such as Great Expectations, Soda, Monte Carlo, or dbt tests at enterprise scale.* Knowledge of data governance, cataloging, and lineage tools (Unity Catalog, Purview, Alation, or similar).* Experience with high-performance Python data tools such as Polars or DuckDB for efficient data processing.* Cloud certifications (Snowflake SnowPro, Databricks Data Engineer, Azure Data Engineer, or AWS Data Analytics).* Consulting experience or demonstrated ability to work across multiple domains and adapt quickly to new problem spaces.* Contributions to open-source data engineering projects or active participation in the dbt/data community.* Master's degree or PhD in a technical field.At Huron, we’re redefining what a consulting organization can be. We go beyond advice to deliver results that last. We inherit our client’s challenges as if they were our own. We help them transform for the future. We advocate. We make a difference. And we intelligently, passionately, relentlessly do great work…together. Whether you have years of experience or come right out of college, we invite you to explore our many opportunities. Find out how you can use your talents and develop your skills to make an impact immediately. Learn about how our culture and values provide you with the kind of environment that invites new ideas and innovation. Come see how we collaborate with each other in a culture of learning, coaching, diversity and inclusion. And hear about our unwavering commitment to make a difference in partnership with our clients, shareholders, communities and colleagues. Huron Consulting Group offers a competitive compensation and benefits package including medical, dental, and vision coverage to employees and dependents; a 401(k) plan with a generous employer match; an employee stock purchase plan; a generous Paid Time Off policy; and paid parental leave and adoption assistance. Our Wellness Program supports employee total well-being by providing free annual health screenings and coaching, bank at work, and on-site workshops, as well as ongoing programs recognizing major events in the lives of our employees throughout the year. All benefits and programs are subject to applicable eligibility requirements. Huron is fully committed to providing equal employment opportunity to job applicants and employees in recruitment, hiring, employment, compensation, benefits, promotions, transfers, training, and all other terms and conditions of employment. Huron will not discriminate on the basis of age, race, color, gender, marital status, sexual orientation, gender identity, pregnancy, national origin, religion, veteran status, physical or mental disability, genetic information, creed, citizenship or any other status protected by laws or regulations in the locations where we do business. We endeavor to maintain a drug-free workplace.
    #J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineering Manager

Data Engineering Manager

Data Engineering Manager

Data Engineering Manager

Data Engineering Manager...

Data Engineer Manager

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Are you considering a career change into machine learning in your 30s, 40s or 50s? You’re not alone. In the UK, organisations across industries such as finance, healthcare, retail, government & technology are investing in machine learning to improve decisions, automate processes & unlock new insights. But with all the hype, it can be hard to tell which roles are real job opportunities and which are just buzzwords. This article gives you a practical, UK-focused reality check: which machine learning roles truly exist, what skills employers really hire for, how long retraining realistically takes, how to position your experience and whether age matters in your favour or not. Whether you come from analytics, engineering, operations, research, compliance or business strategy, there is a credible route into machine learning if you approach it strategically.

How to Write a Machine Learning Job Ad That Attracts the Right People

Machine learning now sits at the heart of many UK organisations, powering everything from recommendation engines and fraud detection to forecasting, automation and decision support. As adoption grows, so does demand for skilled machine learning professionals. Yet many employers struggle to attract the right candidates. Machine learning job adverts often generate high volumes of applications, but few applicants have the blend of modelling skill, engineering awareness and real-world experience the role actually requires. Meanwhile, strong machine learning engineers and scientists quietly avoid adverts that feel vague, inflated or confused. In most cases, the issue is not the talent market — it is the job advert itself. Machine learning professionals are analytical, technically rigorous and highly selective. A poorly written job ad signals unclear expectations and low ML maturity. A well-written one signals credibility, focus and a serious approach to applied machine learning. This guide explains how to write a machine learning job ad that attracts the right people, improves applicant quality and strengthens your employer brand.

Maths for Machine Learning Jobs: The Only Topics You Actually Need (& How to Learn Them)

Machine learning job adverts in the UK love vague phrases like “strong maths” or “solid fundamentals”. That can make the whole field feel gatekept especially if you are a career changer or a student who has not touched maths since A level. Here is the practical truth. For most roles on MachineLearningJobs.co.uk such as Machine Learning Engineer, Applied Scientist, Data Scientist, NLP Engineer, Computer Vision Engineer or MLOps Engineer with modelling responsibilities the maths you actually use is concentrated in four areas: Linear algebra essentials (vectors, matrices, projections, PCA intuition) Probability & statistics (uncertainty, metrics, sampling, base rates) Calculus essentials (derivatives, chain rule, gradients, backprop intuition) Basic optimisation (loss functions, gradient descent, regularisation, tuning) If you can do those four things well you can build models, debug training, evaluate properly, explain trade-offs & sound credible in interviews. This guide gives you a clear scope plus a six-week learning plan, portfolio projects & resources so you can learn with momentum rather than drowning in theory.