Jobs

Global IT Domain Architect Expert Director – Gen AI/ LLM


Job details
  • Boston Consulting Group
  • London
  • 2 days ago

WHAT YOU'LL DO

We are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform architectures and cloud native platforms, cloud infrastructure, and AI SDLC/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems. This role, in close collaboration with our cloud & platform engineering teams and platform users/ use-case teams, will delve into their unique challenges, designing/ enabling cutting-edge Gen AI platform capabilities and developing strategic, reusable, secure, scalable platform capabilities that elevate their use of Generative AI.

In this critical role, you will leverage your expertise to design and implement advanced Generative AI capabilities, ensuring they align with enterprise security and compliance standards. You will collaborate closely with the platform team, our engineering teams, enabling them to achieve the outcomes. Additionally, you will document solution architectures thoroughly and review them with Platform teams, Enterprise Architects, Security, and other stakeholders to ensure alignment with enterprise architecture principles and security standards.

This position offers an exciting opportunity to be at the forefront of Gen AI innovation, working within a dynamic and collaborative environment. If you have a passion for cutting-edge technology and a drive to make a significant impact, we invite you to apply for this role.


YOU'RE GOOD AT

  • Architecting and building scalable platform which are secure and compliant to enterprise requirements.

  • Defining and documenting current, transition and target state architectures.

  • Influencing and being a technical thought partner with EAs, Lead Architects, Chapter Leads, TALs.

  • Are passionate to build things the right way while meeting business needs, intellectually curious, and enjoy learning new skills and capabilities.

  • Committing to cross-functional collaboration to achieve the best results for the organization.

  • Enjoying coaching and developing people to improve their performance, knowledge and expertise.

  • Comfortable with both planning and execution.

  • Bring a data-driven approach to decision making, both in day-to-day management and in making technical or architectural trade-offs.


YOU BRING (EXPERIENCE & QUALIFICATIONS)

  • Master’s or bachelor’s degree in engineering (or equivalent). Preferably with a focus on artificial intelligence, machine learning, or data science 

  • Proven Experience in architecting Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing based systems for scale and robustness.

  • 2+ years’ experience in experimenting, architecting and developing with LLM.

  • 1 to 2 years of experience with LLMs and related services for production use case.

  • 10+ years design and implementation experience of building enterprise grade platform services with distributed architecture and security/compliance adherence.  

Experience & Skills (Mandatory) 

  • Strong knowledge and experience in Generative AI/ LLM based development.

  • Strong experience working with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex) 

  • Strong experience with cloud infrastructure for AI/Generative AI/ML 

  • Experience with multi-agent architecture & frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios. 

  • Expertise in building enterprise grade, secure data ingestion pipelines for unstructured data – including indexing, search, and advance retrieval patterns. 

  • Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets. 

  • Proficiency in generating and working with text embeddings with understanding of embedding spaces and their applications in semantic search and information retrieval. 

  • Knowledge and Experience in building knowledge graphs in production.

  • Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with Generative AI models. 

  • Experience with security related to LLM integrations.

  • Experience with implementing LLM guardrails at platform, agent and application level.

  • Knowledge of training and fine-tuning Foundation Models, including multimodal inputs and outputs 

  • Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks. 

  • Experience with LLM monitoring and observability. 

  • Experience in LLM Testing and Evaluation.


YOU'LL WORK WITH

  • Your Gen AI Platform team members, PO, and Chapter Lead. You will also work with other Domain Architects in Cloud and Platform Engineering Portfolio, by setting their direction, establishing objectives and key results, working on the staffing and development of your chapter, and ensuring that you maximize outputs and working products.

  • Portfolio Lead Architect, Enterprise Architects, Technical Area Leads, Product Owners and Chapter Leads.

  • Agile Coaches and Scrum Masters, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation.


Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Global IT Domain Architect Expert Director – Gen AI/ LLM

WHAT YOU'LL DOWe are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a...

Boston Consulting Group London