Global IT Domain Architect Expert Director – Gen AI/ LLM Full-time

WHAT YOU’LL DO

We are seeking a highly skilled and experienced Gen AI /LLM Domain Architect Expert Director to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform architectures and cloud native platforms, cloud infrastructure, and AI SDLC/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems. This role, in close collaboration with our cloud & platform engineering teams and platform users/ use-case teams, will delve into their unique challenges, designing/ enabling cutting-edge Gen AI platform capabilities and developing strategic, reusable, secure, scalable platform capabilities that elevate their use of Generative AI.

In this critical role, you will leverage your expertise to design and implement advanced Generative AI capabilities, ensuring they align with enterprise security and compliance standards. You will collaborate closely with the platform team, our engineering teams, enabling them to achieve the outcomes. Additionally, you will document solution architectures thoroughly and review them with Platform teams, Enterprise Architects, Security, and other stakeholders to ensure alignment with enterprise architecture principles and security standards.

This position offers an exciting opportunity to be at the forefront of Gen AI innovation, working within a dynamic and collaborative environment. If you have a passion for cutting-edge technology and a drive to make a significant impact, we invite you to apply for this role.

WHO WE ARE

BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world’s best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next. We count on your authenticity, exceptional work, and strong integrity. In return we are committed to supporting you in discovering the most fulfilling career journey possible-and unlocking your potential to advance the world. Our team called Global Services (GS) provides corporate support to business areas such as Finance, Legal, HR, Marketing and IT. This diverse team of experts, operators and specialists represent all levels from Partner to entry level staff, operating across the globe in multiple countries. Global Services is in short, the backbone of BCG.

YOU BRING (EXPERIENCE & QUALIFICATIONS)

• Master’s or bachelor’s degree in engineering (or equivalent). Preferably with a focus on artificial intelligence, machine learning, or data science

• Proven Experience in architecting Gen AI, Artificial Intelligence, Machine Learning, or Natural Language Processing based systems for scale and robustness.

• 2+ years’ experience in experimenting, architecting and developing with LLM.

• 1 to 2 years of experience with LLMs and related services for production use case.

• 10+ years design and implementation experience of building enterprise grade platform services with distributed architecture and security/compliance adherence.

Experience & Skills (Mandatory)

• Strong knowledge and experience in Generative AI/ LLM based development.

• Strong experience working with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex)

• Strong experience with cloud infrastructure for AI/Generative AI/ML

• Experience with multi-agent architecture & frameworks and an understanding of multi-agent systems and their applications in complex, multi-step problem-solving scenarios.

• Expertise in building enterprise grade, secure data ingestion pipelines for unstructured data – including indexing, search, and advance retrieval patterns.

• Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.

• Proficiency in generating and working with text embeddings with understanding of embedding spaces and their applications in semantic search and information retrieval.

• Knowledge and Experience in building knowledge graphs in production.

• Experience with RAG concepts and fundamentals (VectorDBs, AWS OpenSearch, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with Generative AI models.

• Experience with security related to LLM integrations.

• Experience with implementing LLM guardrails at platform, agent and application level.

• Knowledge of training and fine-tuning Foundation Models, including multimodal inputs and outputs

• Proficiency in Python, TypeScript, NodeJS, ReactJS (and equivalent) and all associated GenAI libraries and frameworks.

• Experience with LLM monitoring and observability.

• Experience in LLM Testing and Evaluation.

EQUAL OPPORTUNITY

BCG is an Equal Employment Opportunity employer and is committed to a policy of administering all employment decisions and actions without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations.

YOU’RE GOOD AT

• Architecting and building scalable platform which are secure and compliant to enterprise requirements.

• Defining and documenting current, transition and target state architectures.

• Influencing and being a technical thought partner with EAs, Lead Architects, Chapter Leads, TALs.

• Are passionate to build things the right way while meeting business needs, intellectually curious, and enjoy learning new skills and capabilities.

• Committing to cross-functional collaboration to achieve the best results for the organization.

• Enjoying coaching and developing people to improve their performance, knowledge and expertise.

• Comfortable with both planning and execution.

• Bring a data-driven approach to decision making, both in day-to-day management and in making technical or architectural trade-offs.

YOU’LL WORK WITH

• Your Gen AI Platform team members, PO, and Chapter Lead. You will also work with other Domain Architects in Cloud and Platform Engineering Portfolio, by setting their direction, establishing objectives and key results, working on the staffing and development of your chapter, and ensuring that you maximize outputs and working products.

• Portfolio Lead Architect, Enterprise Architects, Technical Area Leads, Product Owners and Chapter Leads.

• Agile Coaches and Scrum Masters, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation.