Global IT Platform Engineer Expert Senior Manager – Gen AI/ LLM Ops Full-time

WHAT YOU’LL DO

We are seeking a highly skilled and experienced Platform Engineer Senior Manager with Gen AI /LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform engineering, cloud infrastructure, LLM Observability and DevOps/MLOps/LLMOps, with a passion for creating scalable, reliable, and efficient systems.

WHO WE ARE

BCG pioneered strategy consulting more than 50 years ago, and we continue to innovate and redefine the industry. We offer multiple career paths for the world’s best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next. We count on your authenticity, exceptional work, and strong integrity. In return we are committed to supporting you in discovering the most fulfilling career journey possible-and unlocking your potential to advance the world. Our team called Global Services (GS) provides corporate support to business areas such as Finance, Legal, HR, Marketing and IT. This diverse team of experts, operators and specialists represent all levels from Partner to entry level staff, operating across the globe in multiple countries. Global Services is in short, the backbone of BCG.

YOU BRING (EXPERIENCE & QUALIFICATIONS)

• Bachelor’s degree in computer science engineering (or equivalent degree or experience)
• Proven building and supporting scalable, reliable Gen AI or LLM powered applications in production.
• Proven experience in building & enabling self-serve observability tools, dashboards for engineering teams.
• 12+ years of relevant experience in delivering and maintaining platform or complex technology solutions with strong technical background, preferably in global organization/ enterprise.
• 1+ years of experience in develop, deploy, test, and maintain production-grade access to LLMs and related services.
• Strong expertise in Modern Engineering, DevOps / GitOps, Infra as a Code practices – Strong understanding of CI/CD, AI/ ML pipelines and automation tools.

Experience & Skills (Mandatory)

• Strong knowledge and experience in Generative AI/ LLM based development.
• Strong experience in building and integrating LLM observability tools
• Strong experience in optimizing LLM performance, usage and cost
• Strong experience in building CI/CD pipeline templates for AI SDLC (ML Ops, RAG pipelines, Data Ingestion pipelines)
• Proficiency in cloud platforms (AWS, Azure, GCP) and infrastructure as code (Terraform, Terraform Cloud, Github Actions, ArgoCD and equivalent).
• Experience with containerization and orchestration technologies (Kubernetes, Docker).
• Strong experience working with and enabling key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex).
• Expertise in building enterprise grade, secure data ingestion pipelines for structured/ unstructured data – including indexing, search, and advance retrieval patterns.
• Proficiency in Python, Go, Terraform (and equivalent)
• Experience in LLM Testing and Evaluation is preferred
• Experience with security related to LLM integration is preferred

EQUAL OPPORTUNITY

BCG is an Equal Employment Opportunity employer and is committed to a policy of administering all employment decisions and actions without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations.

YOU’RE GOOD AT

• Being a great hands-on engineer passionate of building platform capabilities.
• Performing successfully in a fast-paced, multi-cultural and service-oriented environment
• Verbal and written communication at a business and technical level
• High level of initiative, self-motivation, resourcefulness, and collaboration
• Are passionate, intellectually curious, and enjoy learning new skills and capabilities.
• Building relationships and reliable team player, displaying consideration and respect for others
• Interpreting rules and guidelines flexibly to enhance the business and aligning with BCG’s values and culture
• Exhibiting ownership and accountability for the squad deliverables
• Servicing customer teams / platform users with a strong customer centricity
• Attention to detail, well organized, able to set priorities and take decisions
• Being flexible to be available outside of normal business hours for international calls as needed

YOU’LL WORK WITH

• Your Gen AI Platform Engineering chapter in Cloud and Platform Engineering Portfolio
• Product Owners, Chapter Leads and other squad members.
• Agile Coaches and Scrum Leads, that will ensure that you adopt agile principles, mindset and ways of working into your daily routine and who will coach you during the transformation.