Staff Machine Learning Researcher – Generative AI Full-time

WHAT YOU DO AT AMD CHANGES EVERYTHING

We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world’s most important challenges. We strive for execution excellence while being direct, humble, collaborative, and inclusive of diverse perspectives.

AMD together we advance_

THE ROLE:

The AI Models and Applications team is looking for an exceptional machine learning machine learning expert, with both academic and industrial research experience, to explore and innovate on architectures and training techniques for large language models (LLMs), large multimodal models (LMMs), image/video generation and other foundation models. You will be part of a world-class research and development team focussing on efficient and scalable pre-training, instruction tuning, alignment and optimization. As an early member of the team, you can help us shape the direction and strategy to fulfill this important charter.

THE PERSON:

This role is for you if you are passionate about reading through the latest literature, coming up with novel ideas, and leading the implementation of those through high quality code to push the boundaries on scale and performance. The ideal candidate will have both theoretical expertise and hands-on experience with developing LLMs, LMMs, and/or diffusion models. We are looking for someone who is familiar with hyper-parameter tuning methods, data preprocessing & encoding techniques and distributed training approaches for large models.

KEY RESPONSIBILITIES:

• Pre-train and finetune over large GPU clusters while optimizing for various trade-offs.
• Improve upon the state-of-the-art in Generative AI model architectures and training techniques.
• Accelerate the training and inference speed across AMD accelerators.
• Publish your work at top-tier conferences and workshops and/or through technical blogs.
• Proactively engage with academia and open-source ML communities.
• Drive continuous improvement of infrastructure and development ecosystem.
• Influence the direction of AMD AI platform.
• Formulate technical roadmaps and lead projects from conception to deployment as well as continued maintenance.
• Stay up-to-date on ongoing AI development activities across the company, help work through technical challenges, and be involved in design decisions

PREFERRED EXPERIENCE:

• Strong development and debugging skills in Python.
• Experience in deep learning frameworks (like PyTorch or TensorFlow) and distributed training tools (like DeepSpeed or Pytorch Distributed).
• Experience with fine-tuning methods (like RLHF & DPO) as well as parameter efficient techniques (like LoRA & DoRA).
• Solid understanding of various types of transformers and state space models.
• Strong publication record in top-tier conferences, workshops or journals.
• Strong communication and problem-solving skills.
• Experience in diligently dealing with and getting insights from large training datasets
• Strong communication, problem-solving and technical leadership skills.
• 5+ years of experience (beyond Master’s or PhD) in developing and deploying deep learning models at scale.
• Prior impactful contributions to open ML research or developer community.

ACADEMIC CREDENTIALS:

• Advanced degree (Master’s/PhD) in machine learning, computer science, artificial intelligence, or a related field and 5+ years of experience beyond that is expected.

#LI-LV1

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.