AI Content Expert, AGI Data Services Full-time

AI is the most transformational technology of our time, capable of tackling some of humanity’s most challenging problems. That is why Amazon is investing in generative AI and the responsible development and deployment of large language models (LLMs) across all of our businesses.

We are looking for highly motivated and talented candidates who will generate multi- turn data demonstrations to be used in Supervised Fine Tuning (SFT) of LLMs. The ideal candidate must demonstrate strong analytical and communication skills, attention to details, creative thinking and a commitment to excellence and responsible AI.

Key job responsibilities

As an AI Content Expert, you will be responsible for generating multi turn demonstrations to train LLMs. The tasks will be complex in nature and will require you to make informed and high judgement decisions in each case. You will be working closely with scientists and teams across the company to review provided guidelines, suggest updates to those guidelines, and engage in ongoing conversations regarding the quality of data, while adhering to Amazon’s responsible AI guidelines and fostering trust. You will also be a part of other initiatives across process improvements, SOP and guidelines formulation, diving deep to provide data insights as and when required.

Your key responsibilities will include (but not limited to) the below:
• tWork on complex processes and provide high quality data generations to customers.
• tOperate with autonomy and maintain strict confidentiality as customer privacy is our biggest tenet
• tLeverage and demonstrate expertise in a wide array of areas, such as (but not limited to) Computer Science, Literature, Music, Mathematics, Economics and Travel
• tPerform audits and quality checks of tasks completed by other specialists, if required
• tIdentify issues and proactively reports operational challenges
• tAnalyze root causes, identify error patterns, and propose solutions to enhance the quality of labeling tasks and their outputs.
• tCreate, update and follow SOP/flow of processes
• tIdentify process improvement opportunities (enhancements and pain points) at process/ function level
• tDemonstrate the ability to handle small to medium scale process improvement projects
• tCommunicate to cross-company stakeholders on an ongoing basis to review a constantly evolving set of guidelines data and resolves emergent issues with minimal guidance
• tContribute in mentoring / training junior data associates on an ongoing basis
• tTroubleshoot issues related to process and conduct root cause analysis if required
• tServe as a subject matter expert for Machine Learning (ML) data workflows, demonstrating proficiency in researching, generating factually and grammatically accurate responses, ranking responses, creating grammatically correct text, and annotating images and videos.
• tCapable of making sound judgments and logical decisions when faced with ambiguous or incomplete information while performing tasks.

A day in the life

We are looking for a talented and enthusiastic content writer to join our team and play a crucial role in unlocking the potential of our AI models through the creation of trustworthy, high-quality training data, while fostering trust in AI systems. You will critically evaluate machine and human-generated demonstrations to produce high-quality preference data for training AI models. Exceptional multitasking abilities, sound judgment, and meticulous attention to detail are essential to deliver impeccable work quality. You must maintain strict confidentiality and rigorously adhere to all applicable Amazon policies for securing confidential information. You will be a part of a diverse team with the shared vision of improving customers’ lives with practical, useful generative AI innovations. An inner drive, individuality, and a creative mind are extremely beneficial.

About the team

You’ll work with a team that provides data creation, curation, and analytics services to help develop, test, and train AI models. We work closely with Machine Learning (ML) Science and Modelling teams, providing the critical data they need to improve the company’s speech recognition and language understanding capabilities.

BASIC QUALIFICATIONS
• tBachelor’s Degree in a relevant field, such as Business Administration, Liberal Arts, Sciences, Computer Science, Engineering, Social Sciences, Visual and Performing Arts, or Communication.
• t3+ years of experience in the relevant field.
• tStrong language proficiency across verbal, written, reading, and comprehension skills. Should display proficiency at a C2 level in the Common European Framework CEFR scale.
• tStrong understanding of U.S.-based culture, society, and norms.
• tStrong interpersonal, analytical and communication skills.
• tDemonstrated passion for delivering a positive customer experience, and maintain composure in ambiguous and difficult situations.
• tExceptional research skills to gather relevant information and understand complex topics.
• tAbility to adapt writing style to suit various style guidelines and customers.
• tAbility to effectively write and evaluate diverse subject matter across various domains
• tProven capacity to leverage open-source resources effectively for comprehensive research purposes
• tAbility to adapt well to fast-paced environments with changing circumstances, direction, and strategy
• tA sense of ownership and drive and a willingness to accept the challenge of daily deadlines is essential
• tThis will be an onsite role and candidate should be flexible in work timing (including night shifts) and be ready to meet delivery targets

PREFERRED QUALIFICATIONS
• tWorking Knowledge of SQL, Python, and/or Machine Learning.
• tFamiliarity with Large Language Models.
• tExperience in detailed content classification and data generation.
• tExperience working in ambiguous roles.