Senior Machine Learning Quality Assurance and Test Automation Engineer Full-time

Your work days are brighter here.

At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our people first. And ever since, the happiness, development, and contribution of every Workmate is central to who we are. Our Workmates believe a healthy employee-centric, collaborative culture is the essential mix of ingredients for success in business. That’s why we look after our people, communities and the planet while still being profitable. Feel encouraged to shine, however that manifests: you don’t need to hide who you are. You can feel the energy and the passion, it’s what makes us unique. Inspired to make a brighter work day for all and transform with us to the next stage of our growth journey? Bring your brightest version of you and have a brighter work day here.

About the Team
This is a great opportunity in the Machine Learning & Data organization. We believe if you do what you love, you’ll love what you do. There’s a lot to love at Workday. Part of a global, high-growth technology company, our Workday team has the opportunity of developing the next generation of Workday’s groundbreaking collaborative products supporting a customer base of 60 million users.

Thrive in our fun, people-first culture that builds an environment focused on your success and ability to do your best work. Join us as we change and optimize the way people work! Are you incredibly motivated by AI and QA, and how to bring it closer together?

Machine Learning & Data organization is bringing “AI first” products to life at every step of the Workday Peakon Employee Voice product offering. We’re looking for a highly creative and deeply skilled Machine Learning QA Engineer to work with us on a range of these challenges.

About the Role

• Lead the implementation of a holistic test strategy for data and model evaluation as well as the fundamental ML pipeline testing and monitoring
• Implement best practices into the AI/ML development cycle so that it is highly stable, discovers issues and requires low maintenance.
• Supporting ML Engineers in Model Evaluation (e.g. Error Analysis), Data Quality Validation, Data Annotation and Model Monitoring to ensure a high quality of AI driven products.
• Working closely with ML Engineers, MLOPs Engineers and other QA engineers to ensure a common understanding and implementation of best practices.
• Contribute to the growth and continuous improvement of quality and testing processes within the organization.

About You

Basic Qualifications :

• Strong Experience in Quality Assurance and Test Automation with strong focus on AI/ML
• Understanding of QA methodologies, tools, and processes
• Strong experience at least in statistical analysis or machine learning algorithms, natural language processing, LLMs
• Experience in AI/ML System Design and Life cycle of ML Models

Other Qualifications:

• Hands on experience with test automation and tools such as Pytest, Giskard, Garak
• Proficiency in SQL and Python
• Experience in Red Teaming of LLM and ML Models

• Experience in AI/ML Model performance validation, data quality/validation testing, model monitoring and data pipeline

Our Approach to Flexible Work

With Flex Work, we’re combining the best of both worlds: in-person time and remote. Our approach enables our teams to deepen connections, maintain a strong community, and do their best work. We know that flexibility can take shape in many ways, so rather than a number of required days in-office each week, we simply spend at least half (50%) of our time each quarter in the office or in the field with our customers, prospects, and partners (depending on role). This means you’ll have the freedom to create a flexible schedule that caters to your business, team, and personal needs, while being intentional to make the most of time spent together. Those in our remote “home office” roles also have the opportunity to come together in our offices for important moments that matter.

Are you being referred to one of our roles? If so, ask your connection at Workday about our Employee Referral process!