Principal Machine Learning, Evaluation. Remote or Hybrid Full-time

Job Requisition ID #

25WD85713

Position Overview

The work we do at Autodesk touches nearly every person on the planet. By creating software tools for making buildings, machines, and even the latest movies, we influence and empower some of the most creative people in the world. As a Principal Machine Learning Deveoper/Engineer with a focus on model evaluation, you will play a critical role in ensuring the quality and performance of ML models across our portfolio of products. This position will help shape the customer experience by ensuring that ML-powered features meet high standards for accuracy, reliability, and user satisfaction.

In this role, you will identify and document quality and performance issues in ML models, establish robust evaluation criteria, and develop systems to continuously improve ML models in production. You will report to a research manager in the Autodesk AI Lab team within Autodesk Research. We are a global team, located in London, San Francisco, Toronto, and remotely. For this role we support both in-person, hybrid, and remote work.

Responsibilities

• Identify, document, and communicate quality and performance issues with ML models
• Design and implement evaluation methodologies, datasets, and metrics to asess the quality, performance, and reliability of ML models
• Test the end-to-end user experience of ML powered features in Autodesk products to ensure alignment with customer needs and product requirements
• Collaborate with AI researchers, engineers, and product teams to understand business requirements and improve ML model performance and customer experience
• Process and analyze data from various sources to evaluate ML model behavior and customer outcomes
• Stay up-to-date on the latest AI/ML evaluation techniques and best practices, applying them to Autodesk products
• Present results and insights to collaborators, leadership, and stakeholders

Minimum Qualifications

• BSc or MSc in Computer Science, Mechanical Engineering, or equivalent industry experience
• 3+ years of professional experience related to ML model development/evaluation and CAD software
• Experience designing and implementing model evaluation methodologies and metrics
• Experience evaluating ML model performance under real-world conditions
• Experience using CAD software such as Fusion 360 and AutoCAD
• Strong written documentation skills to document evaluation criteria, results, and improvement recommendations

Preferred Qualifications

• Knowledge of data representations, including 2D and 3D geometry
• Experience with version control, reproducibility, and writing reusable, testable code
• Experience with cloud services and architectures (e.g. AWS, Azure)
• Knowledge of the design, manufacturing

#LI-Remote

At Autodesk, we’re building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers.