Senior Machine Learning Test Engineer

Job Requisition ID # 26WD98377 Senior Machine Learning Test Engineer Location: United States East Coast Position Overview As a Senior Machine Learning Test Engineer in the Research Enablement team, you will work side-by-side with researchers, Machine Learning developers and developers, and software developers and developers to define and uphold quality standards for ML systems. You are a quality-focused developer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software. Reporting Structure: You will report to an Engineering Manager in Research Enablement. Location: United States, East Coast Time Zone. We are a global team, located in London, San Francisco, Toronto, and remotely. Autodesk is a hybrid-first company, allowing workers to work remotly, in an office, or a mix of both. Responsibilities Define ML quality strategy and acceptance criteria across data, model, and system levels Design and maintain model evaluation suites, metrics, and test datasets Evaluating CAD RL model outputs for geometric validity or policy stability Defining structured rubrics that translate qualitative findings into measurable evaluation gates Testing ML Models from product side API Testing Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins) Create and maintain test harnesses for ML services and APIs Mentor teams on ML QA best practices and consistent evaluation standards Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection) Contribute to multi-team projects and codebases, ensuring code quality and consistency Participate in code reviews and provide constructive f