Design and execute comprehensive testing strategies specifically for AI and ML models, focusing on accuracy, robustness, and performance
Perform extensive testing to identify and mitigate biases or discriminatory outcomes in AI models, ensuring they adhere to ethical AI principles
Balance the use of manual and automated testing methods
Perform manual exploratory testing on complex, non-deterministic AI outputs (e.g., Large Language Models) while building and maintaining automated suites for consistent regression testing
Develop, maintain, and scale automated AI-based test cases using scripting languages such as Python or JavaScript
Integrate automated tests into CI/CD pipelines to enable continuous model evaluation and rapid delivery
Test data pipelines, feature engineering, and data quality to ensure models are trained on clean and reliable data
Create and execute test cases to challenge the AI model with edge cases and adversarial inputs to ensure safety and stability
Identify, document, and track software and AI model defects with detailed, reproducible steps
Work with development teams to prioritize and resolve issues
Work with DevOps, QA leadership to configure monitoring tools and define metrics for tracking post-deployment model health and detecting performance degradation or "model drift"
Stay up to date with emerging QA automation trends, AI testing methodologies, and tools
Requirements
Bachelor’s degree in computer science, Data Science, or related technical field
10 years+ experience in a hybrid QA role, with a strong background in both manual and automated testing
Direct, hands-on experience testing AI applications or ML models in a production environment (preferred)
Strong skills with automation frameworks and tools such as Playwright, Selenium, or similar (preferred)
Proficiency in typescript, as well as Python being highly preferred due to its prevalence in ML (preferred)
Solid understanding of software quality assurance methodologies, testing tools, and processes within an Agile development lifecycle (preferred)
Excellent analytical and problem-solving skills with a keen eye for detail
Strong written and verbal communication skills, with the ability to articulate complex issues to both technical and non-technical stakeholders
Manage QA departments ensuring quality in food production at McCormick. Lead regulatory compliance and team development while driving quality standards.
Quality Assurance Supervisor at Chobani overseeing QA teams and ensuring compliance with food safety regulations. Leading plant quality initiatives and maintaining high standards of food safety.
Internship role focusing on developing QA solutions in a tech - driven agriculture company. Engaging with embedded systems and enhancing agricultural precision technology.
Mystery Consultant performing evaluations for customer service in Switzerland. Engaging in market studies and customer experiences across various sectors on a flexible part - time basis.
Quality Assurance Design Development Specialist ensuring product compliance in development projects. Working with project teams to uphold quality standards and manage documentation in accordance with regulations.
Quality Assurance Technician conducting internal audits and maintaining quality standards at Lincoln Electric. Supporting various quality assurance functions and promoting continuous improvement.
Quality Assurance Manager overseeing quality, safety, and sanitation at Barcelona Wine Bar and Corsica Wine Bar. Conducting audits, training staff, and collaborating with management to uphold standards.
Senior Engineer in Software Quality Engineering focusing on automation in functional and non - functional testing using latest coding techniques. Collaborating within an agile team to enhance project efficiency.
Manual Tester at Uni Systems defining test plans, executing tests, and collaborating with teams in Brussels. Responsible for end - to - end testing and bug investigation.