Quality Assurance Manager overseeing quality assurance and control functions in food safety and compliance. Collaborating with leadership to implement strategic quality plans.
About the role
- Senior QA Engineer at Revvity, validating AI and ML models with a focus on accuracy, robustness, and performance. Engaging in comprehensive testing strategies and hybrid execution methods.
Responsibilities
- Design and execute comprehensive testing strategies specifically for AI and ML models, focusing on accuracy, robustness, and performance
- Perform extensive testing to identify and mitigate biases or discriminatory outcomes in AI models, ensuring they adhere to ethical AI principles
- Balance the use of manual and automated testing methods
- Perform manual exploratory testing on complex, non-deterministic AI outputs (e.g., Large Language Models) while building and maintaining automated suites for consistent regression testing
- Develop, maintain, and scale automated AI-based test cases using scripting languages such as Python or JavaScript
- Integrate automated tests into CI/CD pipelines to enable continuous model evaluation and rapid delivery
- Test data pipelines, feature engineering, and data quality to ensure models are trained on clean and reliable data
- Create and execute test cases to challenge the AI model with edge cases and adversarial inputs to ensure safety and stability
- Identify, document, and track software and AI model defects with detailed, reproducible steps
- Work with development teams to prioritize and resolve issues
- Work with DevOps, QA leadership to configure monitoring tools and define metrics for tracking post-deployment model health and detecting performance degradation or "model drift"
- Stay up to date with emerging QA automation trends, AI testing methodologies, and tools
Requirements
- Bachelor’s degree in computer science, Data Science, or related technical field
- 10 years+ experience in a hybrid QA role, with a strong background in both manual and automated testing
- Direct, hands-on experience testing AI applications or ML models in a production environment (preferred)
- Strong skills with automation frameworks and tools such as Playwright, Selenium, or similar (preferred)
- Proficiency in typescript, as well as Python being highly preferred due to its prevalence in ML (preferred)
- Solid understanding of software quality assurance methodologies, testing tools, and processes within an Agile development lifecycle (preferred)
- Excellent analytical and problem-solving skills with a keen eye for detail
- Strong written and verbal communication skills, with the ability to articulate complex issues to both technical and non-technical stakeholders
Benefits
- Medical, Dental, and Vision Insurance Options
- Life and Disability Insurance
- Paid Time-Off
- Parental Benefits
- Compassionate Care Leave
- 401k with Company Match
- Employee Stock Purchase Plan
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Manager of Customer Service Quality Assurance at Nuvei responsible for leading a data - driven QA program. Focused on customer experience and operational excellence with strategic insight and collaboration.
Tester mobilních aplikací specializující se na interní vývoj a testování pro zákaznické aplikace E.ONu. Pracujte v týmu v Českých Budějovicích, Praze nebo Brně.
Customer Care Quality Assurance Officer evaluating customer interactions and improving quality standards at Allianz. Collaborating with teams to enhance customer service through data - driven insights.
Associate Director Clinical QA Compliance ensuring quality and integrity of clinical development activities at BioNTech. Leading the proactive, risk - based Quality Strategy implementation across clinical trials.
QA Manager role at Perrigo ensuring product quality through oversight of manufacturing and packaging. Focusing on cross - functional continuous improvement and regulatory compliance in the pharma sector.
Officer, QA (Oncology) at Hikma Pharmaceuticals conducting analytical research and ensuring product compliance. Collaborating in a culture of progress in the pharmaceutical industry in Algiers.
Quality Engineer at Hikma Pharmaceuticals creating control groups and qualifying inspectors. Leading QA initiatives and auditing processes to ensure compliance and continuous improvement.
Supplier Quality Engineer ensuring quality across supply chains for SKF's Condition Monitoring products. Collaborating globally and supporting stakeholders to meet quality standards.
Ingénieur QA R&D travaillant sur l'amélioration continue de la qualité logiciel. Collaborer avec les équipes de développement agile et participer à la conception et automatisation des tests.