Senior Decision Scientist advancing next - generation business intelligence through AI frameworks and analytics strategies at CVS Health. Collaborating across teams to deliver impactful data - driven solutions for the retail sector.
About the role
- QE Lead managing quality strategy for AI & Analytics in engineering. Leading quality assurance across AI systems and collaborating with cross-functional teams.
Responsibilities
- Own and define the QA strategy for AI and Analytics solutions, including ML models, RAG pipelines, and data-driven systems.
- Design and execute testing approaches for AI systems, covering functional, non-functional, bias, robustness, and reliability aspects.
- Establish observability, evaluation, and monitoring practices for AI quality in pre-production and production environments.
- Lead and contribute to test automation frameworks for AI, APIs, data pipelines, and analytics workflows.
- Collaborate with cross-functional teams to embed quality early in the AI development lifecycle.
Requirements
- Proven experience in quality engineering with exposure to AI/ML-based applications and analytics platforms.
- Hands-on experience testing AI systems such as RAG, LLM-based applications, or predictive models.
- Strong understanding of manual and automated testing approaches for APIs, data pipelines, and distributed systems.
- Experience with AI evaluation techniques, metrics, and validation strategies (accuracy, relevance, drift, hallucination, etc.).
- Ability to define QA standards, mentor engineers, and influence quality practices across teams.
Benefits
- RIB may require all successful applicants to undergo and pass a comprehensive background check before they start employment.
- Background checks will be conducted in accordance with local laws and may, subject to those laws, include proof of educational attainment, employment history verification, proof of work authorization, criminal records, identity verification, credit check. Certain positions dealing with sensitive and/or third party personal data may involve additional background check criteria.
- RIB is an Equal Opportunity Employer. We are committed to being an exemplary employer with an inclusive culture, developing a workplace environment where all our employees are treated with dignity and respect. We value diversity and the expertise that people from different backgrounds bring to our business.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Portfolio AI Analytics and Execution Consultant at CNA utilizing AI tools and analytics for creating underwriting strategies. Collaborate across teams to implement innovative solutions for portfolio management.
AI Engineering Lead at Finastra leading AI engineers and developing GenAI solutions. Hands - on role requiring strong technical expertise in AI/ML and software development.
Support transversal teams in compliance with global privacy, AI, and technology regulations at Amadeus. Collaborate on training programs and legal interpretations for stakeholders.
AI Success Engineer at OpenAI supporting enterprise adoption and integration of AI technologies for key customers. Leading technical relationships and guiding deployment for enterprise clients.
Werkstudent in Media Research & AI, contributing to AI product development and data solutions for innovative media strategies. Collaborate with diverse teams to enhance technological excellence.
Student trainee in Media Research & AI at Mediaplus focusing on target group research. Engaging in innovative data solutions and collaboration with a talented team.
PP
Werkstudent*in supporting bioinformatics and proteomics within an international team at PTB. Focused on developing workflows for mass spectrometry applications in biological research.
Head of Growth Social & AI leading the commercial launch of a new AI - powered social media offering. Focusing on client acquisition and market positioning in Europe.
Cloud Developer (Azure AI Foundry) working on AI integration and cloud solutions. Responsible for MLOps practices and collaborating with data teams for performance monitoring.