Technical Writer & QA Specialist elevating deliverables’ clarity and client - readiness at Aldrich Solutions. Combining editorial skills with structured quality assurance in a consulting environment.
About the role
- Quality Engineer focusing on AI and ML healthcare solutions at Vizient. Responsible for validating data quality, model performance, and safe deployments across various collaborative teams.
Responsibilities
- Validate AI and ML-powered healthcare solutions across the full development lifecycle to ensure data quality, model performance, reliability, and safe deployment in production environments
- Design and execute data-driven and automated test strategies, including model evaluation, prompt regression testing, dataset profiling, and end-to-end pipeline validation
- Partner with data science, engineering, product, and security teams to define measurable quality gates and deliver compliant, explainable, and dependable AI experiences that drive client value
- Develop and execute test strategies for ML and generative AI-powered applications
- Design and maintain evaluation frameworks for Large Language Models (LLM), including automated scoring and LLM -as-a-judge methodologies
- Develop prompt regression test suites to detect performance degradation across model and prompt versions
- Evaluate generative AI systems for hallucination risk, factual consistency, grounding accuracy, and safety compliance
- Conduct model evaluation, regression testing, and drift monitoring in development and production environments
- Build dashboards and monitoring tools to detect degraded evaluation scores, drift, or safety risks and support proactive triage
- Design and implement proactive AI-driven alerting and recommendation systems embedded within dashboards and user workflows
- Automate dashboard metric generation and refresh pipelines using Python and data workflows
- Partner with cross-functional teams to define AI quality standards, acceptance criteria, and release gates
- Investigate defects, analyze root causes, and recommend corrective actions to improve reliability and performance
Requirements
- Relevant degree preferred
- 2 or more years of relevant experience required
- Experience validating ML or generative AI-based applications, including model evaluation and data quality assessment required
- Proficiency in Python, SQL, and test automation frameworks
- Experience evaluating LLM systems, including prompt regression testing and automated or human-in-the-loop judging methodologies
- Familiarity with RAG evaluation concepts, including retrieval quality, context relevance, faithfulness, and safety testing
- Experience designing AI evaluation metrics, including ranking, calibration, and reliability measures
- Experience building model monitoring dashboards and production health reporting
- Understanding of Agile methodologies and CI/CD practices
- Strong analytical, documentation, and communication skills
- Self-starter who thrives in fast-paced, iterative environment and drives quality initiatives end-to-end amid ambiguity and shifting priorities.
Benefits
- Comprehensive benefits plan
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
BSA/FCC Quality Assurance Manager leading the QA program in compliance team at Customers Bank. Managing QA specialists and performing compliance reviews to ensure quality standards.
Senior Quality Engineer leading development activities and quality improvements in a fast - paced manufacturing setting. Requires strong engineering background and extensive experience with quality standards.
Internal Quality Assurance Lead ensuring integrity and quality of assessment in IOSH Academy programmes. Providing academic guidance to tutors and overseeing quality assurance.
Junior/Middle QA Engineer at IntellectEU focusing on test automation, collaborating with developers for quality assurance in digital finance projects. Contributing to a growing team with international experience.
Quality Assurance employee ensuring high quality standards in the production of labels for pharmaceutical products and food. Collaborating with teams to improve product quality and meet customer requirements.
QA Professional managing quality assurance and audits in pharmaceutical logistics. Responsible for documentation and compliance with regulatory standards in a decentral location.
Senior Quality Assurance Manager in a growing non - profit pharmaceutical company. Responsible for quality management processes and compliance in Berlin.
As a Senior Engineer - QA, leading engineering approach for delivering complex technology products. Focused on building and adhering to QA best practices in financial services context.
Specialist Quality Assurance role in the pharmaceutical industry ensuring global supply chain compliance. Responsibilities include evaluation of clinical supply materials and continuous quality improvements.