AI Quality Assurance Lead ensuring AI compliance and accuracy at Chip. Overseeing quality assurance processes and collaborating across teams in a hybrid work environment.
Responsibilities
Conduct QA reviews of AI interactions, treating AI as a “virtual agent.”
Oversee automated scoring systems that assess accuracy, tone, empathy, and escalation behaviour.
Monitor dashboards and predictive QA tools to identify potential risks or failures in real time.
Lead calibration sessions to align human QA results with automated scoring outputs.
Drive continuous improvement through customer feedback analysis, complaint tracking, and performance reporting.
Ensure AI interactions comply with FCA Principles, Consumer Duty, and complaints handling rules.
Monitor guardrails that ensure AI operates within its agreed principles.
Embed fairness and bias testing into QA processes.
Provide assurance to senior accountable managers and support regulatory reporting.
Deliver monthly AI quality and risk reporting to a Model Governance Committee.
Ensure all AI QA processes are auditable, transparent, and regulator-ready.
Act as the key point of contact for Risk & Compliance, Product and Engineering in relation to AI oversight.
Work closely with Engineering, Product, Customer Support, and Content teams to maintain quality inputs into the AI.
Partner with Risk & Compliance to ensure 2nd line oversight is robust and effective.
Engage with senior leadership to provide insights on AI performance and future improvements.
Requirements
Proven experience in Quality Assurance or Risk/Compliance oversight, ideally in financial services.
Essential to have knowledge of FCA regulatory expectations, including Consumer Duty and Principles for Businesses.
Familiarity with AI concepts (e.g. model drift, hallucination, bias, explainability).
Strong analytical skills with the ability to interpret data and identify actionable insights.
Excellent communication skills, able to bridge operational, technical, and compliance stakeholders.
Comfortable working in a fast-paced environment with emerging technology and regulatory scrutiny.
Benefits
Discretionary Performance-Related Bi-Annual Bonus of up to 10% (Cash) and 5% (Shares) based on your gross annual salary.
Workplace pension scheme - We invest in your future with a workplace pension scheme , contributing 5% on earnings up to £50,000 .
Private medical insurance (medical history disregarded)
Employee Assistance Programme
Cycle to work scheme
Season ticket loan
Free ChipX subscription for UK-based employees
28 days holiday plus bank holidays, plus the days between Christmas and New Year.
Annual training budget for courses, workshops, or conferences to help you advance your career.
£30 per month Chip Fitness Benefit to suit your Mental/Physical Wellbeing.
Lead Platform Engineer in a technology company focusing on DevOps, QA, AI, and engineering excellence. Collaborate across teams for predictable software delivery and quality improvements.
Quality Engineer at Tenneco focusing on product audits and process improvements in Puebla. Seeking candidates with engineering background and advanced problem - solving skills for the automotive industry.
QA Automation Engineer implementing automation solutions for a technology education company. Focus on enhancing product quality and supporting development team standards.
Quality Assurance Officer in Giza overseeing safety procedures and conducting quality audits. Engaging in quality checks and compliance with regulatory guidelines in a pharmaceutical setting.
Administrative Assistant focusing on quality assurance in Leipzig for a plasma donation center. Ensuring compliance with quality standards and providing administrative support.
Senior QA Architect at Stefanini developing quality assurance strategies and mentoring QA teams across software projects. Collaborating with multidisciplinary teams to ensure software quality.
Quality Assurance Specialist ensuring compliance in pharmaceutical materials and processes. Oversight on new product introductions and quality assurance in a hybrid environment.
Quality Assurance Specialist monitoring collections calls and ensuring FCA compliance in motor finance. Collaborating with agents to improve performance and uphold best practices.
QA Engineer ensuring manual quality and release confidence for B2B SaaS platforms at Transreport. Focused on improving QA processes in a hybrid work environment in London.
Test Analyst responsible for software testing and quality assurance at Consort Group. Contributing to test design, execution, and ensuring application quality in Lisbon's hybrid environment.