AI Quality Assurance Lead ensuring AI compliance and accuracy at Chip. Overseeing quality assurance processes and collaborating across teams in a hybrid work environment.
Responsibilities
Conduct QA reviews of AI interactions, treating AI as a “virtual agent.”
Oversee automated scoring systems that assess accuracy, tone, empathy, and escalation behaviour.
Monitor dashboards and predictive QA tools to identify potential risks or failures in real time.
Lead calibration sessions to align human QA results with automated scoring outputs.
Drive continuous improvement through customer feedback analysis, complaint tracking, and performance reporting.
Ensure AI interactions comply with FCA Principles, Consumer Duty, and complaints handling rules.
Monitor guardrails that ensure AI operates within its agreed principles.
Embed fairness and bias testing into QA processes.
Provide assurance to senior accountable managers and support regulatory reporting.
Deliver monthly AI quality and risk reporting to a Model Governance Committee.
Ensure all AI QA processes are auditable, transparent, and regulator-ready.
Act as the key point of contact for Risk & Compliance, Product and Engineering in relation to AI oversight.
Work closely with Engineering, Product, Customer Support, and Content teams to maintain quality inputs into the AI.
Partner with Risk & Compliance to ensure 2nd line oversight is robust and effective.
Engage with senior leadership to provide insights on AI performance and future improvements.
Requirements
Proven experience in Quality Assurance or Risk/Compliance oversight, ideally in financial services.
Essential to have knowledge of FCA regulatory expectations, including Consumer Duty and Principles for Businesses.
Familiarity with AI concepts (e.g. model drift, hallucination, bias, explainability).
Strong analytical skills with the ability to interpret data and identify actionable insights.
Excellent communication skills, able to bridge operational, technical, and compliance stakeholders.
Comfortable working in a fast-paced environment with emerging technology and regulatory scrutiny.
Benefits
Discretionary Performance-Related Bi-Annual Bonus of up to 10% (Cash) and 5% (Shares) based on your gross annual salary.
Workplace pension scheme - We invest in your future with a workplace pension scheme , contributing 5% on earnings up to £50,000 .
Private medical insurance (medical history disregarded)
Employee Assistance Programme
Cycle to work scheme
Season ticket loan
Free ChipX subscription for UK-based employees
28 days holiday plus bank holidays, plus the days between Christmas and New Year.
Annual training budget for courses, workshops, or conferences to help you advance your career.
£30 per month Chip Fitness Benefit to suit your Mental/Physical Wellbeing.
Quality Engineer at Brink responsible for maintaining ISO 9001 standards and improving production processes. Work collaboratively within the quality team to support and advise on critical processes.
Quality Assurance Specialist overseeing production quality and compliance at Berghof Fluoroplastic Technology. Conducting inspections and continuous improvement initiatives in manufacturing.
Quality Assurance Engineer leading automation testing efforts for the Analytics Scrum Team at Hitachi Energy. Focused on developing frameworks and ensuring quality for analytical algorithms.
Quality Manager responsible for regular quality checks and problem resolution in flat glass production. Collaborating with teams to enhance product quality and ensure compliance with standards.
Quality Engineer responsible for implementing and supervising quality management systems at Tenneco in Swarzedz - Jasin, Poland. Conducting audits, maintaining documentation, and supporting training activities.
Senior QA Automation Engineer at SMBC responsible for high - quality automated tests. Collaborating with teams to understand requirements and improve testing processes in a hybrid work environment.
Senior Quality Assurance Engineer in SSO Services Engineering at Deutsche Bank. Deliver automation solutions and collaborate on testing within complex project environments.
Quality Assurance Software Engineer ensuring top - notch quality for cloud - based managed services at Kyndryl. Defining strategies, automating testing, and mentoring QA Engineers in a collaborative environment.
Quality Assurance Software Engineer ensuring software quality and performance at Kyndryl. Collaborating with teams and automating tests for cloud - based managed services.
Quality Assurance Software Engineer ensuring software quality, reliability, and performance at Kyndryl. Collaborating with engineering squads to develop features and perform robust testing.