Hybrid Customer Support Lead – AI Quality Assurance

Posted 3 weeks ago

Apply now

About the role

  • Conduct QA reviews of AI interactions, treating AI as a “virtual agent.”
  • Oversee automated scoring systems that assess accuracy, tone, empathy, and escalation behaviour.
  • Monitor dashboards and predictive QA tools to identify potential risks or failures in real time.
  • Lead calibration sessions to align human QA results with automated scoring outputs.
  • Drive continuous improvement through customer feedback analysis, complaint tracking, and performance reporting.
  • Ensure AI interactions comply with FCA Principles, Consumer Duty, and complaints handling rules.
  • Monitor guardrails that ensure AI operates within its agreed principles.
  • Embed fairness and bias testing into QA processes.
  • Provide assurance to senior accountable managers and support regulatory reporting.
  • Deliver monthly AI quality and risk reporting to a Model Governance Committee.
  • Ensure all AI QA processes are auditable, transparent, and regulator-ready.
  • Act as the key point of contact for Risk & Compliance, Product and Engineering in relation to AI oversight.
  • Work closely with Engineering, Product, Customer Support, and Content teams to maintain quality inputs into the AI.
  • Partner with Risk & Compliance to ensure 2nd line oversight is robust and effective.
  • Engage with senior leadership to provide insights on AI performance and future improvements.

Requirements

  • Proven experience in Quality Assurance or Risk/Compliance oversight, ideally in financial services.
  • Essential to have knowledge of FCA regulatory expectations, including Consumer Duty and Principles for Businesses.
  • Familiarity with AI concepts (e.g. model drift, hallucination, bias, explainability).
  • Strong analytical skills with the ability to interpret data and identify actionable insights.
  • Excellent communication skills, able to bridge operational, technical, and compliance stakeholders.
  • Comfortable working in a fast-paced environment with emerging technology and regulatory scrutiny.

Benefits

  • Discretionary Performance-Related Bi-Annual Bonus of up to 10% (Cash) and 5% (Shares) based on your gross annual salary.
  • Workplace pension scheme - We invest in your future with a workplace pension scheme , contributing 5% on earnings up to £50,000 .
  • Private medical insurance (medical history disregarded)
  • Employee Assistance Programme
  • Cycle to work scheme
  • Season ticket loan
  • Free ChipX subscription for UK-based employees
  • 28 days holiday plus bank holidays, plus the days between Christmas and New Year.
  • Annual training budget for courses, workshops, or conferences to help you advance your career.
  • £30 per month Chip Fitness Benefit to suit your Mental/Physical Wellbeing.
  • Company laptop.

Job title

Customer Support Lead – AI Quality Assurance

Job type

Experience level

Senior

Salary

£35,000 per year

Degree requirement

High School Diploma

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job