AI Quality Assurance Lead ensuring AI compliance and accuracy at Chip. Overseeing quality assurance processes and collaborating across teams in a hybrid work environment.
Responsibilities
Conduct QA reviews of AI interactions, treating AI as a “virtual agent.”
Oversee automated scoring systems that assess accuracy, tone, empathy, and escalation behaviour.
Monitor dashboards and predictive QA tools to identify potential risks or failures in real time.
Lead calibration sessions to align human QA results with automated scoring outputs.
Drive continuous improvement through customer feedback analysis, complaint tracking, and performance reporting.
Ensure AI interactions comply with FCA Principles, Consumer Duty, and complaints handling rules.
Monitor guardrails that ensure AI operates within its agreed principles.
Embed fairness and bias testing into QA processes.
Provide assurance to senior accountable managers and support regulatory reporting.
Deliver monthly AI quality and risk reporting to a Model Governance Committee.
Ensure all AI QA processes are auditable, transparent, and regulator-ready.
Act as the key point of contact for Risk & Compliance, Product and Engineering in relation to AI oversight.
Work closely with Engineering, Product, Customer Support, and Content teams to maintain quality inputs into the AI.
Partner with Risk & Compliance to ensure 2nd line oversight is robust and effective.
Engage with senior leadership to provide insights on AI performance and future improvements.
Requirements
Proven experience in Quality Assurance or Risk/Compliance oversight, ideally in financial services.
Essential to have knowledge of FCA regulatory expectations, including Consumer Duty and Principles for Businesses.
Familiarity with AI concepts (e.g. model drift, hallucination, bias, explainability).
Strong analytical skills with the ability to interpret data and identify actionable insights.
Excellent communication skills, able to bridge operational, technical, and compliance stakeholders.
Comfortable working in a fast-paced environment with emerging technology and regulatory scrutiny.
Benefits
Discretionary Performance-Related Bi-Annual Bonus of up to 10% (Cash) and 5% (Shares) based on your gross annual salary.
Workplace pension scheme - We invest in your future with a workplace pension scheme , contributing 5% on earnings up to £50,000 .
Private medical insurance (medical history disregarded)
Employee Assistance Programme
Cycle to work scheme
Season ticket loan
Free ChipX subscription for UK-based employees
28 days holiday plus bank holidays, plus the days between Christmas and New Year.
Annual training budget for courses, workshops, or conferences to help you advance your career.
£30 per month Chip Fitness Benefit to suit your Mental/Physical Wellbeing.
Quality Engineer intern coordinating quality activities at Arquus in Limoges. Joining a highly qualified team in the development and manufacturing of all - terrain armored vehicles.
Quality Assurance & Regulatory Affairs Specialist supporting Demant's 3rd - party business partners. Handling documentation, audits, and regulatory coordination within an international organization.
Senior Quality Engineer working in a dynamic environment with a focus on product quality for hearing impaired. Opportunities for professional growth and exciting projects.
QA Tester validating software quality at innovative technology company. Designing and executing test strategies while collaborating with international teams in a dynamic environment.
Senior Frontend Entwickler und QA - Engineer in der Softwareentwicklung bei Creditreform. Verantwortlich für die Entwicklung von Web - Frontends und Gewährleistung hoher Softwarequalität in Neuss.
Software Testautomatisierer developing and maintaining automated test solutions in hybrid working conditions at medium - sized IT firm Mentopolis Consulting & Software Concepts GmbH.
Design Quality Assurance Engineer responsible for managing product design and compliance in medical technology industry. Collaborating across departments to meet regulatory standards and improve quality processes.
Quality Engineer II at Heraeus Medevio developing engineering solutions for manufacturing complaints and quality issues. Leading teams to improve product and process quality in Cartago, Costa Rica.
Lead QA processes in the software factory of Blue Technology, focusing on quality and automation. Collaborate with teams to ensure excellence in deliverables and continuous improvement.
Quality Assurance Analyst ensuring quality of software solutions developed for air traffic control systems. Responsible for testing and defect management in a hybrid work setting.