Hybrid Manager, Generative AI Advisory and Oversight

at Capital One

• Job title: Manager, Generative AI Advisory and Oversight
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: $179,400 - $245,600 per year
• Degree requirement: Bachelor's Degree
• Tech skills: AWS, Azure, Cloud
• Location requirements: Hybrid, McLean, United States

About the role

• Manager responsible for AI/ML risk analysis and oversight at Capital One, collaborating with Cyber and Technology teams. Leading architecture assessments and ensuring safe technology adoption within a growing organization.

Responsibilities

• Provide technical leadership in assessing the architecture, security requirements/controls, roadmaps, and reusable patterns for AI/ML system design and deployments (including Agentic AI frameworks), while providing oversight and effective challenge over the end-to-end AI/ML lifecycle
• Evaluate proposed and approved AI/ML technical solutions for automation, resiliency, performance, scalability, and security including appropriate tradeoffs, risks and opportunities
• Develop and maintain AI/ML risk guidance to ensure the safe adoption of emerging technologies, including governance for agentic AI components, establishing secure data/tool interaction models and how to maintain secure operational boundaries
• Evaluate the dynamic behavior of AI systems and oversee the development of key continuous monitoring controls and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk appetite
• Define requirements for AI observability, focusing on the traceability of autonomous decisions and comprehensive system audit trails
• Mentor junior risk associates to bring them up to speed on AI/ML architecture and risks, including Generative AI, AI Agents, and Agentic AI systems
• Build and maintain relationships with technical leaders, engineers, architects, and other stakeholders to understand and evaluate implementation plans, business priorities and technical solutions to ensure risks are well communicated and understood by key stakeholders
• Demonstrate enthusiasm for keeping current with AI/ML trends, actively experimenting with and learning new technologies, engaging in both internal and external technology communities, and providing mentorship to colleagues within the risk management and engineering sectors
• Demonstrate strong analytical, problem-solving, and decision-making skills
• Define, structure and plan work independently
• Translate complex ideas, technology, and programs into language executives can relate to and perform as a key influencer on technical decisions that affect the AI/ML platforms and systems
• Draft and communicate independent reports for broad audiences including executives, business leaders, product managers, legal experts, security specialists and software engineers
• Coordinate program-related activities and deliverables to ensure effective collaboration within the team and across stakeholder groups.

Requirements

• Bachelor's degree or military experience
• At least four years of experience in Technology Management or Cyber Risk Management
• At least one year of experience architecting, designing, developing, integrating, delivering, supporting or assessing complex AI systems
• 2+ years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud)
• Master's degree in Computer Science, Computer Engineering, or relevant technical field
• Experience assessing GenAI or LLM-Powered application architectures in production, including security best practices for Generative AI development and deployments
• Experience drafting and communicating reports or analytic assessments for executives
• Ability to communicate clearly and to interact effectively at all levels of the organization, and to influence as warranted and appropriate to drive to consensus
• Experience with identifying and communicating key risks related to AI/ML implementations and architectures
• Experience with risk analysis and reports that describe the risk implications to executives
• Ability to manage multiple high-visibility and high-impact projects while maintaining superior results
• Familiarity with AI controls and control frameworks (NIST AI Risk Management Framework, ISO 42001, OWASP Top 10 for LLM, MITRE ATLAS)
• Prior experience working in financial services or other highly-regulated sectors

Benefits

• Comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being