Senior Manager of Product Operations for CVS Media Exchange overseeing product lifecycle management. Driving systems and frameworks for strong decision - making and operational rigor in a hybrid working environment.
About the role
- Technical operator scaling the evaluation engine at Harvey. Collaborating with cross-functional teams to ensure model accuracy and operational efficiency in legal tech.
Responsibilities
- Build and scale the systems that power model and product evaluations across Harvey
- Embed evaluation workflows and readiness checkpoints into the product development lifecycle
- Create the single source of truth for evaluation status, results, history, and launch readiness
- Turn Expert-designed evaluation methodologies into scalable, repeatable operational processes
- Manage relationships with human data vendors and ensure evaluation quality meets legal standards
- Work with Engineering and Research to improve evaluation tooling, automation, and dashboards
- Drive evaluation readiness for major product and model launches across geographies and jurisdictions
- Document and operationalize evaluation governance as complexity increases
- Help define how Harvey ensures model accuracy, reliability, and trust at global scale
Requirements
- 4–7+ years in technical program management, product operations, research operations, or evaluation/benchmarking roles
- Experience working with ML/AI evaluations, benchmarking frameworks, or scientific workflows
- Comfort with statistical methodologies and SQL or Python, or similar tools to interpret evaluation data
- Ability to work deeply with legal experts and operationalize complex evaluation methodologies
- Strong cross-functional coordination skills across Product, Engineering, Research, and data providers/vendors
- High attention to detail and a bias toward clarity, rigor, and reproducibility
- Ability to navigate extreme ambiguity and bring order to complex systems
- Strong communication skills and comfort translating technical nuance for diverse stakeholders
- Desire to do whatever it takes to make evaluation systems successful—from writing documentation to diagnosing pipeline issues
Benefits
- Comprehensive health, dental and vision coverage
- Retirement benefits (401k match up to 4%)
- Flexible PTO
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Associate Director of Product Operations at Syneos Health managing product analysts and teams to analyze data for product decisions. Aligning technology initiatives with business goals across multiple departments.
Senior Product Operations Manager at GoodLeap overseeing Product Ops within the B2B division. Collaborating with various teams to ensure successful execution of strategies and maximum ROI.
Product Operations Analyst at Pluralsight enhancing product performance through customer feedback management. Collaborating with design and product management to improve operational structure and reporting.
Product Operations Associate at Sun King in Lusaka, Zambia, collaborating on tech - enabled solutions. Overseeing product operations and managing rollouts in a hybrid environment.
Vice President of Product Operations leading FOX One at Tubi Media Group. Overseeing product lifecycle and strategic planning across a fast - growing media streaming service.
Senior Product Operations Manager at Tubi managing technical partner relationships and operational health. Ensuring optimal user experiences through effective communication and data - driven analysis.
Entry - level Product Operations Specialist in Zurich supporting product and engineering teams with AI tools. Collaborating with stakeholders and improving operational workflows in a hybrid environment.
Product Operations Specialist ensuring smooth operational execution of Peppr products and cross - functional collaboration. Managing workflows, onboarding, and activation for restaurant tech solutions.
Director of Product Operations at Elsevier Clinical Solutions empowering product execution and operational effectiveness across product teams while driving excellence and collaboration.