Technical operator scaling the evaluation engine at Harvey. Collaborating with cross-functional teams to ensure model accuracy and operational efficiency in legal tech.
Responsibilities
Build and scale the systems that power model and product evaluations across Harvey
Embed evaluation workflows and readiness checkpoints into the product development lifecycle
Create the single source of truth for evaluation status, results, history, and launch readiness
Turn Expert-designed evaluation methodologies into scalable, repeatable operational processes
Manage relationships with human data vendors and ensure evaluation quality meets legal standards
Work with Engineering and Research to improve evaluation tooling, automation, and dashboards
Drive evaluation readiness for major product and model launches across geographies and jurisdictions
Document and operationalize evaluation governance as complexity increases
Help define how Harvey ensures model accuracy, reliability, and trust at global scale
Requirements
4–7+ years in technical program management, product operations, research operations, or evaluation/benchmarking roles
Experience working with ML/AI evaluations, benchmarking frameworks, or scientific workflows
Comfort with statistical methodologies and SQL or Python, or similar tools to interpret evaluation data
Ability to work deeply with legal experts and operationalize complex evaluation methodologies
Strong cross-functional coordination skills across Product, Engineering, Research, and data providers/vendors
High attention to detail and a bias toward clarity, rigor, and reproducibility
Ability to navigate extreme ambiguity and bring order to complex systems
Strong communication skills and comfort translating technical nuance for diverse stakeholders
Desire to do whatever it takes to make evaluation systems successful—from writing documentation to diagnosing pipeline issues
Product Operations Support ensuring customer satisfaction and achieving revenue targets for Datacom's PSG. Managing post - sale orders and supporting Account Managers for hardware and software transactions.
Product Operations Leader managing manufacturing and functional objectives at GE Aerospace. Driving lean operations and coordinating complex manufacturing issues for aviation technologies.
Product Operations Leader at GE Aerospace managing manufacturing issues, driving delivery of new technologies, and ensuring collaboration between Engineering and suppliers. Supporting program operations and fostering a culture of continuous improvement.
Senior Associate in product operations at athenahealth enhancing healthcare solutions through client communication and analytics. Responsible for planning and executing impactful product features with cross - functional teams.
Senior Product Operations Manager at Adobe focusing on strategy, operational systems, and tools to optimize customer - facing teams. Collaborating across organization to enhance operational efficiencies is key.
Business Technology Manager in Assurance Department at EisnerAmper. Collaborating on innovations in assurance processes and software tools to improve client service.
Product Operations Coordinator supporting product development and delivery at Westcor Land Title Insurance Company. Facilitating project coordination, scheduling, and communication among stakeholders.
Product Operations Manager coordinating beta programs with internal teams and customers at Five9. Requires strong project management skills and enterprise software experience in a hybrid role.