Hybrid Product Manager, Models

at Heidi Health

• Job title: Product Manager, Models
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: Not specified
• Degree requirement: No Education Requirement
• Location requirements: Hybrid, San Francisco, United States

About the role

• Product Manager focused on AI models platform for healthcare startup Heidi. Collaborating with engineers and product teams to ensure quality and efficiency in model deployment.

Responsibilities

• Own product strategy and roadmap for Heidi's models platform (evaluation, safety, model routing, fine-tuning infrastructure), setting clear goals and being held accountable to achieving them
• Prioritise your team's work across enablement requests, model safety and quality, and bets on new capabilities
• Figure out where product teams get stuck on your models and fix the platform so they don't
• Build eval tooling and fine-tuning workflows that your engineers and product teams can actually use in clinical settings
• Decide what to improve next by reading clinician feedback, model quality signals, and what product teams are asking for
• Allocate engineering capacity across product teams who all want more than you can give, and tell them clearly what you're deferring
• Work with your engineers on eval design, fine-tuning trade-offs, and model architecture decisions at a technical level
• Set model quality and safety targets grounded in clinical outcomes (did the note capture the right diagnosis? did the referral letter contain the right history?)
• Spot infrastructure that two product teams are building separately and consolidate it
• Watch foundation model developments and decide when to rip up your roadmap

Requirements

• 4+ years working on AI platform, infrastructure, or model-adjacent products, though we care more about what you've built than time served
• Technical depth on model evaluation, fine-tuning, and production AI systems. You've designed eval suites, debugged model regressions, and understand what makes models fail in production.
• Genuine curiosity about what models get wrong in clinical settings and why
• Technical enough to hold your own with your engineers, credible enough to present safety trade-offs to leadership
• You use AI tools to do your own work, not just manage people who do
• Strong opinions, weakly held. You'll shift the room when you're right.
• Willingness to update your views when the technology shifts, which it does roughly quarterly.
• Data fluency with diagnostic teeth - can you read evaluation results and distinguish a real regression from noise? Can you design an eval that catches the thing your current suite misses?

Benefits

• Flexible hybrid working environment, with 3 days in the office.
• A generous personal development budget of $500 per annum
• Learn from some of the best engineers and creatives, joining a diverse team
• Become an owner, with shares (equity) in the company, if Heidi wins, we all win
• The rare chance to create a global impact as you immerse yourself in one of Australia’s leading healthtech startups
• If you have an impact quickly, the opportunity to fast track your startup career!