Principal AI Engineer at Humana focused on enterprise platform strategy and AI systems design. Leading development of agentic AI platforms and influencing architectural direction.
About the role
- Product Manager overseeing AI observability and evaluation within the ML/AI Platform team at Spotify. Collaborating with engineering leaders to enhance AI workloads and user experiences.
Responsibilities
- Own the product roadmap for Spotify’s AI observability capabilities across instrumentation, data contracts, and debugging workflows.
- Collaborate with stakeholders to develop the roadmap for Spotify’s AI/Agentic evaluation capabilities via LLM-as-judges and other approaches.
- Build golden path instrumentation defaults (SDKs/libraries/templates) that make LLM workloads observable by default.
- Partner with engineering to deliver root-cause workflows across LLM chains/agents (what changed, where time/cost is spent, which step fails, which prompt/template/model version regressed).
- Drive adoption with internal teams through discovery, pilots, documentation, and ongoing enablement.
- Define and track success metrics (coverage, time-to-first-trace, regressions caught pre-prod, MTTR, cost anomalies detected early).
- Partner with Privacy/Security to establish safe logging and retention guidance that supports both compliance and debuggability.
Requirements
- 2+ years of experience as a Product Manager, Technical Product Manager, or equivalent product ownership role.
- Familiar with ML and AI development flows, and comfortable reasoning about LLM application patterns (prompting, RAG/agents, evaluation basics).
- Aware of LLM evaluation approaches (golden datasets, regression testing, human-in-the-loop review, LLM-as-a-judge).
- Comfortable partnering with engineers on technical tradeoffs and system design, even if you are not writing production code.
- Strong product fundamentals: discovery, prioritization, roadmap communication, and stakeholder alignment.
- Metrics-oriented and pragmatic; you can define outcomes and iterate based on evidence.
Benefits
- Equity
- Flexibility to work where you work best!
- Accessibility accommodations during the interview process
Job title
Job type
Experience level
Salary
Degree requirement
Location requirements
AI Developer Technology Engineer designing and optimizing GPU - accelerated workloads for financial markets at NVIDIA. Collaborating with technical experts to analyze and improve performance of complex AI applications.
AI Engineer at Maki building AI - powered talent acquisition and management solutions. Collaborating on AI features, evaluating models, and ensuring compliance in a hybrid role.
Head of ML/AI Platform at ZEIT Verlagsgruppe leading a new team in ML/AI development efforts. Requires expertise in cloud infrastructure, software development, and agile environments.
Director leading AI platform strategy and development at Cargill, serving employees globally with AI solutions. Overseeing the technical capabilities and guiding organizational innovation for AI.
Forward Deployed AI Engineer deploying generative models for pharmaceutical and biotech customers. Ensuring seamless integration and advocating for customer success through technical excellence and collaboration.
Senior AI Architect leading AI architecture strategy for Honeywell. Shape scalable AI platforms across ML, GenAI and agentic systems.
Associate Principal AI Engineer evolving AI platform capabilities and supporting AI adoption at Aegon. Building production - ready AI solutions while collaborating with diverse teams on business transformation initiatives.
AI Engineer creating the world's first viral agent for influencer marketing using advanced AI technologies. Driving influencer marketing strategies for record labels and brands with innovative tools.
Seasoned Data Scientist developing and deploying GenAI/machine learning models on GCP. Leading microservice - based solutions and MLOps practices with a focus on the pharma domain.