Hybrid Senior Data Scientist – ML Operations, Analytics

Posted 13 hours ago

Apply now

About the role

  • Senior Data Scientist in a Legal AI company focusing on ML operations analytics, collaborating with teams for effective legal outcomes.

Responsibilities

  • Build ML operations analytics tracking pipeline health, costs, latency, and quality metrics across all services
  • Lead production LLM evaluation initiatives, designing custom metrics, quality monitoring and LLM observability in general
  • Drive development efforts in collaboration with different ML teams based on analytics outputs
  • Collaborate with our data annotation team on prompt engineering and evaluation dataset creation
  • Help with curating the Filevine dataset
  • Create actionable dashboards and insights for ML teams and leadership
  • Help define SLAs, cost optimization and failure prevention strategies for our ML pipelines

Requirements

  • 3+ years in data science, ML operations, or analytics engineering
  • Experience with LLM evaluation frameworks and quality metrics design
  • Strong Python, SQL, and data visualization skills
  • Knowledge of prompt optimization techniques
  • Deep understanding of latest trends in LLMs and their production deployments
  • Excellent communication skills in English to translate technical metrics into business insights
  • Collaborative mindset with ability to work across machine learning teams

Benefits

  • Independent contractors responsible for their own taxes and compliance with applicable laws

Job title

Senior Data Scientist – ML Operations, Analytics

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

No Education Requirement

Tech skills

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job