Hybrid Search Quality Analyst

Posted last month

Apply now

About the role

  • Data Analyst at Perplexity utilizing advanced search technologies. Responsible for data-driven insights and A/B testing to inform product development and improve user engagement.

Responsibilities

  • Develop data-driven insights from user behavior to inform our product roadmap and accelerate adoption
  • Formulate hypotheses and validate them by designing, running, and analyzing A/B tests
  • Determine appropriate metrics and visualizations for tracking, and implement them in dashboards
  • Design new pipelines that will help to deliver better ranking quality. From discovering new signals, producing metrics and construct data labeling pipelines with human and LLM feedback

Requirements

  • 4+ years of experience working as a data analyst or in a related role
  • Experience working on search-related products, with emphasis on designing online metrics and analyzing A/B experiments
  • Strong Python skills (expected to write production-grade code)
  • Proficiency with SQL
  • Experience with Business Intelligence (BI) tools
  • Deep knowledge of statistics
  • Proficiency with Apache Spark (preferred)
  • Experience with Databricks (preferred)
  • Experience with development of LLM-as-a-judge systems (preferred)

Benefits

  • Comprehensive health, dental, and vision insurance for you and your dependents.

Job title

Search Quality Analyst

Job type

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job