Senior Data Scientist at Epicor responsible for designing, building, and deploying ML solutions that empower customers. Collaborating across teams to ensure ML solutions deliver measurable value.
About the role
- Data Scientist designing evaluation metrics and pipelines to enhance answer quality for Perplexity's AI products. Collaborating in a high-impact team using advanced machine learning methodologies.
Responsibilities
- Architect and maintain automated evaluation pipelines to assess answer quality across Perplexity's products, ensuring high standards for accuracy and helpfulness
- Design evaluation sets and methods specifically to measure the impact of tool calls (particularly web search retrieval) on the final answer's quality
- Develop VLM-based solutions to programmatically evaluate how final answers render visually across different platforms and devices
- Continuously review public benchmarks and academic evaluations for their applicability to the Perplexity product, adapting and incorporating them into our regular performance measurements
- Operate within a small, high-impact team where your evaluation metrics directly shape product changes, collaborating closely with technical leadership to measure and improve Answer Quality
Requirements
- PhD or MS in a technical field or equivalent experience
- 4+ years of experience in data science or machine learning
- Strong proficiency in Python and SQL (expected to write production-grade code)
- Experience building within a modern cloud data stack, specifically AWS and Databricks
- Comfortable with agentic coding workflows and using AI-assisted development tools to iterate faster
- 1+ years of experience working with LLMs at scale, specifically with LLM-as-a-judge setups (preferred)
- Prior experience working on customer-facing web products or consumer apps, with real user traffic at scale (preferred)
- A strong research background, with experience applying research methods to real-world ML problems (preferred)
- Experience defining evaluation metrics (e.g., factual consistency, hallucination rate, retrieval precision) and building ground truth datasets (preferred)
Benefits
- U.S. Benefits
- Full-time U.S. employees enjoy a comprehensive benefits program including equity, health, dental, vision, retirement, fitness, commuter and dependent care accounts, and more.
- International Benefits
- Full-time employees outside the U.S. enjoy a comprehensive benefits program tailored to their region of residence.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Principal Data Scientist at Epicor leading advanced analytics and AI strategies across product ecosystems. Guiding teams, shaping architecture, and delivering impactful analytics solutions.
Junior Data Scientist at BlaBlaCar developing and deploying machine learning models to enhance customer support. Collaborating within a data team to optimize processes and drive efficiency.
Data Scientist delivering analytical insights by applying advanced analytics at Navy Federal. Working with financial and operational data to develop key business models and optimize processes.
Data Scientist developing and implementing data science methods at Ipsos to enhance analytics and deliver insights. Collaborating with teams to build models and tools for various applications.
Data Scientist at Elevance Health developing predictive models for healthcare analytics and optimization. Collaborating to enhance member experiences with innovative solutions and AI techniques.
Working student in Capital Markets handling IT and Data Science tasks. Involvement in process optimization, data analysis, and database management.
Data Scientist Summer Intern analyzing complex datasets to support analytics initiatives at Sprinklr. Collaborating with teams for data - driven decision making in a global SaaS company.
Data Science Intern developing and deploying reliability analytics & predictive models for PG&E's Electric Reliability Strategy at the Diablo Canyon Power Plant.
Data Scientist developing advanced data science models and anomaly detection techniques for utility operations. Leading cross - functional team efforts in enhancing electric transmission and distribution reliability.