About the company
Perplexity is looking for an experienced analyst to help us build and improve our core search technologies. You'll work at the intersection of data analysis and engineering - designing metrics, building data pipelines, and improving the quality of our search and answer systems.
Responsibilities
- Find and diagnose quality issues in our search pipeline.
- Design metrics from scratch to track and measure search quality.
- Build datasets for model training, including LLM-as-a-judge labeling pipelines.
- Improve search snippet quality and page selection algorithms for indexing.
- Design and analyze A/B experiments to validate improvements.
Requirements
- 4+ years of experience as a data analyst or in a related role.
- Strong coding skills — expected to write production-grade code at a mid-level backend engineer level.
- Proficiency with SQL and Python.
- Demonstrated hands-on experience with at least one of the following: designing metrics from scratch (not just analyzing existing A/B experiments); building labeling pipelines using LLM-as-a-judge; training ML models that shipped to production with measurable metric improvements; designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals.
Conditions
- Preferred qualifications: experience working on search-related products; knowledge of statistics and A/B experiment design; experience with Apache Spark or Databricks.