About the company
The Agent Observability team builds cutting-edge tools to monitor, explain, and improve AI systems in production, particularly those leveraging Large Language Models (LLMs) and generative AI. We provide robust, scalable observability for AI workloads, including drift detection, model evaluation, and behavior tracing.
Responsibilities
- Drive design and implementation of LLM observability features
- Ideate, prototype, and scale new product features for generative AI systems
- Work cross-functionally with eng, product, UX, and applied science
- Develop and extend tools for tracing, evaluating, and debugging LLMs
- Influence architecture decisions and mentor engineers
- Stay close to customer pain points to guide product and engineering priorities
- Stay current with industry trends in machine learning and observability
Requirements
- BS/MS/PhD in Computer Science, Engineering or related field, or equivalent experience
- Deep understanding of distributed systems and scalable backend architectures
- Hands-on experience building and shipping LLM-powered or GenAI applications
- Understanding of model internals, inference pipelines, evaluation techniques, and prompt engineering
- Product-oriented mindset, comfortable with ambiguity
- Experience with observability tools/platforms
Conditions
- Hybrid workplace
- Estimated yearly salary: $234,000 – $300,000 USD
- Competitive salary and equity package, healthcare, dental, parental planning, mental health benefits, 401(k) match, PTO, fitness reimbursements, discounted ESPP