About the company
ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better.
Responsibilities
- Platform Eval Strategy & Adoption: Partner closely with Servicenow AI platform and product teams to understand, implement, validate, and drive adoption of out-of-the-box Evals, while influencing the platform roadmap based on enterprise needs
- Enterprise Eval Innovation: Identify gaps in platform evaluation capabilities and drive the definition and development of custom Evals, metrics, rubrics, datasets, and evaluation strategies for enterprise-specific AI applications and agentic workflows
- Custom Eval Innovation: Identify gaps where OOTB Evals don't adequately measure enterprise AI quality; define and drive custom metrics, rubrics, datasets and evaluation strategies; develop reusable Evals for domain-specific behaviors and business outcomes; establish evaluation approaches for AI agents, task completion, tool usage and multi-step workflows
- Eval-Driven Development: Embed Evals into the full AI lifecycle: Define → Measure → Build → Evaluate → Improve → Release → Monitor; require AI teams to define expected behavior and measurable quality criteria; establish evaluation coverage and quality thresholds; integrate trusted Evals into development, regression and release workflows; establish Eval-based quality gates for appropriate AI applications; enable continuous evaluation in production
Requirements
- Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving
- 10+ years of experience in Product Management roles, with a focus on AI
- A technically strong Product Manager who combines: AI/LLM expertise + Evaluation Science + Quality Engineering + Product Management + Platform Strategy with the ability to influence AI Specialists, engineers and platform teams without direct authority
- Experience with LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability, CI/CD and developer platforms
- Servicenow AI Platform experience is a huge plus
Conditions