About the company
ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together.
Responsibilities
- Eval orchestration at scale.
- Agent observability and tracing.
Requirements
- Direct experience building evaluation systems for LLM-based products — scoring methodology, benchmark design, and failure analysis, not just prompt engineering.
- A working understanding of coding agent architecture: tool use, agentic loops, context management, and the tradeoffs between generic and domain-specific scaffolding.
- 2+ years of experience with technologies relevant to ServiceNow, including advanced coding skills and fluency in one or more of Java, C++, Shell, or JavaScript.
- Experience critically evaluating foundation models — distinguishing real capability differences from tuning or scaffold artifacts.
- Ability to execute against ambiguous priorities, weighing context, risk, and desired outcomes — particularly where eval data is incomplete or contested.