About the company
The team that built Jeeva AI is building Digital Workers, a new suite of autonomous agents for identity operations and security inside Okta, working directly with the CEO and bringing the product to Okta's 20,000+ customers.
Responsibilities
- Build the agent harness for planning, tool use, memory, context compaction, interruption and recovery during long-running work
- Integrate OpenAI and Anthropic model APIs; select models using measured quality, latency and cost with clear failure handling
- Evaluate existing harnesses and build only the missing pieces; keep the harness connected to AWS workflow execution and approval state
- Keep authorization and sensitive writes behind application policy checks
- Build evaluation datasets and replay tests for valid findings, access decisions, app setup and AI agent onboarding
- Measure false positives, missed risks, unsafe actions, completion rate and cost; turn production failures into regression tests
- Test prompt injection, stale evidence, conflicting instructions and unsafe tool use; protect tenant boundaries in retrieval and memory
- Improve prompts, retrieval, tools and model routing; evaluate fine-tuning or post-training when justified
Requirements
- Strong Python engineering skills and experience shipping an LLM application that uses tools
- Hands-on experience building agent workflows or evaluation systems for tool-using LLM applications (Claude Agent SDK, OpenAI Codex SDK, Strands Agents, LangChain Deep Agents, LangGraph or custom)
- Experience integrating model APIs, structured outputs and asynchronous services; OpenAI or Anthropic especially relevant
- Depth in agent execution or evaluation systems with working code and failure analysis
- Ability to distinguish a plausible model response from a supported finding or verified action
- Extra credit: open-source contributions, agent observability, security evaluations, synthetic evaluation data, fine-tuning, preference data, model distillation, identity and security workflows
Conditions
- Annual base salary $165,000 – $226,000 USD for San Francisco Bay Area
- Equity (where applicable), bonus and benefits including health, dental, vision, 401(k), flexible spending account and paid leave
- In-person role