About the company
Okta secures AI by building trusted, neutral infrastructure that enables organizations to safely embrace AI. The team that built Jeeva AI is building Digital Workers, a suite of autonomous agents for identity operations and security inside Okta, working directly with the CEO.
Responsibilities
- Build the agent harness for planning, tool use, memory, context compaction, interruption and recovery during long-running work
- Integrate OpenAI and Anthropic model APIs; select models using measured quality, latency and cost with clear failure handling
- Evaluate existing harnesses and build only the missing pieces; keep the harness connected to AWS workflow execution and approval state
- Keep authorization and sensitive writes behind application policy checks; require evidence of resulting state before marking work complete
- Build evaluation datasets and replay tests for valid findings, access decisions, app setup and AI agent onboarding
- Measure false positives, missed risks, unsafe actions, completion rate and cost; turn production failures into regression tests
- Test prompt injection, stale evidence, conflicting instructions and unsafe tool use; protect tenant boundaries in retrieval and memory
- Improve prompts, retrieval, tools and model routing; evaluate fine-tuning or other post-training methods
Requirements
- Strong Python engineering skills and experience shipping an LLM application that uses tools
- Hands-on experience building agent workflows or evaluation systems for tool-using LLM applications (Claude Agent SDK, OpenAI Codex SDK, Strands Agents, LangChain Deep Agents, LangGraph or custom implementation)
- Experience integrating model APIs, structured outputs and asynchronous services
- Depth in agent execution or evaluation systems with working code and failure analysis
- Ability to distinguish a plausible model response from a supported finding or verified action
Conditions
- Core stack: Python FastAPI, AWS Step Functions, Amazon Bedrock AgentCore, PostgreSQL on Amazon RDS, pgvector
- Planned analytics layer using ClickHouse or BigQuery
- Annual base salary range for San Francisco Bay Area: $194,000 – $267,000 USD, plus equity, bonus and benefits