About the company
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Engineer / AI Builder based in Canada.
Responsibilities
- Design and build agentic AI workflows, including reasoning loops, tool and function calling, orchestration, and single- or multi-agent architectures.
- Develop and maintain production RAG pipelines covering chunking strategies, embeddings, vector search, re-ranking, knowledge freshness, and dynamic content updates.
- Integrate AI solutions with AWS services such as Bedrock and Agent Core, including MCP-based tools.
- Develop production-grade system prompts using structured role definitions, output constraints, and few-shot examples.
- Build robust evaluation and observability capabilities using golden datasets, LLM-as-judge approaches, RAGAS-style metrics, tracing platforms, and runtime guardrails.
- Design for failure and degradation through retries, backoff and jitter, circuit breakers, fallback models, and clear user-facing recovery experiences.
- Build backend and full-stack services using Python and Node.js, including AWS Lambda, API Gateway, RESTful APIs, and serverless architectures.
- Design DynamoDB single-table schemas for conversation state, agent memory, and session history.
- Provide technical leadership by evaluating architectural trade-offs, mentoring engineers, and establishing strong practices for agentic AI development.
Requirements
- 6+ years of professional software engineering experience, including substantial hands-on experience delivering GenAI or LLM-powered systems into production.
- Demonstrated expertise in agentic AI, including reasoning loops, tool/function calling, multi-agent orchestration.
- Strong practical experience with RAG, including chunking, embeddings, vector databases such as OpenSearch, similarity search, re-ranking, and knowledge-refresh strategies.
- Experience implementing LLM evaluation and observability, including golden datasets, LLM-as-judge, RAGAS or comparable metrics, and tracing platforms such as LangFuse or LangSmith.
- Strong production prompt-engineering capabilities.
- Hands-on experience with the AWS GenAI ecosystem, particularly Bedrock, Agent Core, Lambda, DynamoDB, S3, SQS, EventBridge, and Step Functions.
- Strong Python and Node.js development skills, with experience building full-stack applications and RESTful APIs.
- Solid understanding of reliability patterns for LLM-backed systems.
- Experience with Docker, cloud-native deployment, production monitoring, and troubleshooting.
- Experience mentoring engineers and contributing to technical standards and engineering practices.
Conditions
- Competitive salary range of $176,612–$243,680 CAD.
- Remote position based in Canada.
- Opportunity to work on production-grade AI systems with significant technical ownership and influence.
- Exposure to advanced agentic AI, GenAI, RAG, AWS, evaluation, and observability technologies.
- Collaborative environment with cross-functional and globally distributed teams.
- Opportunities to mentor engineers.