About the company
Valletta Software Development is a custom mobile/web software developer in the US and Europe. Its teams implement IT projects of varying complexity, including website and mobile app development, enterprise systems, and AI/ML solutions. It has been named one of the Top 10 Software Development Companies in Q2 2026 by 50Pros.
Responsibilities
- Design and ship specialist AI agents using memory, tools, data and multi-step reasoning.
- Build multi-agent orchestration that routes work between specialist agents, manages dependencies and synthesises conflicting outputs.
- Develop systems that evaluate confidence, uncertainty and consequence before recommendations reach a practitioner.
- Build human-in-the-loop escalation so the system knows when to answer, ask for more information or defer to a human.
- Create workflows that turn sport scientist expertise into validated, versioned and testable agent capabilities.
- Build evaluation, observability and regression testing to measure and improve agent performance in production.
- Work with domain experts to ensure AI outputs are grounded, traceable and actionable.
Requirements
- Production agentic AI experience, including memory or persistent state, tool use/tool calling, multi-step reasoning or workflows, and production deployment and operation. Chatbots, prompt engineering and RAG alone are not sufficient.
- Experience building or substantially contributing to a production multi-agent system, including agent routing, specialist agent composition, dependency-aware workflows, parallel and sequential execution, handling conflicting agent outputs and response synthesis. Experience with LangGraph, AutoGen, CrewAI or equivalent frameworks is valuable.
- Hands-on experience calibrating probabilistic ML or AI systems, including Platt scaling, isotonic regression, Expected Calibration Error (ECE), reliability and calibration curves, and confidence and uncertainty estimation.
- 5+ years of professional experience in applied ML, AI or software engineering.
- Strong Python and software engineering fundamentals.
- Experience building and operating production systems.
- Nice to have: production RAG and reranking; foundation-model fine-tuning or domain adaptation (LoRA, PEFT or similar); LLM observability and drift detection; evaluation harnesses and automated regression testing; human-in-the-loop architectures, confidence thresholds and escalation models; causal or counterfactual reasoning; Go/Golang; AWS, including ECS, EC2, Lambda, SNS or SQS; GraphQL, REST or gRPC; PostgreSQL or MongoDB; and experience working with sport scientists, clinicians or other domain experts.
- Advanced or native English.
Conditions
- Remote, for candidates located in the EU.
- Working hours: 11:00–20:00 CET, with more than 50% overlap with New York.
- Full-time B2B contract.
- Salary: USD 4,500–5,300 per month.
- Join a remote team of 100+ specialists from 20+ countries.
- Work across fintech, MedTech, AI/ML, e-commerce and other projects, with the opportunity to switch teams or industries.
- Client interview preparation, training and actionable feedback.
- Well-structured processes, strong management and long-term vision.
- Core values: honesty, flexibility, innovation and a people-first approach.
- Regular salary.