About the Company
Sutherland is a global digital transformation company that combines human expertise and artificial intelligence to deliver measurable results. We work with iconic brands worldwide, providing market-leading technology and business process excellence.
Responsibilities
- Build test suites validating agent outputs against golden-record datasets across covered processes.
- Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business.
- Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes.
- Feed findings into the human QA function for final sign-off — this role supports human QA authority on regulated activity with technical evidence, not replaces it.
Requirements
- 5+ years QA/test engineering experience, ideally including ML/LLM output validation (not just deterministic software testing).
- Experience defining test datasets and accuracy benchmarks for document/text-processing systems.
- Domain process familiarity a plus for building realistic test scenarios.
Conditions