About the company
Sutherland works with iconic brands worldwide, bringing a unique value proposition through market-leading technology and business process excellence, with over 200 unique inventions under several patents across AI and other critical technologies.
Responsibilities
- Build test suites validating agent outputs against golden-record datasets across covered processes
- Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business
- Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes
- Feed findings into the human QA function for final sign-off
Requirements
- 5+ years QA/test engineering experience, ideally including ML/LLM output validation
- Experience defining test datasets and accuracy benchmarks for document/text-processing systems
- Domain process familiarity a plus for building realistic test scenarios