About the company
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior/Mid-level Quality Engineering Analyst based in Brazil.
Responsibilities
- Analyze LLM behavior and design rigorous test scenarios that assess the accuracy, consistency, safety, and contextual relevance of AI-generated responses.
- Execute functional, exploratory, regression, and automated tests across conversational flows and APIs.
- Establish validation routines for generative models, identifying and mitigating hallucinations.
- Investigate integration anomalies, document issues, and collaborate with engineering teams.
- Validate RESTful APIs, integrations, and data flows.
- Assess usability, responsiveness, and performance of AI-powered journeys.
- Work within agile environments and maintain technical communication with stakeholders.
Requirements
- Hands-on experience creating and executing functional, exploratory, and regression tests.
- Practical experience with test automation frameworks such as Cypress or Robot Framework.
- Ability to translate expected AI and LLM behavior into structured test scenarios.
- Experience testing RESTful APIs with tools such as Postman.
- Comfortable using generative AI tools such as GitHub Copilot.
- Experience with cloud environments and querying relational and non-relational databases.
- Experience working in agile teams.
Conditions
- Fully remote position based in Brazil.
- Opportunity to work with LLM-powered conversational experiences and generative AI technologies.
- Exposure to software quality engineering, test automation, APIs, cloud environments, databases, and complex integrations.