Middle/Senior QA Engineer (AI products)
- Рівень:
- senior
- Джерело:
- djinni.co
Що робити
- Take ownership of product quality across our Salesforce-related solutions, initially focusing on the Ascendix AI Agent;
- Perform functional, regression, and exploratory testing of both deterministic and non-deterministic functionality;
- Evaluate AI-generated responses for accuracy, hallucinations, and correct execution of actions;
- Design, maintain, and improve LLM evaluation datasets, scoring criteria, and regression tests;
- Develop and maintain automated tests using Playwright and modern AI-assisted tools;
Що очікуємо
- 5+ years of experience in Software Quality Assurance;
- Hands-on experience testing AI-powered applications with non-deterministic outcomes, such as LLM-based products, AI agents, or chatbots;
- Practical experience with LLM evaluation techniques, including test datasets, scoring rubrics, LLM-as-judge approaches, and regression tracking;
- Experience in test automation and maintaining automated test suites;
- Solid API testing skills using Postman or similar tools;
Що пропонуємо
- Experience with Playwright (TypeScript or JavaScript);
- Salesforce testing experience, including Lightning, managed packages, and permission sets;
- Familiarity with LLM evaluation tools such as Promptfoo, DeepEval, Ragas, or Langfuse;
- Experience using AI-assisted development tools such as Claude Code, Cursor, or similar;
- Basic prompt engineering skills;
Схожі вакансії
З блогу Trackr
Усі статті →
Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot