AI QA Automation Engineer (Python)

Що робити

• Build automated evaluation frameworks for agents, RAG, prompts, tools, workflows, and model outputs.
• Create benchmark datasets, golden responses, regression suites, evaluation metrics, and release thresholds.
• Test hallucination, grounding, citation accuracy, prompt injection, tool selection, and multi-agent coordination.
• Develop agents that generate test cases, validate API and workflow outputs, and support intelligent UAT.
• Build UI, API, integration, performance, end-to-end automation, and CI/CD quality gates.