We’re looking for a quality-focused engineer who combines a solid manual testing foundation with hands-on automation experience and a growing interest in AI evaluation. You care deeply about how systems behave, you’re not satisfied with surface-level testing, and you’re excited about what modern QA looks like in an AI-driven world.
What you’ll do
Design and execute evaluation strategies for AI-powered features, including LLM-based flows, recommendation engines, and decision logic.
Validate AI outputs for correctness, consistency, bias, hallucination risk, and edge cases — defining clear qualitative and quantitative acceptance criteria.
Perform deep manual, exploratory, and scenario-based testing across the product, from AI-driven flows to core application functionality.
Build and maintain automated UI and API test suites, and keep them running reliably in CI/CD.
Build and maintain automated evaluation and regression pipelines for AI-enabled systems.
Identify non-determinism and reliability risks specific to AI systems and propose practical mitigations.
Partner closely with engineers and product teams to improve testability, observability, and overall release quality.
Performance, load, and security testing.
What we’re looking for
Sharp analytical thinking and attention to detail — you notice what others miss.
4+ years of hands-on manual testing experience, including exploratory testing, test planning, and writing acceptance criteria for complex or enterprise systems.
4 +years of test automation experience using frameworks such as Playwright, Cypress, or Selenium — covering UI and/or API layers.
Confident writing and maintaining test code in TypeScript/JavaScript, Python, Java.
Demonstrated ability to own a full test strategy, not just execute test cases.
Strong understanding of AI system behavior, including non-determinism, prompt sensitivity, and the unique challenges of validating model outputs.
Reads backend code comfortably to debug test failures and understand system behavior.
Nice to have
Experience with AI evaluation frameworks, prompt testing, or model validation techniques.
Familiarity with agentic QA concepts and AI-assisted testing workflows.
Hands-on SDET experience — from framework design to internal tooling.
Exposure to observability tooling and how it supports quality in production systems.
What We Offer
Competitive compensation and benefits package.
Remote-first work with a flexible schedule.
Opportunities for professional growth, training, and certifications.
A dynamic environment where innovation, security, operational excellence, and cutting-edge ML technologies are highly valued.
Projects that span cutting-edge AI, UX, fintech, and healthtech domains.
