About us:
Devlight is the AI partner for companies moving from manual work to intelligent operations. We design and build AI agents, intelligent workflows, and product experiences that reduce manual effort, improve decision-making, and strengthen customer experience. Built on a decade of delivering digital products used by millions, we bring product discipline to AI, designing systems that teams can operate, trust, and improve over time. Our clients: Nova Poshta, Sense Bank, Aurora, OKWINE, NOVUS, VARUS, BROCARD, Dnipro-M, and many others.
About the role:
Devlight builds AI systems for enterprise clients, from discovery and architecture through release and production operation. We are hiring an engineer to build agentic systems. The current engagement is a conversational agent inside a client product with a large user base: the agent interprets the request, decides which tools to call, retrieves data from the client’s systems through typed contracts, streams the response into the application, and returns structured actions the application executes itself. The system is already designed: there is an architecture vision with C1—C3 views, ADRs for every key decision, tool contracts, and specifications for guardrails, grounding, and evaluation methodology. A solution architect owns the architecture, and the project tech lead runs day-to-day supervision. Your part is implementation and getting it to release against a written specification. Technical context: TypeScript / Node.js (NestJS), Anthropic API, streaming to the client, Postgres and Redis, Kubernetes on AWS, end-to-end observability on OpenTelemetry. This is a project hire of about 3 months, with the scope likely to expand. After successful delivery, the collaboration continues on other projects at the company.
Your future responsibilities:
Your future responsibilities:
Build the agent core: the think—act—observe loop, tool selection, session state, layered prompts with caching.
Implement the agent’s tools and the call runtime: typed contracts, retries, timeouts, error mapping.
Guardrails and grounding: input filtering, response validation against retrieved data, safe fallbacks for every failure mode.
Streaming to the client: incremental delivery, structured action events for the application, reconnection and backpressure.
Evaluation: assemble datasets, build the run harness, wire regression gates before releases and before any model or prompt change.
Observability: tracing, cost and latency metrics, dashboards, incident analysis from traces.
Extend the stack where the work calls for it: vector and hybrid retrieval, multimodal input, streaming voice.
Work from written specifications and keep them current.
Your professional qualities:
5+ years of professional experience as a software engineer.
At least one agent you took to production with real users.
Tool design: granularity, argument and response schemas, error and timeout handling, how the agent behaves when a call fails.
Multi-step loops and context: layered prompt structure with caching, session and conversation state, parallel tool calls, recovery after failure, token and latency budgets.
LLM APIs at the level of detail: tool use, structured outputs, streaming, prompt caching, limits and retries.
Grounding and guardrails: validating responses against the source, input filtering, off-topic and jailbreak handling, discipline around personal data.
Choosing the grounding approach for the data at hand: direct tool calls or RAG, with the decision argued.
Evaluation as a practice: test case sets, automated grading with LLM-as-judge, regression gates before a release and before any prompt or model change.
Tracing and metrics: every model call and tool call as a span, cost and latency per conversation, diagnosing an incident from the trace.
Production backend work in TypeScript / Node.js: NestJS or a comparable framework, REST, streaming over SSE or WebSocket, Postgres and Redis.
Claude Code (or a compa
