AI Integrator
- Джерело:
- djinni.co
Що робити
- Model Serving & API
- ▪ Evaluate and deploy open-source LLMs via vLLM, Ollama, or TGI on GPU infrastructure;
- ▪ Design and maintain a REST API with auth, rate limiting, versioning, and API documentation;
- ▪ Optimize inference: quantization, batching, and concurrency tuning for latency/cost trade-offs.
- Web App Integration
Що очікуємо
- ▪ 3+ years of experience across backend, API design, and web technologies;
- ▪ Proven track record deploying or integrating LLMs in production (open-source models strongly preferred);
- ▪ Hands-on knowledge of REST API design and at least one API framework;
- ▪ Experience building AI features in web apps, including streaming and async response handling;
- ▪ Familiarity with document processing workflows — OCR, parsing, classification at scale;
Схожі вакансії
З блогу Trackr
Усі статті →Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot


