MLOps Engineer (LLM Infrastructure)

Що робити

• Design, build, and maintain infrastructure for deploying, serving, and monitoring machine learning models at scale
• Deploy and scale large language models (7B-376B parameters) across varied sizes, optimizing for latency, throughput, and cost
• Operate and enhance a multi-provider gateway for routing requests between self-hosted models and external APIs
• Develop and manage automated pipelines for model training, fine-tuning, evaluation, and continuous delivery
• Monitor production ML services, implement observability, and respond to incidents