Generative AI Operations Engineer

About

As a Generative AI Operations Engineer, you will design, deploy, and maintain the operational backbone for large-scale GenAI models and services. You will collaborate with data scientists, ML engineers, and software developers to ensure AI applications are scalable, reliable, and efficient across cloud platforms. You will build automated CI/CD pipelines for training, evaluating, and deploying LLMs and AI agents, while managing sophisticated multi-agent systems. You will integrate AI agents with external tools using MCP, implement IaC (Terraform), and establish robust monitoring, security, and cost-aware architectures. This role offers the chance to shape production GenAI infrastructure.

Benefits

• Design, implement and maintain automated CI/CD pipelines for training, evaluating, and deploying LLMs and AI agents
• Deploy and manage multi-agent AI systems with reliable agent-to-agent communication
• Integrate AI agents with external tools and APIs using Model Context Protocol (MCP)
• Utilize AI-powered development tools to accelerate infrastructure code, testing, and debugging in cloud environments
• Define and manage GenAI infrastructure using Terraform or similar IaC tools
• Implement monitoring and logging to track model/agent performance, resource usage, and health, including tracing
• Design scalable architectures for model serving and inference with a focus on performance and cost
• Apply security best practices and ensure regulatory compliance for GenAI infrastructure and data

Requirements