AI Engineer III

Job Summary

The AI Engineer III is the lead builder of the "Engine Room," responsible for the reliability, scalability, and observability of the Pantheon AI Mesh and Azure AI Foundry stack. This role designs and maintains the CI/CD pipelines for models and agents, ensuring that AI solutions are deployed securely, monitored for drift, and can be rolled back instantly if issues arise.

Essential Functions

• Architect and maintain the LLMOps/GenAIOps toolchain.
• Implement and manage the Azure AI Foundry environment.
• Develop comprehensive observability dashboards.
• Automate "Policy-as-API" controls for governance guardrails.
• Collaborate with the Platform SRE team for high availability and disaster recovery.
• Manage the "Model Registry."
• Configure and maintain "Vector Databases" and RAG pipelines.
• Implement "Prompt Filtering" and content moderation gateways.
• Develop "Blue/Green" or "Canary" deployment strategies for AI agents.
• Manage the "API Gateway" for all AI services.
• Optimize "GPU/CPU Orchestration."
• Build automated "Drift Detection" alerts.

Education And Experience

• Bachelor's degree in Computer Science, Engineering, or related technical field required (or equivalent experience).
• Five (5) years of IT engineering experience, with at least three (3) years specialized in DevOps, MLOps, or Cloud Infrastructure.
• Experience with Azure AI Services (Azure OpenAI, AI Search, Azure ML) and container orchestration (Kubernetes/AKS).
• Experience building and maintaining CI/CD pipelines for machine learning models or complex software applications.

Competencies, Knowledge And Skills

• Mastery of Python and scripting languages for automation and infrastructure-as-code (Terraform, Bicep, ARM templates).
• Deep understanding of LLMOps principles.
• Proficiency in Azure Networking and Security.
• Knowledge of Vector Databases and RAG infrastructure requirements.
• Strong observability skills.

Licensure And Certification (Preferred)

• Microsoft Certified: Azure AI Engineer Associate or Azure DevOps Engineer Expert.
• CKA (Certified Kubernetes Administrator).

Working Conditions

General office environment; may be required to sit or stand for extended periods of time. Travel is not typically required.

Compensation Range

Salary: $94,100.00 - $164,800.00

Compensation Type: Salary

In addition to base compensation, you may qualify for a bonus tied to company and individual performance. A substantial and comprehensive total rewards package is offered.