DevOps Engineer (AI Platform)

About

This role would be more on the implementation side focusing on implementing and operating the platform. They will handle LLM model onboarding configs, manage deployments using Helm/ArgoCD. They will also help maintain CI/CD pipelines.

Key skills to look for:

• Basic to High level understanding LLM integration
• LLM Fundamentals: LLM API familiarity (understanding tokens, TPM/RPM limits, context windows, model versioning)
• Programming Python: (for Gateway configurations, hooks, and custom callbacks)
• Working knowledge of Kubernetes
• Helm and ArgoCD / GitOps experience
• Docker and CI/CD pipelines
• AWS / cloud deployment exposure
• YAML-based configuration management