Senior AI Engineer

Introduction

Our client is seeking a Senior AI Engineer with a deep foundation in Platform Engineering. This role is a specialized hybrid, focusing on the intersection of robust Cloud Operations and the industrialization of AI services. You will be responsible for hosting, tuning, and scaling Large Language Models (LLMs) and RAG architectures within the Group IT Hub South Africa.

✅ DevOps & AI Hybrid

✅ GPU-Accelerated Kubernetes

Position Details

• Contract End Date: 01-04-2026 to 31-12-2028
• Location: Midrand/Menlyn/Rosslyn/Home Office Rotation
• Role Group: DevOps / Platform Engineering
• Experience Required: 4-6 years related experience

The Mission

Bridge the gap between infrastructure and intelligence.

You will not only manage day-to-day cloud operations but also design and build AI-driven services using RAG (Retrieval-Augmented Generation), vector databases, and Group Managed LLMs.

A key focus will be the orchestration of GPU-accelerated node pools to host and tune high-performance models.

Desired Experience & Qualification

Qualifications & Experience

• Relevant IT Degree.
• 5 Years plus of experience in the essential skills listed above, specifically in a Platform or DevOps capacity.

Essential Skills (Verified)

• Cloud: Azure (AZ-104)
• Databases: SQL Language using PostgreSQL
• Container Orchestration: Kubernetes (CKAD)
• Infrastructure as Code: Terraform/Open Tofu
• Programming Languages: Python
• Templating Tools: Helm, Kustomize
• Operating Systems: Advanced Linux
• Version Control: Advanced Git and GitHub Enterprise
• CI/CD: Create, Manage and support Shared Workflows
• Monitoring: Grafana, Loki, Prometheus

Advantageous Skills

• AI Frameworks: LangChain, LangGraph, LangSmith, and Model Context Protocol (MCP).
• Generative AI: Experience with CoPilot, Claude Code, and Vector Databases.
• Hardware Orchestration: Managing GPU-accelerated node pools in Kubernetes.
• Web Frameworks: FastAPI, SQLAlchemy, or SQLModel.
• Methodology: Familiarity with the BMAD Method.

Package & Remuneration

Key Responsibilities

• Design, Build and Test New Cloud Configurations.
• Optimize Performance, Operational Excellence and Costs within our teams cloud environments
• Developer Support regarding Planform Topics.
• Design, Build and Test AI services using REST and Group Managed LLM's
• Host, Manage and Tune deployed LLMs in Kubernetes GPU Enabled node pool
• Design, Build and Test an AI RAG using vector database

Interested?