Kubernetes Administrator & AI Engineer

About

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Scepter Technologies, Inc, is seeking the following.

Role

Kubernetes Administrator & AI Engineer

Location

Herndon VA - Day 1 Onsite.

Certifications

AWS Certified AI Foundations or AWS Certified AI Professional certifications (Mandatory)

Employment Type

Long Term Contract.

Sponsorship

No Sponsor shipt.

Responsibilities

• Strong Kubernetes skills including disconnected installation, Kubernetes administration, and troubleshooting issues with the system.
• Extensive hands-on experience on EKS cluster deployment and upgrade in the production environment.
• Extensive EKS troubleshooting experience.
• Proven experience in LLMOps, including the deployment, monitoring, and scaling of Generative AI systems in production environments.
• Experience orchestrating and maintaining agentic workflows using frameworks like LangChain, CrewAI, or AutoGen.
• Hands-on experience managing vector databases (e.g., Pinecone, Weaviate, Milvus) and optimizing RAG (Retrieval-Augmented Generation) pipelines for low latency.
• Implementation of AI Governance, including security guardrails (e.g., NeMo Guardrails) and cost-management strategies for LLM consumption.
• Experience building Internal Developer Platforms (IDP) for AI, providing shared tooling for model experimentation and deployment.