Sr AI Platform Engineer- AI Platform Engineer

Job Description

Qualifications

• 5-10+ years software engineering or ML infrastructure experience.
• Strong Python engineering fundamentals (FastAPI, async, typing/Pydantic, testing).
• Experience with model safety/guardrails approaches (prompt injection defense, PII redaction, toxicity filters, policy enforcement).
• Hands on with Arize AI, LangSmith, or similar LLM observability platforms.
• Experience creating evaluation frameworks using RAGAS, G Eval, or custom rubric systems.
• Strong familiarity with vector databases (Pinecone, Weaviate, Milvus), embeddings, and retrieval pipelines.
• Solid understanding of LLM architectures, tokenization, embeddings, context limits, and RAG patterns.
• Experience in cloud (GCP preferred), Kubernetes/GKE, containers, and CI/CD.
• Strong understanding of security, governance, DLP, data privacy, RBAC, and enterprise compliance requirements.

Soft Skills

• Strong documentation and communication skills.
• Ability to influence engineering teams and standardize best practices.
• Comfortable working across multiple stakeholders-platform, security, ML engineering, product.

Nice to Have

• Experience with LangChain/LangGraph or LlamaIndex orchestrations.
• Experience with Guardrails.ai, Rebuff, Protect AI, or similar LLM security tooling.
• Experience with GCP Vertex AI pipelines, Model Monitoring, and Vector Search.
• Familiarity with knowledge graphs, grounding models, fact checking models.
• Building SDKs or developer frameworks adopted across multiple teams.
• On prem or hybrid AI deployment experience.