RAG + Agentic AI Engineer (India) (Remote)

Job Description — RAG + Agentic AI Engineer

About Us

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.

About the Role

We are looking for a highly skilled RAG + LLM-based Agentic AI Engineer to build production-grade retrieval systems, multi-agent workflows, and enterprise-ready AI applications. You will work across document pipelines, model orchestration, tool-driven agents, and governed AI systems that power Codvo’s next-generation products

.

Key Responsibilities

- Build end-to-end RAG pipelines: smart chunking, hybrid retrieval, reranking, query rewriting.

- Implement LangGraph-based agentic workflows with tools, planning, and self-healing behaviors.

- Develop and optimize vector search systems (Qdrant/Weaviate/OpenSearch).

- Design multi-tenant, ontology-driven knowledge layers for enterprise data.

- Implement guardrails, hallucination reduction, and automated evals.

- Build and maintain document ingestion pipelines (PDF, DOCX, OCR, images).

- Architect and deploy FastAPI-based AI microservices with caching and async execution.

- Integrate LLM systems with enterprise apps (SharePoint, CRM, databases, MCP tools).

- Ensure security, PII safety, auditability, and governance requirements are met.

- Collaborate with solution architects and domain SMEs to translate use cases into working AI systems.

Core Skills & Competencies

RAG Engineering:

- Smart/component-aware chunking

- Hybrid retrieval (BM25 + dense)

- Reranking

- Graph-RAG basics

- Query rewriting & multi-hop retrieval

Agentic AI:

- LangGraph

- MCP tools

- Multi-agent orchestration

- Tool-calling workflows

Vector & Search:

- Qdrant or Weaviate

- OpenSearch/Elasticsearch

- HNSW tuning

LLM Ops:

- Prompt engineering

- Hallucination control

- RAG/agent eval frameworks

- Synthetic data generation

Backend & Infra:

- Python, FastAPI

- Async programming

- Docker, CI/CD

- Cloud basics

Data Engineering:

- Document parsing

- ETL pipelines

- Caching, batching, streaming

Security & Governance:

- PII handling

- Access control

- Audit trails

Nice-to-Have

- Experience with Haystack, LlamaIndex, or RAG frameworks

- Fine-tuning retrievers or small LLMs

- Ontology modeling

- Enterprise search deployments

- Agents in customer support, ops, legal, engineering

What You’ll Get

- Work on cutting-edge agentic AI systems at production scale

- Ownership over enterprise-grade architectures

- Fast growth environment

- Influence Codvo’s platform and accelerators

Experience: 5+ Years