GenAI Engineer

Customer Need

The project is focused on building production-grade GenAI solutions with emphasis on:

• RAG pipelines leveraging LLMs
• Prompt engineering (system/tool prompts, function calling, versioning with evals)
• Evaluation & observability (ground truth setup, confusion metrics, LLM-as-judge with human review, cost & latency monitoring)
• Retrieval strategies & prompt patterns (context management, hallucination mitigation)
• LangChain/LlamaIndex (or equivalent) proficiency
• Cloud LLM providers (Azure OpenAI, AWS Bedrock, Vertex AI)
• Workflow orchestration (Airflow, Dagster)
• Security & privacy (PII handling, RBAC)
• Python expertise with strong practical experience

Success criteria:

A production-ready prompt + RAG pipeline system with measurable quality lift (accuracy/confusion metrics) and reduced hallucinations, backed by a repeatable evaluation harness.