Senior Engineer, AI Inference Development

About

Lead AI inference development as a Senior Engineer focused on LLM optimization. Utilize your knowledge in vLLM and innovative strategies to create efficient AI systems during a rapid growth phase.

We seek a dedicated engineer with at least 3 years in software development. You’ll oversee the optimization of our AI inference engine, ensuring it remains performant and cost-effective. Collaborate with a talented team as you drive innovation and maintain high standards across the product.

Take the next step in your career at an ambitious AI startup focused on reliability and performance.

Key Responsibilities

• Oversee optimization of LLM inference engine
• Drive performance and scalability enhancements
• Collaborate with team members to implement advanced AI models
• Maintain a reliable and high-quality product
• Engage actively in fostering innovation and team culture

Requirements

• Minimum 3 years of software engineering experience
• Expertise in vLLM, quantization and LLM techniques
• Bachelor’s or Master’s degree from a leading university
• Proficiency in Python and familiarity with Kubernetes
• Commitment to high standards and innovation