Infrastructure Software Engineer

About

As an Infrastructure Software Engineer at Baseten, you’ll build and maintain components of our ML inference platform that powers production AI applications. You’ll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance.

Responsibilities

• Develop infrastructure components for our ML inference platform using Python and Go
• Implement and maintain Kubernetes deployments for model serving
• Contribute to our inference orchestration layer for model deployments
• Build and enhance monitoring systems for model performance metrics
• Implement efficient resource management solutions for ML workloads
• Support infrastructure automation to improve ML deployment workflows
• Work closely with team members to implement technical solutions
• Help balance performance optimization with system reliability
• Participate in technical discussions around infrastructure improvements
• Learn and apply infrastructure best practices

Benefits

• Remote-first work environment. The Baseten team is welcome to work from wherever they want; fully remote, in our San Francisco office, or a mix of both. Today, our team (including our founding team) is spread across the United States, Canada, and Armenia. We provide a $1,000 stipend for you to make your home-office comfortable and productive
• Regular in-person team summits. We get together as a team three times a year to plan, workshop, and most importantly, get to know each other better
• Unlimited PTO. We ask that everyone take at least 4 weeks of vacation. And we have a company-wide break between Christmas and New Year’s Day
• Full healthcare coverage. Medical, dental and vision insurance for you and your family
• Paid parental leave. 16-weeks fully paid parental leave (adoptive and non-birth parents included) and flexibility with schedules while returning to work
• Company-sponsored 401(k) for you to contribute to
• Learning and development budget. We encourage you to take classes, attend conferences, and invest in your craft and we’ll cover expenses to make it happen