Engineering Manager, AI Inference Systems

In this role, you will:

• Own substantial portions of our inference stack
• Ensure we have the ability to run GPT-4, ChatGPT, and future models at increasingly high scale with increasing efficiency
• Hire world-class AI systems engineers in one of the most competitive hiring markets
• Coordinate the inference needs of OpenAI's teams and products
• Create a diverse, equitable, and inclusive culture that makes all feel welcome while enabling radical candor and the challenging of group think

You might thrive in this role if you:

• Have 3+ years of experience in engineering management and 7+ years as an IC working with high scale distributed systems and ML systems.
• Have experience with ML systems, particularly high scale distributed inference for modern LLMs.
• Have experience with highly available, reliable, production grade systems at scale
• Have familiarity with the latest AI research and working knowledge of how these systems are efficiently implemented
• Care deeply about diversity, equity, and inclusion, and have a track record of building inclusive teams
• Have experience closing extremely competitive candidates for your team, and the ability to craft and convey compelling visions of the future
• Have a voracious and intrinsic desire to learn and fill in missing skills—and an equally strong talent for sharing learnings clearly and concisely with others
• Are comfortable with ambiguity and rapidly changing conditions. You view changes as an opportunity to add structure and order when necessary