Software Engineer, OpenInference

About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high‑performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top‑tier investors, with over $135 M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Join Arize AI's Engineering team working on OpenInference – the industry‑leading open‑source standard for AI observability, LLM and agent instrumentation. You’ll define how organizations instrument, trace, and observe their AI applications across the entire ecosystem, shaping the future of AI development worldwide. This role demands exceptional technical versatility, deep community engagement, and end‑to‑end ownership from conception to delivery.

What You’ll Do

• Build new LLM and instrumentation libraries for emerging LLM providers and agent frameworks
• Maintain and enhance existing instrumentation across Python and TypeScript ecosystems (e.g., OpenAI, Anthropic, LlamaIndex, CrewAI, and many more)
• Drive improvements to semantic conventions and OpenTelemetry standards that define AI observability
• Collaborate with the global developer community through GitHub, Slack, and conferences, as well as Arize PMs and solution architects
• Take complex problems from ideation to completion with full ownership and accountability

What We’re Looking For

• 3–5+ years of software development experience shipping production code
• Expert‑level proficiency in both Python and TypeScript
• Community‑oriented mindset with genuine passion for collaborative open‑source development
• Deep interest in the AI/LLM ecosystem with a desire to stay current on emerging technologies
• Strong analytical skills to distill requirements from diverse sources and stakeholders

Bonus Points (Not Required)

• Experience building SDK clients, instrumentation libraries, or platform APIs
• Hands‑on experience with AI/ML observability or evaluation systems

What Makes This Role Unique?

• Direct impact on the AI ecosystem by building instrumentation that powers the next generation of AI applications across thousands of companies
• Work at the intersection of open‑source community building and enterprise‑scale AI deployments, helping define industry standards while staying at the forefront of LLM technologies

Compensation & Benefits

• Estimated annual salary: $125,000 – $225,000 plus a competitive equity package (actual compensation based on experience, skill set, and qualifications)
• Comprehensive benefits package: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave, mental health and wellness support
• Remote‑first company with optional office locations in New York City and the San Francisco Bay Area; WFH monthly stipend for co‑working spaces

Diversity & Inclusion @ Arize

• Commitment to making AI work for people and reducing bias industry‑wide
• Regular chats with industry experts, researchers, and ethicists to advance responsible AI
• Culturally conscious events such as LGBTQ trivia during Pride month
• Active “Lady Arizers” subgroup fostering an inclusive community