C
Founding Platform Engineer
CT19
New York · On-site Full-time Lead 3w ago
About the role
The Role
Our client is hiring a Founding Platform Engineer to build the backbone of their training, evaluation, and inference systems
This is a central role within the business. You’ll be responsible for designing and building systems that transform messy, large-scale data into formats that models can reliably learn from. You’ll operate across the full stack from data ingestion through to production inference.
What You’ll Work On
- Building and scaling infrastructure for model training, evaluation, and inference
- Designing high-performance inference systems
- Creating clean, standardised dataset interfaces
- Developing ingestion and processing pipelines across multiple data sources
- Building indexing, search, and retrieval systems for large-scale datasets
- Ensuring datasets are versioned, reproducible, and reliable
- Improving performance across distributed systems (GPU, networking, storage)
- Identifying and resolving bottlenecks in ML pipelines
- Implementing fault detection and recovery mechanisms
- Building internal tooling for debugging, inspection, and data quality
- Collaborating closely with ML engineers and researchers
- Contributing to best practices around handling sensitive data
What We Are Looking For:
- Backend, infrastructure, or distributed systems engineering
- Scaling data pipelines or production systems
- Large-scale ML systems (training and/or inference)
- GPU performance, memory constraints, and data loading challenges
- Designing systems for datasets that exceed memory limits
- Indexing, search, or retrieval systems
- Balancing latency, throughput, and cost trade-offs
- Building internal tools for technical teams
- Working with sensitive or regulated data
- A strong focus on reliability, reproducibility, and simplicity
- Modern infrastructure (cloud, containers, Kubernetes, CI/CD, observability)
- Writing clean, maintainable code with pragmatic decision-making
- Thriving in fast-paced, early-stage environments
Skills
CI/CDCloudContainersKubernetesML
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free