This position is no longer accepting applications. The listing is kept for reference.
Browse open rolesSenior ML Systems Engineer, Inference
About the role
Runpod rents GPU capacity to developers running AI workloads and says the platform has processed more than 20 billion inference requests. This role owns LLM serving performance end to end, against the stated goal of making Runpod the fastest and most cost efficient place in the world to run inference.
It is measurement before optimisation, which is the right order. Defining how inference performance is measured, meaning throughput, time to first token, inter-token latency and cost per token, and building tooling that makes those numbers rigorous and repeatable. Then profiling the serving stack from scheduling and memory management down to kernels and interconnect, for large models on single-node and multi-node GPU deployments. What you learn has to come back as production runtimes, configurations and defaults that customers benefit from without asking.
Runpod closed a $100M Series A in June 2026 and describes itself as a small, remote-first team. Remote within the United States.
Skills
More from Runpod
-
Cloud Infrastructure Security Engineer (Systems/Kernel)
Runpod US only
$152K - $175K per year -
Head of Analytics and Business Intelligence
Runpod US only · United States; no employment visa sponsorship
$200K - $280K per year -
Software Engineer (Full-Stack)
Runpod US only
$130K - $200K per year -
Director, Product Management
Runpod US only
$225K - $325K per year
Jobs like this
-
Senior Software Engineer, Agentic AI
Curai Health US only
$175K - $210K per year -
Software Engineer, New Grad, Machine Learning Platform
Quora North America · United States or Canada
$97.6K - $139K per year -
Senior Machine Learning Engineer
Coinbase US only · United States
$213.8K - $225K per year -
Staff Machine Learning Engineer, Compliance Automation (Platform)
Coinbase US only · United States
$218K - $256.5K per year
Republished listing
This opportunity was discovered on Runpod's public careers page and is republished here for discovery purposes. Applications are handled by the employer.
If this is your role and you want it off the board, contact us.