This position is no longer accepting applications. The listing is kept for reference.

Browse open roles

Senior ML Systems Engineer, Inference

  • $150K - $220K / year
  • US only
  • Posted about 2 months ago

About the role

Runpod rents GPU capacity to developers running AI workloads and says the platform has processed more than 20 billion inference requests. This role owns LLM serving performance end to end, against the stated goal of making Runpod the fastest and most cost efficient place in the world to run inference.

It is measurement before optimisation, which is the right order. Defining how inference performance is measured, meaning throughput, time to first token, inter-token latency and cost per token, and building tooling that makes those numbers rigorous and repeatable. Then profiling the serving stack from scheduling and memory management down to kernels and interconnect, for large models on single-node and multi-node GPU deployments. What you learn has to come back as production runtimes, configurations and defaults that customers benefit from without asking.

Runpod closed a $100M Series A in June 2026 and describes itself as a small, remote-first team. Remote within the United States.

Skills

More from Runpod

  1. Cloud Infrastructure Security Engineer (Systems/Kernel)

    Runpod US only

    $152K - $175K per year
    Linux DevOps / SRE
  2. Head of Analytics and Business Intelligence

    Runpod US only · United States; no employment visa sponsorship

    $200K - $280K per year
    SQL Management
  3. Software Engineer (Full-Stack)

    Runpod US only

    $130K - $200K per year
    Full Stack Full-stack
  4. Director, Product Management

    Runpod US only

    $225K - $325K per year
    GPU Management

Jobs like this

  1. Senior Software Engineer, Agentic AI

    Curai Health US only

    $175K - $210K per year
    Agents Data / ML
  2. Software Engineer, New Grad, Machine Learning Platform

    Quora North America · United States or Canada

    $97.6K - $139K per year
    Machine Learning Data / ML
  3. Senior Machine Learning Engineer

    Coinbase US only · United States

    $213.8K - $225K per year
    Machine Learning Data / ML
  4. Staff Machine Learning Engineer, Compliance Automation (Platform)

    Coinbase US only · United States

    $218K - $256.5K per year
    Machine Learning Data / ML

Republished listing

This opportunity was discovered on Runpod's public careers page and is republished here for discovery purposes. Applications are handled by the employer.

If this is your role and you want it off the board, contact us.