Staff Software Engineer: AI Inference Data Plane

  • $167.2K - $209K / year
  • US only · US (remote)
  • Posted 4 months ago

About the role

The data plane behind DigitalOcean's inference offering: multi-tenant, high scale, hosting large generative models with real availability requirements. Tensor and data parallelism, KV cache optimisation, and vLLM are named directly.

This is the layer where inference economics are decided, and it sits between distributed systems work and hardware behaviour in a way very few roles do.

US remote, Python and Go with Kubernetes and gRPC. The posting notes it is hands-on and expects full use of current AI coding tools.

Skills

How to apply

Apply directly on the employer's application page. Your application goes straight to them.

More from Digital Ocean

  1. Manager, AI Engineering - AI & Business Tech Engineering

    Digital Ocean US only · US (remote)

    $180K - $200K per year
    Python Management
  2. Principal Software Engineer

    Digital Ocean US only · US (remote)

    $235.2K - $294K per year
    Go Backend
  3. Principal Infrastructure Architect

    Digital Ocean US only · US (remote)

    $184K - $231K per year
    GPU DevOps / SRE
  4. Principal Engineer, Data Center Architect

    Digital Ocean US only · US (remote)

    $184K - $231K per year
    GPU DevOps / SRE

Jobs like this

  1. Staff Software Engineer- AI Platform

    Aledade US only · United States

    $176K - $238K per year
    Python Backend
  2. Senior Platform Software Engineer, Transport

    Fivetran US only · US (remote)

    $152.9K - $183.5K per year
    Python Backend
  3. Staff Software Engineer, Ecosystem

    Boulevard US only · United States

    $193.9K - $225K per year
    APIs Backend
  4. AI Native Senior Software Engineer

    Versaterm Canada only · Canada

    $140K - $170K per year
    AI Backend

Republished listing

This opportunity was discovered on Digital Ocean's public careers page and is republished here for discovery purposes. Applications are handled by the employer.

If this is your role and you want it off the board, contact us.