US only · US (remote)

Staff Software Engineer: AI Inference Data Plane

Digital Ocean Posted about 2 months ago $167.2K - $209K

Apply now
All remote roles

About the role

The data plane behind DigitalOcean's inference offering: multi-tenant, high scale, hosting large generative models with real availability requirements. Tensor and data parallelism, KV cache optimisation, and vLLM are named directly.

This is the layer where inference economics are decided, and it sits between distributed systems work and hardware behaviour in a way very few roles do.

US remote, Python and Go with Kubernetes and gRPC. The posting notes it is hands-on and expects full use of current AI coding tools.

Skills

Backend Python Go Kubernetes gRPC LLMs vLLM

How to apply

Apply directly on the employer's application page. Your application goes straight to them.

More from Digital Ocean

  1. Manager, Customer Success Engineering

    Digital Ocean · US only · US (remote)

    $125K - $153K Support Python

  2. Manager, AI Engineering - AI & Business Tech Engineering

    Digital Ocean · US only · US (remote)

    $180K - $200K Management Python

  3. Principal Software Engineer

    Digital Ocean · US only · US (remote)

    $235.2K - $294K Backend Go

  4. Principal Infrastructure Architect

    Digital Ocean · US only · US (remote)

    $184K - $231K DevOps / SRE GPU

Jobs like this

  1. Senior Platform Software Engineer, Transport

    Fivetran · US only · US (remote)

    $152.9K - $183.5K Backend Python

  2. Senior Software Engineer - Model Evaluation & AI Systems

    Deepgram · US only · US (remote)

    $180K - $240K Backend Python

  3. AI Provider Operations & Support Engineer

    OpenRouter · US only · US (remote)

    $215K - $280K Backend Python

  4. Senior Backend Engineer

    You.com · US only · US (remote)

    $200K - $250K Backend Python

Republished listing

This opportunity was discovered on Digital Ocean's public careers page and is republished here for discovery purposes. Applications are handled by the employer.

If this is your role and you want it off the board, contact us.